f3101a8cc6
SYCL: add gelu_erf kernel ( #13749 )
...
* SYCL: add gelu_erf kernel
* refactor code
Co-authored-by: Atharva Dubey <atharva.dubey@codeplay.com >
* Use scope_op_debug_print
---------
Co-authored-by: Atharva Dubey <atharva.dubey@codeplay.com >
2025-05-27 20:52:59 +05:30
Akarshan Biswas and GitHub
6f180b915c
SYCL: Add non contiguous support in RMS_NORM and NORM kernels ( #13611 )
...
* SYCL: Add non contiguous input support to norm kernel
* refactor and add RMS_NORM non contiguous input support
ggml-ci
* restore subgroup reduction for multi-subgroup thread blocks in norm kernels
* Swap grid dims of nsamples and nrows
ggml-ci
* Revert "Swap grid dims of nsamples and nrows"
This reverts commit 43be2d657fec7f7fba54e2cd154106bc0fc45adf.
* restore not required changes
ggml-ci
* address review comments: change it to more like SYCL
* Use a common function to calculate offset
* remove wrap around logic for handling broadcasts
* remove static from calculate_offset fn and use ceil_div
2025-05-26 21:10:36 +05:30
Akarshan Biswas and GitHub
515fdbf7ed
SYCL: revert "sycl: simplify bin_bcast_kernel ( #13383 )" ( #13752 )
...
Temporarily reverted due to failing fp16 DIV operation
This reverts commit 02cdd2d8b0
2025-05-25 10:08:37 +03:00
Akarshan Biswas and GitHub
1e333d5bba
SYCL: Disable reorder optimize by default and stop setting tensor extras when optimize is disabled ( #13254 )
...
* SYCL: Do not set tensor extras when reorder optimize is disabled
* SYCL: Disable reorder optimize by default
2025-05-06 20:27:06 +05:30
Akarshan Biswas and GitHub
66645a5285
SYCL: Disable mul_mat kernels for noncontiguous tensor b ( #13308 )
...
ggml-ci
2025-05-05 13:39:10 +05:30
Akarshan Biswas and GitHub
a4c340f974
SYCL: Add all missing unary kernels ( #13074 )
...
* SYCL: Add all missing unary kernels
ggml-ci
* decouple kernel launch range from data size using strided loop
* use ciel_div helper for num_blocks
ggml-ci
* clean auto imported header files
2025-04-28 11:33:25 +02:00
Akarshan Biswas and GitHub
5368ddda7a
SYCL: Add non-contiguous support in ROPE ( #12993 )
...
ggml-ci
2025-04-21 19:13:30 +05:30
Akarshan Biswas and GitHub
8d66005763
SYCL: Refactor and enable FP16 in binary broadcast OPs ( #12975 )
...
* SYCL: refactor move to a separate file
* Fix binbcast
* Remove duplicates
* fix include formatting
* fix typo
2025-04-18 15:57:56 +02:00
Akarshan Biswas and GitHub
510676475f
SYCL: Add ROPE vision kernel ( #12887 )
...
* SYCL: Add ROPE vision kernel
* Add comment about rope mode
2025-04-15 10:37:42 +02:00
Akarshan Biswas and GitHub
75afa0ae31
SYCL: Fix im2col ( #12910 )
...
* SYCL: Fix im2col
* restore local workgroup size adjustments for large inputs
* restore format
2025-04-14 14:23:53 +02:00
Akarshan Biswas and GitHub
fccf9cae83
SYCL: Add fp16 type support to unary op kernels ( #12788 )
...
* SYCL: Add fp16 support to some elementwise OP kernels
* remove comment
ggml-ci
* Use static_cast directly
* remove not needed cast from tanh
* Use static cast and remove unneeded castings
* Adjust device_support_op for unary OPs
* Use cast_data and typed_data struct to deduplicate casting code
2025-04-11 16:03:50 +08:00
Akarshan Biswas and GitHub
8bbf26083d
SYCL: switch to SYCL namespace ( #12674 )
2025-04-01 10:11:39 +02:00
Akarshan Biswas and GitHub
6c02a032fa
SYCL: Remove misleading ggml_sycl_op_flatten function ( #12387 )
...
* SYCL: Remove misleading ggml_sycl_op_flatten function
* remove trailing whitespace
* Fix L2 norm from rebase
* remove try catch block from element_wise.cpp
* remove comment from common.hp
* ggml-sycl.cpp: Add try catch sycl::exception block in compute_forward
* norm.cpp: remove try catch exception block
2025-03-31 11:25:24 +02:00
Akarshan Biswas and GitHub
f17a3bb4e8
SYCL: implement memset ggml backend buffer interface ( #12580 )
...
* SYCL: implement memset ggml backend buffer interface
* use GGML_ABORT macro
* Do not wait for all queues to finish for memset operation
2025-03-27 09:46:00 +08:00
Akarshan Biswas and GitHub
e2f560175a
SYCL: disable Q4_0 reorder optimization ( #12560 )
...
ggml-ci
2025-03-25 18:40:18 +08:00
Akarshan Biswas and GitHub
c95fa362b3
ci: [SYCL] ggml-ci Use main GPU and enable sysman ( #12547 )
2025-03-24 19:35:38 +02:00
Akarshan Biswas and GitHub
48d7021c61
CI: fix SYCL build ( #12546 )
2025-03-24 14:58:32 +02:00
Akarshan Biswas and GitHub
b3c9a65673
SYCL: set extras only on GGML_TYPE_Q4_0 ( #12366 )
...
* SYCL: set extras only on GGML_TYPE_Q4_0
* release tensor_extras in reset buffer interface
2025-03-17 09:45:12 +08:00
Akarshan Biswas and GitHub
5e43f104cc
SYCL: Disable f16 Unary OPs as not supported by the kernels ( #12201 )
2025-03-05 16:58:23 +01:00
Akarshan Biswas and GitHub
ece9745bb8
SYCL: Move CPY kernels to a separate file and add few missing kernels ( #12133 )
...
* SYCL: refactor and move cpy kernels to a separate file
* Add few missing cpy kernels
* refactor and add debug logs
2025-03-03 11:07:22 +01:00
