439f1b193d
sycl: add GGML_SYCL_USE_ASYNC_MEM_OP env toggle ( #22153 )
...
* sycl: add GGML_SYCL_USE_ASYNC_MEM_OP env toggle
Signed-off-by: Chun Tao <chun.tao@intel.com >
* Use async mem ops for correctness when SYCL graphs are explicitly on.
Signed-off-by: Tao, Chun <chun.tao@intel.com >
---------
Signed-off-by: Chun Tao <chun.tao@intel.com >
Signed-off-by: Tao, Chun <chun.tao@intel.com >
Co-authored-by: Chun Tao <chun.tao@intel.com >
2026-05-19 09:44:02 +03:00
0caf2a1d48
sycl: scalar SWAR byte-subtract in Q6_K MMVQ dot product ( #22156 )
...
Signed-off-by: Chun Tao <chun.tao@intel.com >
Co-authored-by: Chun Tao <chun.tao@intel.com >
2026-05-18 08:12:21 +03:00
5511965b19
sycl: route small f32 matmuls to oneMKL, bypass oneDNN ( #22150 )
...
Signed-off-by: Chun Tao <chun.tao@intel.com >
Co-authored-by: Chun Tao <chun.tao@intel.com >
2026-05-18 08:11:51 +03:00
60489932ec
sycl: Q5_K reorder MMVQ/dequant + Q8_0 reorder MMVQ path ( #22152 )
...
* sycl: Q5_K reorder MMVQ/dequant + Q8_0 reorder MMVQ path
Signed-off-by: Chun Tao <chun.tao@intel.com >
* Remove duplicate definitions
---------
Signed-off-by: Chun Tao <chun.tao@intel.com >
Co-authored-by: Chun Tao <chun.tao@intel.com >
Co-authored-by: Todd Malsbary <todd.malsbary@intel.com >
2026-05-09 08:48:07 +03:00
4a4f819cb6
sycl: Battlemage AOT build via spir64_gen + MMQ subgroup annotations ( #22147 )
...
* sycl: Battlemage AOT build via spir64_gen + MMQ subgroup annotations
Signed-off-by: Chun Tao <chun.tao@intel.com >
* Remove unneeded/unnecessary comments and annotations
The MMQ subgroup annotations added are on functions gated behind
ggml_sycl_supports_mmq(). Revisit the need for these annotations
when that function changes.
---------
Signed-off-by: Chun Tao <chun.tao@intel.com >
Co-authored-by: Chun Tao <chun.tao@intel.com >
Co-authored-by: Todd Malsbary <todd.malsbary@intel.com >
2026-05-09 08:42:40 +03:00
c5703e03a5
sycl: support non-contiguous input in PAD op ( #22148 )
...
Signed-off-by: Chun Tao <chun.tao@intel.com >
Co-authored-by: Chun Tao <chun.tao@intel.com >
Co-authored-by: Todd Malsbary <todd.malsbary@intel.com >
2026-05-09 08:05:22 +08:00
ad09224658
sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET ( #22149 )
...
* sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET
Signed-off-by: Chun Tao <chun.tao@intel.com >
* Fix abort during test-backend-ops
Signed-off-by: Todd Malsbary <todd.malsbary@intel.com >
* Regenerate ops.md
Signed-off-by: Todd Malsbary <todd.malsbary@intel.com >
* Add scope_dbg_print to newly added SYCL ops.
Also add scope_dbg_print to existing ssm_conv op.
Signed-off-by: Todd Malsbary <todd.malsbary@intel.com >
---------
Signed-off-by: Chun Tao <chun.tao@intel.com >
Signed-off-by: Todd Malsbary <todd.malsbary@intel.com >
Co-authored-by: Chun Tao <chun.tao@intel.com >
Co-authored-by: Todd Malsbary <todd.malsbary@intel.com >
2026-05-07 18:51:33 +03:00
