3 people 663445b0de sycl: quantize and reorder the input to q8_1 when reorder is enabled (#13826) ...

* [WIP]: fuse q8 quantization and reorder

* wip2: fuse q8 quantization and reorder

* working q8 reorder commit

* restored common.hpp

* remove debug prints

* remove unnecessary headers and remove trailing whitespace

* Update ggml/src/ggml-sycl/ggml-sycl.cpp

Co-authored-by: Alberto Cabrera Pérez <alberto.cabrera@intel.com>

---------

Co-authored-by: Alberto Cabrera Pérez <alberto.cabrera@intel.com>

2025-06-02 10:12:20 +01:00

..

dpct

SYCL: Rename oneMKL to oneMath (#12192)

2025-04-01 16:24:29 +08:00

backend.hpp

sycl : implementation of reordered Q4_0 MMVQ for Intel GPUs (#12858)

2025-05-09 16:34:08 +01:00

binbcast.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

binbcast.hpp

SYCL: Refactor and enable FP16 in binary broadcast OPs (#12975)

2025-04-18 15:57:56 +02:00

CMakeLists.txt

cmake : Fix broken CMake error messages (ggml/1252)

2025-06-01 13:43:57 +03:00

common.cpp

SYCL: Remove misleading ggml_sycl_op_flatten function (#12387)

2025-03-31 11:25:24 +02:00

common.hpp

SYCL: Add non contiguous support in RMS_NORM and NORM kernels (#13611)

2025-05-26 21:10:36 +05:30

concat.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

concat.hpp

SYCL: Refactor ggml_sycl_compute_forward (#11121)

2025-01-10 08:13:03 +08:00

conv.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

conv.hpp

SYCL: Refactor ggml_sycl_compute_forward (#11121)

2025-01-10 08:13:03 +08:00

convert.cpp

sycl: reordered Q4_K MMVQ (#13109)

2025-05-15 17:35:44 +02:00

convert.hpp

sycl: addressing non-contiguous src1 mul_mats (nc and batched) (#13343)

2025-05-08 10:08:01 +01:00

cpy.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

cpy.hpp

SYCL: Move CPY kernels to a separate file and add few missing kernels (#12133)

2025-03-03 11:07:22 +01:00

dequantize.hpp

sycl: reordered Q4_K MMVQ (#13109)

2025-05-15 17:35:44 +02:00

dmmv.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

dmmv.hpp

llama : reorganize source code + improve CMake (#8006)

2024-06-26 18:33:02 +03:00

element_wise.cpp

SYCL: add gelu_erf kernel (#13749)

2025-05-27 20:52:59 +05:30

element_wise.hpp

SYCL: add gelu_erf kernel (#13749)

2025-05-27 20:52:59 +05:30

gemm.hpp

sycl: use oneDNN for matrices multiplication (#12972)

2025-05-15 16:53:41 +02:00

getrows.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

getrows.hpp

SYCL: Remove misleading ggml_sycl_op_flatten function (#12387)

2025-03-31 11:25:24 +02:00

ggml-sycl.cpp

sycl: quantize and reorder the input to q8_1 when reorder is enabled (#13826)

2025-06-02 10:12:20 +01:00

gla.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

gla.hpp

SYCL: Add gated linear attention kernel (#11175)

2025-01-15 11:20:17 +08:00

im2col.cpp

SYCL: Fix im2col (#12910)

2025-04-14 14:23:53 +02:00

im2col.hpp

SYCL: Remove misleading ggml_sycl_op_flatten function (#12387)

2025-03-31 11:25:24 +02:00

mmq.cpp

fixed compilation warnings in ggml-sycl (#12424)

2025-03-18 08:51:25 +08:00

mmq.hpp

llama : reorganize source code + improve CMake (#8006)

2024-06-26 18:33:02 +03:00

mmvq.cpp

sycl: quantize and reorder the input to q8_1 when reorder is enabled (#13826)

2025-06-02 10:12:20 +01:00

mmvq.hpp

llama : reorganize source code + improve CMake (#8006)

2024-06-26 18:33:02 +03:00

norm.cpp

SYCL: Add non contiguous support in RMS_NORM and NORM kernels (#13611)

2025-05-26 21:10:36 +05:30

norm.hpp

SYCL: Remove misleading ggml_sycl_op_flatten function (#12387)

2025-03-31 11:25:24 +02:00

outprod.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

outprod.hpp

SYCL: Refactor ggml_sycl_compute_forward (#11121)

2025-01-10 08:13:03 +08:00

presets.hpp

Optimize RWKV6 Operator Naming and Implement Multi-core CPU/ SYCL Acceleration (#10133)

2024-11-07 15:19:10 +08:00

quants.hpp

sycl: reordered Q4_K MMVQ (#13109)

2025-05-15 17:35:44 +02:00

rope.cpp

SYCL: Add mrope kernel (#13755)

2025-05-30 19:40:57 +05:30

rope.hpp

SYCL: Add non-contiguous support in ROPE (#12993)

2025-04-21 19:13:30 +05:30

softmax.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

softmax.hpp

SYCL : SOFTMAX F16 mask support and other fixes (#11261)

2025-01-28 09:56:58 +00:00

sycl_hw.cpp

[SYCL] Optimize mul_mat for Q4_0 on Intel GPU (#12035)

2025-02-24 22:33:23 +08:00

sycl_hw.hpp

[SYCL] Optimize mul_mat for Q4_0 on Intel GPU (#12035)

2025-02-24 22:33:23 +08:00

tsembd.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

tsembd.hpp

SYCL: Refactor ggml_sycl_compute_forward (#11121)

2025-01-10 08:13:03 +08:00

vecdotq.hpp

sycl: quantize and reorder the input to q8_1 when reorder is enabled (#13826)

2025-06-02 10:12:20 +01:00

wkv.cpp

sycl: Add more debug prints (#13640)

2025-05-26 10:28:53 +02:00

wkv.hpp

llama: Add support for RWKV v7 architecture (#12412)

2025-03-18 07:27:50 +08:00