nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 30 Packages Projects Releases Wiki Activity
9,183 Commits 1 Branch 0 Tags
2eb3e6b2428c035dd24f996c7dfc48654dc19a6b
Commit Graph
12 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
shaofeiqiGitHubLi He
 		ec562eb673 opencl: add q5_0 and q5_1 MoE for Adreno (#22985) 
* opencl: add q5_0 moe support

* opencl: add q5_1 moe support

* opencl: avoid potential leak

* opencl: suppress unused var warning when building for non-Adreno

---------

Co-authored-by: Li He <lih@qti.qualcomm.com>
 2026-05-13 11:57:31 -07:00
shaofeiqiandGitHub ceb7e14b96 opencl: add opfilter regex for debugging (#22782) 2026-05-07 11:00:20 -07:00
shaofeiqiandGitHub e45dbdece8 opencl: add q5_K gemm and gemv kernels for Adreno (#21595) 2026-04-16 12:08:33 -07:00
shaofeiqiandGitHub af1127d3c4 opencl: add basic support for q5_k (#21593) 
* opencl: add general q5_k mv

* opencl: add flattened Q5_K mv and general Q5_K mm

* opencl: fix Q5_K unit tests
 2026-04-11 01:46:19 -07:00
shaofeiqiGitHubLi He
 		08f21453ae opencl: add q4_K gemm and gemv kernels for Adreno (#20919) 
* opencl: add q4_K gemm and gemv kernels for Adreno

* opencl: fix whitespace

* opencl: add workarounds for compiler bugs on older devices

* opencl: handle fp16 denorm on X Elite

* opencl: fix kernel build error

* opencl: fix whitespace

* opencl: make q4_K cvt kernels signature consistent

---------

Co-authored-by: Li He <lih@qti.qualcomm.com>
 2026-03-30 12:19:16 -07:00
shaofeiqiandGitHub 84ffd0c192 opencl: add flattened Q4_K mv and general Q4_K mm (#20773) 2026-03-22 22:45:11 -07:00
shaofeiqiGitHubLi He
 		3d9ab225e7 opencl: add cumsum op (#18981) 
* OpenCL: add CUMSUM op support

* remove unused argument

* opencl: refactor cumsum

* opencl: refactor

* opencl: refactor tmp buffer

* opencl: adjust max number of subgroups

* opencl: fix whitespace

* opencl: fix global size when cumsum the tmp buffer

---------

Co-authored-by: Li He <lih@qti.qualcomm.com>
 2026-03-11 22:03:07 -07:00
shaofeiqiGitHubLi He
 		24350fdf9b opencl: add optimized q4_1 mm kernel for adreno (#19840) 
* Add Q4_1 OpenCL Kernels

* opencl: refactor transpose

* opencl: format

* opencl: refactor q4_1 unpack

* opencl: move `ggml_cl_mul_mat_q4_1_f32_adreno`

* opencl: refactor `ggml_cl_mul_mat_q4_1_f32_adreno` and kernels

* opencl: rename kernel files and kernes

* opencl: fix build for non adreno

* opencl: move code around and format

---------

Co-authored-by: Li He <lih@qti.qualcomm.com>
 2026-03-02 19:49:41 -08:00
shaofeiqiGitHubLi He
 		e2f19b320f opencl: refactor expm1 and softplus (#19404) 
* opencl: refactor expm1

* opencl: refactor softplus

* opencl: use h for half literals

---------

Co-authored-by: Li He <lih@qti.qualcomm.com>
 2026-02-17 14:47:18 -08:00
shaofeiqiGitHubLi He
 		983559d24b opencl: optimize mean and sum_row kernels (#19614) 
* opencl: optimize mean and sum_row kernels

* opencl: add comment for max subgroups

* opencl: format

---------

Co-authored-by: Li He <lih@qti.qualcomm.com>
 2026-02-17 13:56:09 -08:00
shaofeiqiGitHubyunjieLi He
 		971facc38e opencl: add optimized q8_0 mm kernel for adreno (#18871) 
* Add Q8_0 OpenCL kernel

Co-authored-by: yunjie <yunjie@qti.qualcomm.com>

* opencl: fix build for non-adreno

* opencl: refactor q8_0

* opencl: enforce subgroup size of 64 for adreno for q8_0

* For A750 and older generations, subgroup size can be 64 or 128.
  This kernel assumes subgroup size 64.

* opencl: suppress warning when adreno kernels are disabled

---------

Co-authored-by: yunjie <yunjie@qti.qualcomm.com>
Co-authored-by: Li He <lih@qti.qualcomm.com>
 2026-01-30 10:19:27 -08:00
shaofeiqiandGitHub 5516b9c16a opencl: add TRI op support (#18979) 2026-01-21 22:05:54 -08:00