nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 27 Packages Projects Releases Wiki Activity
8,434 Commits 1 Branch 0 Tags
5e54d51b199ad2d70cf6eba4bff756bbf63366a6
Commit Graph
6 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
shaofeiqiGitHubLi He
 		3d9ab225e7 opencl: add cumsum op (#18981) 
* OpenCL: add CUMSUM op support

* remove unused argument

* opencl: refactor cumsum

* opencl: refactor

* opencl: refactor tmp buffer

* opencl: adjust max number of subgroups

* opencl: fix whitespace

* opencl: fix global size when cumsum the tmp buffer

---------

Co-authored-by: Li He <lih@qti.qualcomm.com>
 2026-03-11 22:03:07 -07:00
shaofeiqiGitHubLi He
 		24350fdf9b opencl: add optimized q4_1 mm kernel for adreno (#19840) 
* Add Q4_1 OpenCL Kernels

* opencl: refactor transpose

* opencl: format

* opencl: refactor q4_1 unpack

* opencl: move `ggml_cl_mul_mat_q4_1_f32_adreno`

* opencl: refactor `ggml_cl_mul_mat_q4_1_f32_adreno` and kernels

* opencl: rename kernel files and kernes

* opencl: fix build for non adreno

* opencl: move code around and format

---------

Co-authored-by: Li He <lih@qti.qualcomm.com>
 2026-03-02 19:49:41 -08:00
shaofeiqiGitHubLi He
 		e2f19b320f opencl: refactor expm1 and softplus (#19404) 
* opencl: refactor expm1

* opencl: refactor softplus

* opencl: use h for half literals

---------

Co-authored-by: Li He <lih@qti.qualcomm.com>
 2026-02-17 14:47:18 -08:00
shaofeiqiGitHubLi He
 		983559d24b opencl: optimize mean and sum_row kernels (#19614) 
* opencl: optimize mean and sum_row kernels

* opencl: add comment for max subgroups

* opencl: format

---------

Co-authored-by: Li He <lih@qti.qualcomm.com>
 2026-02-17 13:56:09 -08:00
shaofeiqiGitHubyunjieLi He
 		971facc38e opencl: add optimized q8_0 mm kernel for adreno (#18871) 
* Add Q8_0 OpenCL kernel

Co-authored-by: yunjie <yunjie@qti.qualcomm.com>

* opencl: fix build for non-adreno

* opencl: refactor q8_0

* opencl: enforce subgroup size of 64 for adreno for q8_0

* For A750 and older generations, subgroup size can be 64 or 128.
  This kernel assumes subgroup size 64.

* opencl: suppress warning when adreno kernels are disabled

---------

Co-authored-by: yunjie <yunjie@qti.qualcomm.com>
Co-authored-by: Li He <lih@qti.qualcomm.com>
 2026-01-30 10:19:27 -08:00
shaofeiqiandGitHub 5516b9c16a opencl: add TRI op support (#18979) 2026-01-21 22:05:54 -08:00