nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 35 Packages Projects Releases Wiki Activity
3,278 Commits 1 Branch 0 Tags
d08c20eddedb24515a3212e2de66bdff41a26b8c
Commit Graph
2 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
luoyu-intelandGitHub d08c20edde [SYCL] Fix the sub group size of Intel (#8106) 
* use warp_size macro for all sycl kernels

* fix mask of permute_sub_group_by_xor

* fix rms_norm with correct warp number

* fix rms_norm_f32/group_norm_f32

* move norm to norm.cpp file

* fix quantize bug

* fix mmvq's batch size
 2024-07-02 10:16:00 +08:00
luoyu-intelandGitHub de391e4c80 [SYCL] Fix windows build and inference (#8003) 
* add sycl preset

* fix debug link error. fix windows crash

* update README
 2024-06-20 21:19:05 +08:00