nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 35 Packages Projects Releases Wiki Activity
3,279 Commits 1 Branch 0 Tags
a9f3b102157ba992cfe058909b7f6e1906d2d647
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
luoyu-intelandGitHub a9f3b10215 [SYCL] Fix win build conflict of math library (#8230) 
* fix win build conflict of math library

* fix the condition: !(win32 & SYCL)

* revert warp_size=16
 2024-07-02 12:50:07 +08:00
luoyu-intelandGitHub d08c20edde [SYCL] Fix the sub group size of Intel (#8106) 
* use warp_size macro for all sycl kernels

* fix mask of permute_sub_group_by_xor

* fix rms_norm with correct warp number

* fix rms_norm_f32/group_norm_f32

* move norm to norm.cpp file

* fix quantize bug

* fix mmvq's batch size
 2024-07-02 10:16:00 +08:00
luoyu-intelandGitHub de391e4c80 [SYCL] Fix windows build and inference (#8003) 
* add sycl preset

* fix debug link error. fix windows crash

* update README
 2024-06-20 21:19:05 +08:00