nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 20 Packages Projects Releases Wiki Activity
7,253 Commits 1 Branch 0 Tags
1257491047aed0f56b81f532a5a4865add918821
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
fj-y-saitoGitHubGeorgi Gerganov
 		df70bedda7 arm64: add i8mm route with SVE ggml_vec_dot_q4_K_q8_K and ggml_vec_dot_q6_K_… (#15277) 
* add i8mm route with SVE ggml_vec_dot_q4_K_q8_K and ggml_vec_dot_q6_K_q8_K

* Surround SVE function with compiler directive

* fix compile switch

* fix coding style

* ggml : fix indent

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2025-11-10 15:12:59 +02:00
fj-y-saitoandGitHub d9a14523bb ggml : add SVE support for q6_K_q8_K (#12361) 2025-03-18 10:14:39 +02:00
fj-y-saitoGitHubGeorgi Gerganov
 		c67cc9837d ggml: aarch64: implement SVE kernels for q4_K_q8_K vector dot (#11227) 
* Add SVE support for q4_K_q8_K

* Update ggml/src/ggml-cpu/ggml-cpu-quants.c

change to use K_SCALE_SIZE

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2025-01-16 11:11:49 +02:00