nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 20 Packages Projects Releases Wiki Activity
3,178 Commits 1 Branch 0 Tags
61665277afde2add00c0d387acb94ed5feb95917
Commit Graph
2 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Hong Bo PENGandGeorgi Gerganov b5fcf8ef5c ggml : fix and optimize ppc64le (ggml/849) 
* fix compile issues introduced by loongarch_asx

* restore quant changes to merge

* fix compile issues introduced by loongarch_asx

* further optimize by using vec_msum & vec_sum4s on ppc64le
 2024-06-16 20:32:49 +03:00
Hong Bo PENGandGeorgi Gerganov 0d26d8ccd8 ggml : optimize for ppc64le using VSX intrinsics (ggml/784) 
* optimize for ppc64le using VSX intrinsics

* 1. code clean up by removing comments about overflow concern.

2. fix typo in suffix of scaling.

* Continue to fix typo in suffix of scaling for QK_K <> 256

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2024-05-14 19:08:09 +03:00