nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 31 Packages Projects Releases Wiki Activity
100 Commits 1 Branch 0 Tags
0b366e735729327476ec31da02de3c9c9771ddfb
Commit Graph
1 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Erik ScholzGitHubTy Everett
 		0b366e7357 Command line switch to use F16 for memory_k and memory_v (refactor of #154) (#294) 
* Use F16 for memory_k and memory_v

* add command line switch to use f16 instead of f32 for memory k+v

---------

Co-authored-by: Ty Everett <ty@tyweb.us>
 2023-03-19 19:57:00 +02:00