nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 33 Packages Projects Releases Wiki Activity
163 Commits 1 Branch 0 Tags
a50e39c6fe36be3de0941b3c05aaf9c37912fd47
Commit Graph
4 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Erik ScholzandGitHub 4122dffff9 cmake: make llama an actual library (#392) 2023-03-22 18:37:10 +02:00
Erik ScholzandGitHub 56e659a0b2 fix perplexity after c-api refactor (#390) 
* preallocate a buffer of fitting size for tokenization (utils.cpp)

* don't create a new std::string (especially here, where it's usually large)
 2023-03-22 18:09:38 +02:00
Erik ScholzandGitHub 01a297b099 specify build type for ctest on windows (#371) 2023-03-21 23:34:25 +02:00
Erik ScholzGitHubTy Everett
 		0b366e7357 Command line switch to use F16 for memory_k and memory_v (refactor of #154) (#294) 
* Use F16 for memory_k and memory_v

* add command line switch to use f16 instead of f32 for memory k+v

---------

Co-authored-by: Ty Everett <ty@tyweb.us>
 2023-03-19 19:57:00 +02:00