nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 28 Packages Projects Releases Wiki Activity
729 Commits 1 Branch 0 Tags
235b610d650cbfed6dbd5d671f750d35fc18cd7d
Commit Graph
8 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Erik ScholzandGitHub 7487137227 rework convert.py to read hyper-parameters from config.json (#1958) 
* Read hyper-parameters from HuggingFace-transformer config.json, if they exist, and fall back to guessing, like before otherwise.
  This allows converting open_llama 3B and other non-standard model designs.
 2023-06-22 14:20:47 +02:00
Erik ScholzandGitHub 5ea4339273 make kv_f16 the default for api users (#1517) 2023-05-18 19:31:01 +02:00
Erik ScholzandGitHub a3b85b28da ci : add cublas to windows release (#1271) 2023-05-05 22:56:09 +02:00
Erik ScholzandGitHub 34c1072e49 ci: add debug build to sanitizer build matrix (#527) 2023-03-26 15:48:40 +00:00
Erik ScholzandGitHub 4122dffff9 cmake: make llama an actual library (#392) 2023-03-22 18:37:10 +02:00
Erik ScholzandGitHub 56e659a0b2 fix perplexity after c-api refactor (#390) 
* preallocate a buffer of fitting size for tokenization (utils.cpp)

* don't create a new std::string (especially here, where it's usually large)
 2023-03-22 18:09:38 +02:00
Erik ScholzandGitHub 01a297b099 specify build type for ctest on windows (#371) 2023-03-21 23:34:25 +02:00
Erik ScholzGitHubTy Everett
 		0b366e7357 Command line switch to use F16 for memory_k and memory_v (refactor of #154) (#294) 
* Use F16 for memory_k and memory_v

* add command line switch to use f16 instead of f32 for memory k+v

---------

Co-authored-by: Ty Everett <ty@tyweb.us>
 2023-03-19 19:57:00 +02:00