Erik Scholz and GitHub
5ea4339273
make kv_f16 the default for api users ( #1517 )
2023-05-18 19:31:01 +02:00
Erik Scholz and GitHub
a3b85b28da
ci : add cublas to windows release ( #1271 )
2023-05-05 22:56:09 +02:00
Erik Scholz and GitHub
34c1072e49
ci: add debug build to sanitizer build matrix ( #527 )
2023-03-26 15:48:40 +00:00
Erik Scholz and GitHub
4122dffff9
cmake: make llama an actual library ( #392 )
2023-03-22 18:37:10 +02:00
Erik Scholz and GitHub
56e659a0b2
fix perplexity after c-api refactor ( #390 )
...
* preallocate a buffer of fitting size for tokenization (utils.cpp)
* don't create a new std::string (especially here, where it's usually large)
2023-03-22 18:09:38 +02:00
Erik Scholz and GitHub
01a297b099
specify build type for ctest on windows ( #371 )
2023-03-21 23:34:25 +02:00
0b366e7357
Command line switch to use F16 for memory_k and memory_v (refactor of #154 ) ( #294 )
...
* Use F16 for memory_k and memory_v
* add command line switch to use f16 instead of f32 for memory k+v
---------
Co-authored-by: Ty Everett <ty@tyweb.us >
2023-03-19 19:57:00 +02:00
