Ivan Stepanov and GitHub
4953e9007f
llama : always sort logits before nucleus sampling ( #812 )
...
* Always sort logits before nucleus sampling
* remove second normalization
- fix windows build
- remove normalization since std::discrete_distribution does not require it
2023-04-07 19:02:12 +03:00
5a8c4f6240
llama : define non-positive top_k; top_k range check ( #779 )
...
* Define non-positive top_k; top_k range check
* minor : brackets
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
2023-04-05 19:20:05 +03:00
Ivan Stepanov and GitHub
0c44427df1
make : missing host optimizations in CXXFLAGS ( #763 )
2023-04-05 17:38:37 +03:00
Ivan Stepanov and GitHub
cd7fa95690
Define non-positive temperature behavior ( #720 )
2023-04-03 02:19:04 +02:00
