940362224d
llama : add support for Tekken pre-tokenizer ( #8579 )
...
* llama : Added support for Tekken pre-tokenizer (#8577 )
Removed uneeded `vocab.tokenizer_clean_spaces` assignment
* llama : fix order of pre-tokenizers
* * Tekken pre-tokenizer no longer uses clean_up_tokenization_spaces
* Updated chkhsh for Tekken tokenizer
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
2024-07-20 16:43:51 +03:00
31e7903221
server : add dynatemp_range and dynatemp_exponent ( #5352 )
...
* server: added `dynatemp_range` and `dynatemp_exponent`
* Update README.md
---------
Co-authored-by: Michael Coppola <info@michaeljcoppola.com >
2024-02-06 11:20:00 +02:00
125d03a503
llama.vim : added api key support ( #5090 )
...
Co-authored-by: Michael Coppola <info@michaeljcoppola.com >
2024-01-23 08:51:27 +02:00
27379455c3
server : support for multiple api keys ( #4864 )
...
* server: added support for multiple api keys, added loading api keys from file
* minor: fix whitespace
* added file error handling to --api-key-file, changed code to better
reflect current style
* server: update README.md for --api-key-file
---------
Co-authored-by: Michael Coppola <info@michaeljcoppola.com >
2024-01-11 19:51:17 +02:00
e5804313a1
server : fix options in README.md ( #4765 )
...
* fix examples/server/README.md
* minor : fix whitespace
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
2024-01-04 10:17:09 +02:00
a8bdd65525
server : add parameter -tb N, --threads-batch N ( #3584 )
...
Co-authored-by: Michael Coppola <info@michaeljcoppola.com >
2023-10-11 22:42:22 +03:00
