0db32beaf0
server : fix passing prompt as tokens ( #5955 )
...
* server: fix passing prompt as tokens
* Update examples/server/server.cpp
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
2024-03-09 13:16:53 +02:00
Alexey Parfenov and GitHub
c5688c6250
server : clarify some params in the docs ( #5640 )
2024-02-22 10:27:32 +02:00
Alexey Parfenov and GitHub
6dcc02d244
server : add "samplers" param to control the samplers order ( #5494 )
2024-02-16 13:33:25 +02:00
a803333a4e
common : use enums for sampler types ( #5418 )
...
* common: use enums for sampler types
* Apply suggestions from code review
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
* minor : spaces
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
2024-02-11 15:43:31 +02:00
684780141a
server : allow to specify tokens as strings in logit_bias ( #5003 )
...
* server: allow to specify tokens as strings in logit_bias
* Apply suggestions from code review
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
2024-02-11 15:38:14 +02:00
Alexey Parfenov and GitHub
213d1439fa
server : remove model.json endpoint ( #5371 )
2024-02-06 20:08:38 +02:00
Alexey Parfenov and GitHub
a2d60c9158
server : allow to get default generation settings for completion ( #5307 )
2024-02-05 10:10:22 +02:00
Alexey Parfenov and GitHub
6123979952
server : allow to specify custom prompt for penalty calculation ( #3727 )
2023-12-23 11:31:49 +02:00
Alexey Parfenov and GitHub
eb16dae7e7
server : fix possible ambiguity in content type charset ( #4501 )
2023-12-17 16:56:09 +02:00
Alexey Parfenov and GitHub
d96ca7ded7
server : fix crash when prompt exceeds context size ( #3996 )
2023-11-10 23:48:21 -06:00
