nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 34 Packages Projects Releases Wiki Activity
2,190 Commits 1 Branch 0 Tags
11b12de39bd787c0494da0cd405958fdfedc29c4
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Pierrick HymbertandGitHub c145f8a132 server : slots monitoring endpoint (#5550) 2024-02-18 19:39:57 +02:00
Pierrick HymbertandGitHub e75c6279d1 server : enhanced health endpoint (#5548) 
* server: enrich health endpoint with available slots, return 503 if not slots are available

* server: document new status no slot available in the README.md
 2024-02-18 18:31:28 +02:00
Pierrick HymbertandGitHub 36376abe05 server : --n-predict option document and cap to max value (#5549) 
* server: document --n-predict

* server: ensure client request cannot override n_predict if set

* server: fix print usage LF in new --n-predict option
 2024-02-18 18:30:09 +02:00