nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 34 Packages Projects Releases Wiki Activity
2,229 Commits 1 Branch 0 Tags
5022cf242d689e15defd133f96c4345ad30c5d19
Commit Graph
5 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Pierrick HymbertandGitHub 1ecea255eb server: health: fix race condition on slots data using tasks queue (#5634) 
* server: health: fix race condition on slots data using tasks queue

* server: health:
    * include_slots only if slots_endpoint
    * fix compile warning task.target_id not initialized.
 2024-02-21 15:47:48 +01:00
Pierrick HymbertandGitHub c0a8c6db37 server : health endpoint configurable failure on no slot (#5594) 2024-02-20 09:48:19 +02:00
Pierrick HymbertandGitHub c145f8a132 server : slots monitoring endpoint (#5550) 2024-02-18 19:39:57 +02:00
Pierrick HymbertandGitHub e75c6279d1 server : enhanced health endpoint (#5548) 
* server: enrich health endpoint with available slots, return 503 if not slots are available

* server: document new status no slot available in the README.md
 2024-02-18 18:31:28 +02:00
Pierrick HymbertandGitHub 36376abe05 server : --n-predict option document and cap to max value (#5549) 
* server: document --n-predict

* server: ensure client request cannot override n_predict if set

* server: fix print usage LF in new --n-predict option
 2024-02-18 18:30:09 +02:00