Isaac McFadyen and GitHub
6a2bc8bfb7
server : added --no-prefill-assistant flag ( #13608 )
...
* added no-prefill-assistant flag
* reworded documentation comment
* updated server README.md
2025-05-17 23:59:48 +02:00
Isaac McFadyen and GitHub
496e5bf46b
server : (docs) added response format for /apply-template [no ci] ( #11503 )
2025-01-30 10:11:53 +01:00
Isaac McFadyen and GitHub
f865ea149d
server: added more docs for response_fields field ( #10995 )
2024-12-28 16:09:19 +01:00
8854044561
Clarify default MMQ for CUDA and LLAMA_CUDA_FORCE_MMQ flag ( #8115 )
...
* Add message about int8 support
* Add suggestions from review
Co-authored-by: Johannes Gäßler <johannesg@5d6.de >
---------
Co-authored-by: Johannes Gäßler <johannesg@5d6.de >
2024-06-26 08:29:28 +02:00
Isaac McFadyen and GitHub
2f043328e3
server : fix typo in model name ( #4876 )
2024-01-11 16:33:26 +02:00