Georgi GerganovandGitHub cb1adf8851 server : handle failures to restore host cache (#17078) ...

* server : handle failures to restore host cache

* server : add tests for the prompt cache

2025-11-09 14:27:05 +02:00

..

test_basic.py

…

test_chat_completion.py

server : support unified cache across slots (#16736)

2025-11-02 18:14:04 +02:00

test_completion.py

server : handle failures to restore host cache (#17078)

2025-11-09 14:27:05 +02:00

test_ctx_shift.py

…

test_embedding.py

…

test_infill.py

server : support unified cache across slots (#16736)

2025-11-02 18:14:04 +02:00

test_lora.py

…

test_rerank.py

…

test_security.py

…

test_slot_save.py

…

test_speculative.py

kv-cache : pad the cache size to 256 for performance (#17046)

2025-11-07 20:03:25 +02:00

test_template.py

…

test_tokenize.py

…

test_tool_call.py

…

test_vision_api.py

…