nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 4 Packages Projects Releases Wiki Activity

server-bench : add speed-bench for speculative decoding benchmarking (#23869)

Browse Source 
* spec: add speed-bench support for benchmarking

* speed-bench : add trailing newline to requirements.txt

* speed-bench : bump datasets to 4.8.0 to fix ty check

* server-bench : remove now-unused type: ignore after datasets bump
This commit is contained in:
Ruixiang Wang
2026-05-29 23:09:47 +02:00
committed by GitHub
parent 5a46b46acd
commit 689a9a470e
7 changed files with 643 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
requirements/requirements-server-bench.txt
View File

@@ -1,4 +1,4 @@
datasets~=3.2.0
datasets~=4.8.0
matplotlib~=3.10.0
numpy~=1.26.4
requests~=2.32.3