nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 22 Packages Projects Releases Wiki Activity

server-bench : add speed-bench for speculative decoding benchmarking (#23869)

Browse Source 
* spec: add speed-bench support for benchmarking

* speed-bench : add trailing newline to requirements.txt

* speed-bench : bump datasets to 4.8.0 to fix ty check

* server-bench : remove now-unused type: ignore after datasets bump
This commit is contained in:
Ruixiang Wang
2026-05-29 23:09:47 +02:00
committed by GitHub
parent 5a46b46acd
commit 689a9a470e
7 changed files with 643 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
tools/server/bench/speed-bench/requirements.txt
+3
View File
@@ -0,0 +1,3 @@
datasets
requests
tqdm