Commit Graph
3 Commits
Author SHA1 Message Date
64ed2091b2 server: Add "tokens per second" information in the backend (#10548)
* add cmake rvv support

* add timings

* remove space

* update readme

* fix

* fix code

* remove empty line

* add test

---------

Co-authored-by: Xuan Son Nguyen <son@huggingface.co>
2024-12-02 14:45:54 +01:00
haopengandGitHub 42ae10bbcd add cmake rvv support (#10411) 2024-11-19 21:10:31 +01:00
haopengandGitHub 8fc393f246 scripts : fix pattern and get n_tokens in one go (#10221) 2024-11-09 09:06:54 +02:00