nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 25 Packages Projects Releases Wiki Activity
9,897 Commits 1 Branch 0 Tags
nik
Commit Graph
2 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ting SunandGitHub 87e21bbacd bench : make n_batch and n_ubatch configurable in Batched bench (#6500) 
* bench: make n_batch and n_ubatch configurable

* bench: update doc for batched bench
 2024-04-05 21:34:53 +03:00
Ting SunandGitHub cfc4d75df6 doc: fix outdated default value of batch size (#6336) 
* doc: fix outdated default value of batch size

* doc: add doc for ubatch-size
 2024-03-28 09:51:06 +01:00