nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 28 Packages Projects Releases Wiki Activity
9,398 Commits 1 Branch 0 Tags
3ef236955173431f311e9cd6b12b61bbb56254d5
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
leonardHONGandGitHub 05ff59cb57 CUDA: batch out_prod inner loop with cublasSgemmStridedBatched (#22651) 
* CUDA: batch out_prod inner loop with cublasSgemmStridedBatched

* CUDA: batch out_prod inner loop with cublasSgemmStridedBatched

* CUDA: add cublasSgemmStridedBatched mapping for HIP and MUSA backends
 2026-05-07 21:59:29 +02:00
leonardHONGandGitHub e77056f9b2 CUDA: use fastdiv for batch index split in get_rows (#22650) 2026-05-04 16:24:05 +02:00
leonardHONGandGitHub 97895129e5 ggml-cuda: flush legacy pool on OOM and retry (#22155) 
* ggml-cuda: flush legacy pool on OOM and retry

Signed-off-by: 梁厚宏 <2695316095@qq.com>

* Address review comments: add explicit sync, update destructor, clean up MUSA macros

Signed-off-by: 梁厚宏 <2695316095@qq.com>

---------

Signed-off-by: 梁厚宏 <2695316095@qq.com>
 2026-04-20 23:30:38 +02:00