nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 28 Packages Projects Releases Wiki Activity
9,774 Commits 1 Branch 0 Tags
72a9269172290829c503c351e2b68ca2f7af2bc7
Commit Graph
4 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
leonardHONGandGitHub 3686e9d643 CUDA: only support F32/F16 for GGML_OP_REPEAT (#24533) 2026-06-15 09:11:00 +03:00
leonardHONGandGitHub 05ff59cb57 CUDA: batch out_prod inner loop with cublasSgemmStridedBatched (#22651) 
* CUDA: batch out_prod inner loop with cublasSgemmStridedBatched

* CUDA: batch out_prod inner loop with cublasSgemmStridedBatched

* CUDA: add cublasSgemmStridedBatched mapping for HIP and MUSA backends
 2026-05-07 21:59:29 +02:00
leonardHONGandGitHub e77056f9b2 CUDA: use fastdiv for batch index split in get_rows (#22650) 2026-05-04 16:24:05 +02:00
leonardHONGandGitHub 97895129e5 ggml-cuda: flush legacy pool on OOM and retry (#22155) 
* ggml-cuda: flush legacy pool on OOM and retry

Signed-off-by: 梁厚宏 <2695316095@qq.com>

* Address review comments: add explicit sync, update destructor, clean up MUSA macros

Signed-off-by: 梁厚宏 <2695316095@qq.com>

---------

Signed-off-by: 梁厚宏 <2695316095@qq.com>
 2026-04-20 23:30:38 +02:00