nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 27 Packages Projects Releases Wiki Activity
5,425 Commits 1 Branch 0 Tags
8960efd0a65e5a4830a14f6937c10703534f2569
Commit Graph
5 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
David HuangandGitHub 7f323a589f Add --no-op-offload to improve -ot pp perf in MoE models like llama4 400B (#13386) 2025-05-11 14:18:39 +02:00
David HuangandGitHub 84778e9770 CUDA/HIP: Share the same unified memory allocation logic. (#12934) 
Replace compile-time `GGML_HIP_UMA` with environment variable `GGML_CUDA_ENABLE_UNIFIED_MEMORY`. This unifies the usage on NVIDIA and AMD GPUs, and allows a single binary to be shared between integrated and dedicated GPUs.
 2025-04-15 11:20:38 +02:00
David HuangandGitHub f1648e91cf HIP: fix rocWMMA build flags under Windows (#12230) 2025-03-07 08:06:08 +01:00
David HuangandGitHub 3ffbbd5ce1 HIP: rocWMMA documentation and enabling in workflow builds (#12179) 
* Enable rocWMMA for Windows CI build

* Enable for Ubuntu

* GGML_HIP_ROCWMMA_FATTN documentation work
 2025-03-06 14:14:11 +01:00
David HuangGitHubJohannes GäßlerBen Jackson
 		becade5de7 HIP: implement FlashAttention via rocWMMA for CDNA and RDNA3+ (#12032) 
Adds GGML_HIP_ROCWMMA_FATTN and rocwmma header check
Adds rocWMMA support to fattn-wmma-f16

---

Signed-off-by: Carl Klemm <carl@uvos.xyz>
Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
Co-authored-by: Ben Jackson <ben@ben.com>
 2025-03-03 22:10:54 +01:00