nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 20 Packages Projects Releases Wiki Activity
9,874 Commits 1 Branch 0 Tags
78d2f524682d9fee790a6460c93d018dafeb5229
Commit Graph
2 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Dan JohanssonandGitHub 6a0f779484 ggml : add run-time detection of neon, i8mm and sve (#9331) 
* ggml: Added run-time detection of neon, i8mm and sve

Adds run-time detection of the Arm instructions set features
neon, i8mm and sve for Linux and Apple build targets.

* ggml: Extend feature detection to include non aarch64 Arm arch

* ggml: Move definition of ggml_arm_arch_features to the global data section
 2024-09-28 15:06:16 +03:00
Dan JohanssonandGitHub b2e89a3274 Arm AArch64: Documentation updates (#9321) 
* Arm AArch64: Documentation updates

* Update docs/build.md to include information on how to enable the Arm optimized gemm/gemv kernels

* Update examples/quantize/README.md with information on the Q4_0_4_4, Q4_0_4_8 and Q4_0_8_8 formats

* Add newline to the end of docs/build.md
 2024-09-09 10:02:45 +03:00