nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 29 Packages Projects Releases Wiki Activity
4,693 Commits 1 Branch 0 Tags
198b1ec611a2c551ea40e5b9c0b862f37555a4cc
Commit Graph
2 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Dan JohanssonandGitHub 6a0f779484 ggml : add run-time detection of neon, i8mm and sve (#9331) 
* ggml: Added run-time detection of neon, i8mm and sve

Adds run-time detection of the Arm instructions set features
neon, i8mm and sve for Linux and Apple build targets.

* ggml: Extend feature detection to include non aarch64 Arm arch

* ggml: Move definition of ggml_arm_arch_features to the global data section
 2024-09-28 15:06:16 +03:00
Dan JohanssonandGitHub b2e89a3274 Arm AArch64: Documentation updates (#9321) 
* Arm AArch64: Documentation updates

* Update docs/build.md to include information on how to enable the Arm optimized gemm/gemv kernels

* Update examples/quantize/README.md with information on the Q4_0_4_4, Q4_0_4_8 and Q4_0_8_8 formats

* Add newline to the end of docs/build.md
 2024-09-09 10:02:45 +03:00