nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 20 Packages Projects Releases Wiki Activity
4,093 Commits 1 Branch 0 Tags
4047be74da398acb8717a4d21b77b929ad7ed4f7
Commit Graph
6 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Srihari-mcwandGitHub 2f8bd2b901 llamafile : extend sgemm.cpp support for Q5_0 models (#10010) 2024-10-25 10:27:41 +03:00
Srihari-mcwGitHubGeorgi Gerganov
 		1e7b9299c6 ggml : AVX512 gemm for Q4_0_8_8 (#9532) 
* AVX512 version of ggml_gemm_q4_0_8x8_q8_0

* Remove zero vector parameter passing

* Rename functions and rearrange order of macros

* Edit commments

* style : minor adjustments

* Update x to start from 0

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2024-09-23 17:06:38 +03:00
Srihari-mcwandGitHub 581c305186 ggml : AVX2 support for Q4_0_8_8 (#8713) 
* Add AVX2 based implementations for quantize_q8_0_4x8, ggml_gemv_q4_0_8x8_q8_0 and ggml_gemm_q4_0_8x8_q8_0 functions

* Update code to fix issues occuring due to non alignment of elements to be processed as multiple of 16 in MSVC

* Update comments and indentation

* Make updates to reduce number of load instructions
 2024-09-04 19:51:22 +03:00
Srihari-mcwandGitHub ea5d7478b1 sgemm : improved Q4_0 and Q8_0 performance via 4xN and Mx4 gemm (#8908) 2024-08-31 11:20:35 +03:00
Srihari-mcwandGitHub 5b6da18750 Make updates to type cast based on compiler instead of OS (#7851) 2024-06-17 20:23:17 +02:00
Srihari-mcwandGitHub 33c8d50acc Add provisions for windows support for BF16 code including CMake provision for enabling AVX512_BF16 (#7258) 2024-05-20 12:18:39 +10:00