nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 28 Packages Projects Releases Wiki Activity
5,246 Commits 1 Branch 0 Tags
b1dd4d08e8fe40c9484422c0c5ec9bbd13b067a9
Commit Graph
11 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Srihari-mcwandGitHub eccc7a1602 ggml : Add AVX512 implementation of GEMM - Q4_Kx8 (#12829) 
* Add AVX512 implementation of GEMM - q4kx8

* Update changes to remove unnecessary whitespaces
 2025-04-15 09:22:36 +03:00
Srihari-mcwandGitHub 3d82dbcbce ggml : block interleaving support for Q4_K quantization for x86 AVX2 architecture (#12332) 
* Add block interleaving support for Q4_K quantization

* Remove whitespaces and fix CI/CD issues

* Update pointer of bsums from int16_t to const int16_t

* Add vector version of quantize_q8_K_4x8 function

* Update code formatting based on review comments
 2025-03-20 13:35:34 +02:00
Srihari-mcwGitHubslaren
 		0827b2c1da ggml : fixes for AVXVNNI instruction set with MSVC and Clang (#11027) 
* Fixes for clang AVX VNNI

* enable AVX VNNI and alder lake build for MSVC

* Apply suggestions from code review

---------

Co-authored-by: slaren <slarengh@gmail.com>
 2024-12-31 15:23:33 +01:00
Srihari-mcwGitHubMax Krasnyansky
 		c37fb4cf62 Changes to CMakePresets.json to add ninja clang target on windows (#10668) 
* Update cmakepreset.json to use clang with ninja by default

* Update cmakepreset.json to add clang and ninja based configs

* Updates to build.md file

* Make updates to rename preset targets

* Update with .cmake file

* Remove additional whitespaces

* Add .cmake file for x64-windows-llvm

* Update docs/build.md

* Update docs/build.md

---------

Co-authored-by: Max Krasnyansky <max.krasnyansky@gmail.com>
 2024-12-09 09:40:19 -08:00
Srihari-mcwandGitHub 74d73dc85c Make updates to fix issues with clang-cl builds while using AVX512 flags (#10314) 2024-11-15 22:27:00 +01:00
Srihari-mcwandGitHub 2f8bd2b901 llamafile : extend sgemm.cpp support for Q5_0 models (#10010) 2024-10-25 10:27:41 +03:00
Srihari-mcwGitHubGeorgi Gerganov
 		1e7b9299c6 ggml : AVX512 gemm for Q4_0_8_8 (#9532) 
* AVX512 version of ggml_gemm_q4_0_8x8_q8_0

* Remove zero vector parameter passing

* Rename functions and rearrange order of macros

* Edit commments

* style : minor adjustments

* Update x to start from 0

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2024-09-23 17:06:38 +03:00
Srihari-mcwandGitHub 581c305186 ggml : AVX2 support for Q4_0_8_8 (#8713) 
* Add AVX2 based implementations for quantize_q8_0_4x8, ggml_gemv_q4_0_8x8_q8_0 and ggml_gemm_q4_0_8x8_q8_0 functions

* Update code to fix issues occuring due to non alignment of elements to be processed as multiple of 16 in MSVC

* Update comments and indentation

* Make updates to reduce number of load instructions
 2024-09-04 19:51:22 +03:00
Srihari-mcwandGitHub ea5d7478b1 sgemm : improved Q4_0 and Q8_0 performance via 4xN and Mx4 gemm (#8908) 2024-08-31 11:20:35 +03:00
Srihari-mcwandGitHub 5b6da18750 Make updates to type cast based on compiler instead of OS (#7851) 2024-06-17 20:23:17 +02:00
Srihari-mcwandGitHub 33c8d50acc Add provisions for windows support for BF16 code including CMake provision for enabling AVX512_BF16 (#7258) 2024-05-20 12:18:39 +10:00