nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 26 Packages Projects Releases Wiki Activity
4,810 Commits 1 Branch 0 Tags
4512055792cff7ea107f2d2231f79aa1af073c62
Commit Graph
9 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Srihari-mcwGitHubslaren
 		0827b2c1da ggml : fixes for AVXVNNI instruction set with MSVC and Clang (#11027) 
* Fixes for clang AVX VNNI

* enable AVX VNNI and alder lake build for MSVC

* Apply suggestions from code review

---------

Co-authored-by: slaren <slarengh@gmail.com>
 2024-12-31 15:23:33 +01:00
Srihari-mcwGitHubMax Krasnyansky
 		c37fb4cf62 Changes to CMakePresets.json to add ninja clang target on windows (#10668) 
* Update cmakepreset.json to use clang with ninja by default

* Update cmakepreset.json to add clang and ninja based configs

* Updates to build.md file

* Make updates to rename preset targets

* Update with .cmake file

* Remove additional whitespaces

* Add .cmake file for x64-windows-llvm

* Update docs/build.md

* Update docs/build.md

---------

Co-authored-by: Max Krasnyansky <max.krasnyansky@gmail.com>
 2024-12-09 09:40:19 -08:00
Srihari-mcwandGitHub 74d73dc85c Make updates to fix issues with clang-cl builds while using AVX512 flags (#10314) 2024-11-15 22:27:00 +01:00
Srihari-mcwandGitHub 2f8bd2b901 llamafile : extend sgemm.cpp support for Q5_0 models (#10010) 2024-10-25 10:27:41 +03:00
Srihari-mcwGitHubGeorgi Gerganov
 		1e7b9299c6 ggml : AVX512 gemm for Q4_0_8_8 (#9532) 
* AVX512 version of ggml_gemm_q4_0_8x8_q8_0

* Remove zero vector parameter passing

* Rename functions and rearrange order of macros

* Edit commments

* style : minor adjustments

* Update x to start from 0

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2024-09-23 17:06:38 +03:00
Srihari-mcwandGitHub 581c305186 ggml : AVX2 support for Q4_0_8_8 (#8713) 
* Add AVX2 based implementations for quantize_q8_0_4x8, ggml_gemv_q4_0_8x8_q8_0 and ggml_gemm_q4_0_8x8_q8_0 functions

* Update code to fix issues occuring due to non alignment of elements to be processed as multiple of 16 in MSVC

* Update comments and indentation

* Make updates to reduce number of load instructions
 2024-09-04 19:51:22 +03:00
Srihari-mcwandGitHub ea5d7478b1 sgemm : improved Q4_0 and Q8_0 performance via 4xN and Mx4 gemm (#8908) 2024-08-31 11:20:35 +03:00
Srihari-mcwandGitHub 5b6da18750 Make updates to type cast based on compiler instead of OS (#7851) 2024-06-17 20:23:17 +02:00
Srihari-mcwandGitHub 33c8d50acc Add provisions for windows support for BF16 code including CMake provision for enabling AVX512_BF16 (#7258) 2024-05-20 12:18:39 +10:00