 katsu560andGitHub
|
be2301bcda
|
k_quants : add AVX support to dot functions with QK_K as 64 (#2339)
* add AVX to ggml_vec_dot_q2_K_q8_K()
* add AVX to ggml_vec_dot_q3_K_q8_K()
* add AVX to ggml_vec_dot_q4_K_q8_K()
* add AVX to ggml_vec_dot_q5_K_q8_K()
* add AVX to ggml_vec_dot_q6_K_q8_K()
* refactor AVX code in ggml_vec_dot_q6_K_q8_K()
|
2023-07-25 15:13:41 +03:00 |
|
|
katsu560andGitHub
|
a84ab1da8d
|
tests : fix quantize perf (#1990)
* fix test quantize perf
* avoid the global state
|
2023-06-26 19:47:02 +03:00 |
|
|
katsu560andGitHub
|
5743ca8092
|
k-quants : add AVX support to dot functions (#1916)
* k_quants : add AVX support
* k_quants : apply review comments
|
2023-06-26 19:46:07 +03:00 |
|
|
katsu560andGitHub
|
60f8c361ca
|
ggml : add AVX support based on AVX2 code (#1430)
|
2023-05-14 10:03:51 +00:00 |
|
|
katsu560andGitHub
|
106faaf297
|
cmake : add finding the OpenBLAS header file (#992)
|
2023-04-15 08:51:11 +03:00 |
|