nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 28 Packages Projects Releases Wiki Activity
9,789 Commits 1 Branch 0 Tags
b3ce5cedf4c007b78a45befe839fa3abada03c0b
Commit Graph
9 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
DanieleandGitHub acd604fb27 vulkan: optimize operations in the IM2COL shader (#22685) 
* vulkan: optimize operations in the IM2COL shader

* Add comments and improve the code formatting
 2026-05-20 17:15:13 +02:00
DanieleandGitHub 581650b7ca vulkan: improve im2col (#11826) 
* vulkan: improve im2col performance
 2025-02-28 07:52:51 +01:00
DanieleandGitHub 0a423800ff CUDA: revert part of the RDNA1 optimizations (#8309) 
The change on the launch_bounds was causing a small performance drop in perplexity of 25 t/s
 2024-07-05 09:06:09 +02:00
DanieleandGitHub d23287f122 Define and optimize RDNA1 (#8085) 2024-07-04 01:02:58 +02:00
DanieleandGitHub 987d743d6b Improve hipBLAS support in CMake (#7696) 
* Improve hipBLAS support in CMake

This improves the detection of the correct CMAKE_PREFIX_PATH when using different distributions or a self-built ROCm SDK.

* Set ROCM_PATH correctly
 2024-06-04 14:09:15 +02:00
DanieleandGitHub 30e238b246 Improve HIP compatibility (#7672) 2024-05-31 16:00:29 +02:00
DaniAndTheWebandGitHub 86c7571864 make : update for latest Arch (#1701) 
With the upcoming change to the openblas package in arch the Makefile workaround is no longer needed.
 2023-06-17 19:17:22 +03:00
DaniAndTheWebandGitHub 173d0e6419 makefile: automatic Arch Linux detection (#1332) 
This commit is a port of a detection method used in koboldcpp's Makefile in order to automatically set the -lcblas option on Arch Linux
 2023-05-05 23:57:14 +02:00
DaniAndTheWebandGitHub ea3ad7eb60 Updating build instructions to include BLAS support (#1183) 
* Updated build information

First update to the build instructions to include BLAS.

* Update README.md

* Update information about BLAS

* Better BLAS explanation

Adding a clearer BLAS explanation and adding a link to download the CUDA toolkit.

* Better BLAS explanation

* BLAS for Mac

Specifying that BLAS is already supported on Macs using the Accelerate Framework.

* Clarify the effect of BLAS

* Windows Make instructions

Added the instructions to build with Make on Windows

* Fixing typo

* Fix trailing whitespace
 2023-04-26 22:03:03 +02:00