llama_cpp

6,796 Commits 1 Branch 0 Tags

2 Commits

Author	SHA1	Message	Date
matiaslinandGitHub	5a0e3ef6f0	cuda: Add cublasLt_static linking when GGML_STATIC is enabled (#15622 ) Prior to this change, we faced undefined cublasLt references when attempting to compile 'llama-cli' with GGML_STATIC=ON on Linux. We add linking with CUDA::cublasLt_static when CUDA version is greater than 10.1.	2025-08-28 02:32:36 +02:00
matiaslinandGitHub	faac0bae26	common : ensure llama_batch size does not exceed max size (#9668 ) A crash was observed when the number of tokens added to a batch exceeds llama_batch size. An assertion in llama_batch_add was added to protect against llama_batch size overflow.	2024-09-29 15:25:00 +03:00

Author

SHA1

Message

Date

matiaslinandGitHub

5a0e3ef6f0

cuda: Add cublasLt_static linking when GGML_STATIC is enabled (#15622 )

Prior to this change, we faced undefined cublasLt references when
attempting to compile 'llama-cli' with GGML_STATIC=ON on Linux.

We add linking with CUDA::cublasLt_static when CUDA version is greater
than 10.1.

2025-08-28 02:32:36 +02:00

matiaslinandGitHub

faac0bae26

common : ensure llama_batch size does not exceed max size (#9668 )

A crash was observed when the number of tokens added to a batch exceeds
llama_batch size. An assertion in llama_batch_add was added to protect
against llama_batch size overflow.

2024-09-29 15:25:00 +03:00