nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 27 Packages Projects Releases Wiki Activity
6,205 Commits 1 Branch 0 Tags
a6d3cfe7fa6ea1fb0e1ba8243b731db22ddc0b49
Commit Graph
8 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
stduhpfandGitHub c8ade30036 Mtmd: add a way to select device for vision encoder (#14236) 
* Mtmd: add a way to select device for vision encoder

* simplify

* format

* Warn user if manual device selection failed

* initialize backend to nullptr
 2025-07-22 12:51:03 +02:00
stduhpfandGitHub 4ccea213bc hellaswag: display estimated score confidence interval (#12797) 2025-04-07 18:47:08 +03:00
stduhpfGitHubJeff Bolz
 		4375415b4a Vulkan: RTE rounding for cpy to quant (#12480) 
* Vulkan: RTE rounding for cpy to quant

Co-Authored-By: Jeff Bolz <jbolz@nvidia.com>

* remove trailing whitespace

* avoid duplicating pipeline_cpy_f32_quant

* fix copypasting issue

* remove duplicated code

---------

Co-authored-by: Jeff Bolz <jbolz@nvidia.com>
 2025-03-21 20:34:50 +01:00
stduhpfGitHubXuan Son Nguyen
 		c07e87f38b server : (webui) put DeepSeek R1 CoT in a collapsible <details> element (#11364) 
* webui : put DeepSeek R1 CoT in a collapsible <details> element

* webui: refactor split

* webui: don't use regex to split cot and response

* webui: format+qol

* webui: no loading icon if the model isn't generating

* ui fix, add configs

* add jsdoc types

* only filter </think> for assistant msg

* build

* update build

---------

Co-authored-by: Xuan Son Nguyen <son@huggingface.co>
 2025-01-24 09:02:38 +01:00
stduhpfandGitHub 06d70147e6 Vulkan: fix NaN in tanh.comp with AMD proprietary driver on Windows (#10723) 
* Vulkan: fix NaN in tanh.comp

* Faster NaN-free tanh
 2024-12-08 19:19:19 +01:00
stduhpfandGitHub e31a4f6797 cmake: fix paths for vulkan shaders compilation on Windows (#8573) 
* Vulkan-shaders: attempt fix compilation on windows

* fix miss-matched parenthesis
 2024-08-05 08:18:27 +02:00
stduhpfandGitHub e0324285a5 speculative : threading options (#4959) 
* speculative: expose draft threading

* fix usage format

* accept -td and -tbd args

* speculative: revert default behavior when -td is unspecified

* fix trailing whitespace
 2024-01-16 13:04:32 +02:00
stduhpfGitHubGeorgi Gerganov
 		da5eaef1f3 speculative : support --color (#4343) 
* speculative: add some colors

* minor : add braces

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-12-06 10:08:17 +02:00