stduhpf and GitHub
4ccea213bc
hellaswag: display estimated score confidence interval ( #12797 )
2025-04-07 18:47:08 +03:00
4375415b4a
Vulkan: RTE rounding for cpy to quant ( #12480 )
...
* Vulkan: RTE rounding for cpy to quant
Co-Authored-By: Jeff Bolz <jbolz@nvidia.com >
* remove trailing whitespace
* avoid duplicating pipeline_cpy_f32_quant
* fix copypasting issue
* remove duplicated code
---------
Co-authored-by: Jeff Bolz <jbolz@nvidia.com >
2025-03-21 20:34:50 +01:00
c07e87f38b
server : (webui) put DeepSeek R1 CoT in a collapsible <details> element ( #11364 )
...
* webui : put DeepSeek R1 CoT in a collapsible <details> element
* webui: refactor split
* webui: don't use regex to split cot and response
* webui: format+qol
* webui: no loading icon if the model isn't generating
* ui fix, add configs
* add jsdoc types
* only filter </think> for assistant msg
* build
* update build
---------
Co-authored-by: Xuan Son Nguyen <son@huggingface.co >
2025-01-24 09:02:38 +01:00
stduhpf and GitHub
06d70147e6
Vulkan: fix NaN in tanh.comp with AMD proprietary driver on Windows ( #10723 )
...
* Vulkan: fix NaN in tanh.comp
* Faster NaN-free tanh
2024-12-08 19:19:19 +01:00
stduhpf and GitHub
e31a4f6797
cmake: fix paths for vulkan shaders compilation on Windows ( #8573 )
...
* Vulkan-shaders: attempt fix compilation on windows
* fix miss-matched parenthesis
2024-08-05 08:18:27 +02:00
stduhpf and GitHub
e0324285a5
speculative : threading options ( #4959 )
...
* speculative: expose draft threading
* fix usage format
* accept -td and -tbd args
* speculative: revert default behavior when -td is unspecified
* fix trailing whitespace
2024-01-16 13:04:32 +02:00
da5eaef1f3
speculative : support --color ( #4343 )
...
* speculative: add some colors
* minor : add braces
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
2023-12-06 10:08:17 +02:00
