stduhpf and GitHub
1b0db8f6e0
server : fix webui ( #15462 )
...
* Fix webui crash after streaming
* build webui
2025-08-21 08:19:22 +03:00
stduhpf and GitHub
c8ade30036
Mtmd: add a way to select device for vision encoder ( #14236 )
...
* Mtmd: add a way to select device for vision encoder
* simplify
* format
* Warn user if manual device selection failed
* initialize backend to nullptr
2025-07-22 12:51:03 +02:00
stduhpf and GitHub
4ccea213bc
hellaswag: display estimated score confidence interval ( #12797 )
2025-04-07 18:47:08 +03:00
4375415b4a
Vulkan: RTE rounding for cpy to quant ( #12480 )
...
* Vulkan: RTE rounding for cpy to quant
Co-Authored-By: Jeff Bolz <jbolz@nvidia.com >
* remove trailing whitespace
* avoid duplicating pipeline_cpy_f32_quant
* fix copypasting issue
* remove duplicated code
---------
Co-authored-by: Jeff Bolz <jbolz@nvidia.com >
2025-03-21 20:34:50 +01:00
c07e87f38b
server : (webui) put DeepSeek R1 CoT in a collapsible <details> element ( #11364 )
...
* webui : put DeepSeek R1 CoT in a collapsible <details> element
* webui: refactor split
* webui: don't use regex to split cot and response
* webui: format+qol
* webui: no loading icon if the model isn't generating
* ui fix, add configs
* add jsdoc types
* only filter </think> for assistant msg
* build
* update build
---------
Co-authored-by: Xuan Son Nguyen <son@huggingface.co >
2025-01-24 09:02:38 +01:00
stduhpf and GitHub
06d70147e6
Vulkan: fix NaN in tanh.comp with AMD proprietary driver on Windows ( #10723 )
...
* Vulkan: fix NaN in tanh.comp
* Faster NaN-free tanh
2024-12-08 19:19:19 +01:00
stduhpf and GitHub
e31a4f6797
cmake: fix paths for vulkan shaders compilation on Windows ( #8573 )
...
* Vulkan-shaders: attempt fix compilation on windows
* fix miss-matched parenthesis
2024-08-05 08:18:27 +02:00
stduhpf and GitHub
e0324285a5
speculative : threading options ( #4959 )
...
* speculative: expose draft threading
* fix usage format
* accept -td and -tbd args
* speculative: revert default behavior when -td is unspecified
* fix trailing whitespace
2024-01-16 13:04:32 +02:00
da5eaef1f3
speculative : support --color ( #4343 )
...
* speculative: add some colors
* minor : add braces
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
2023-12-06 10:08:17 +02:00
