nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 29 Packages Projects Releases Wiki Activity
5,775 Commits 1 Branch 0 Tags
bd9c981d7226107f18deb8344c3301450311bb8b
Commit Graph
6 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Aman GuptaandGitHub 27208bf657 CUDA: add bf16 and f32 support to cublas_mul_mat_batched (#14361) 
* CUDA: add bf16 and f32 support to cublas_mul_mat_batched

* Review: add type traits and make function more generic

* Review: make check more explicit, add back comments, and fix formatting

* Review: fix formatting, remove useless type conversion, fix naming for bools
 2025-06-29 01:30:53 +08:00
Aman GuptaandGitHub aa064b2eb7 CUDA: add mean operation (#14313) 
* CUDA: add mean operation

* add back sum_rows_f32_cuda

* Review: early exit if col!=0
 2025-06-22 12:39:54 +08:00
Aman GuptaandGitHub c959f462a0 CUDA: add conv_2d_transpose (#14287) 
* CUDA: add conv_2d_transpose

* remove direct include of cuda_fp16

* Review: add brackets for readability, remove ggml_set_param and add asserts
 2025-06-20 22:48:24 +08:00
Aman GuptaandGitHub 9eaa51e7f0 CUDA: add conv_2d_dw (#14265) 
* CUDA: add conv_2d_dw

* better naming

* simplify using template

* Review: fix operation ordering in ggml-cuda, use __forceinline__, use more const
 2025-06-20 09:50:24 +08:00
Aman GuptaandGitHub 2e42be42bd compare-llama-bench: add option to plot (#14169) 
* compare llama-bench: add option to plot

* Address review comments: convert case + add type hints

* Add matplotlib to requirements

* fix tests

* Improve comment and fix assert condition for test

* Add back default test_name, add --plot_log_scale

* use log_scale regardless of x_values
 2025-06-14 10:34:20 +02:00
AmanandGitHub 7781e5fe99 webui: Wrap long numbers instead of infinite horizontal scroll (#14062) 
* webui: Wrap long numbers instead of infinite horizontal scroll

* Use tailwind class

* update index.html.gz
 2025-06-11 16:42:25 +02:00