Aman Gupta f8f0a47a55 cuda: reserve space for quantize kv-cache at startup (#23907) ...

* cuda: reserve space for quantize kv-cache at startup

* address review comments

* remove forward decl

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

* remove assert in ggml-cuda.cu

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

---------

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

2026-06-03 18:39:59 +08:00

..

cmake

ggml : Parallelize quant LUT init (#23595)

2026-05-25 10:15:46 +03:00

include

TP: quantized KV cache support (#23792)

2026-06-01 12:30:10 +02:00

src

cuda: reserve space for quantize kv-cache at startup (#23907)

2026-06-03 18:39:59 +08:00

.gitignore

…

CMakeLists.txt

ggml : bump version to 0.13.1 (ggml/1523)

2026-05-29 09:56:08 +03:00