Xuan-Son Nguyen e37abd6b5f mtmd: add batching API (#24384) ...

* mtmd: add batching API

* wip

* first working version (gemma4v)

* add arg

* nits

* wire up support_batch()

* fix 0.0 output embd

* fix audio

* nits

* refactor a bit

* nits

* fix non-batching case

* fix comment

2026-06-13 00:10:29 +02:00

..

batched-bench

cmake : add install() for impl libraries + fix apple builds (#23511)

2026-05-22 11:46:26 +03:00

cli

mtmd : add video input support (#24269)

2026-06-08 14:40:12 +03:00

completion

completion : remove useless statics (#24226)

2026-06-06 12:16:16 +02:00

cvector-generator

…

export-lora

…

fit-params

cmake : add install() for impl libraries + fix apple builds (#23511)

2026-05-22 11:46:26 +03:00

gguf-split

…

imatrix

Move duplicated imatrix code into single common imatrix-loader.cpp (#22445)

2026-06-04 17:45:40 +02:00

llama-bench

Support -fa auto in llama-bench (#23714)

2026-05-31 02:03:57 +05:30

mtmd

mtmd: add batching API (#24384)

2026-06-13 00:10:29 +02:00

parser

…

perplexity

perplexity : fix format specifier in LOG_ERR (#23788)

2026-05-28 10:34:58 +03:00

quantize

docs: Update quantization readme (#24133)

2026-06-05 12:21:26 +02:00

results

…

rpc

fix: rpc-server cache may not work in Windows environments (#22394)

2026-04-27 17:25:09 +03:00

server

mtmd: add batching API (#24384)

2026-06-13 00:10:29 +02:00

tokenize

…

tts

logs : reduce (#23021)

2026-05-14 13:05:52 +03:00

ui

ui: PWA support (#23871)

2026-06-12 15:53:26 +02:00

CMakeLists.txt

cmake: skip cvector-generator and export-lora when CPU backend is disabled (#24053)

2026-06-04 13:13:19 +03:00