Xuan-Son Nguyen e37abd6b5f mtmd: add batching API (#24384) ...

* mtmd: add batching API

* wip

* first working version (gemma4v)

* add arg

* nits

* wire up support_batch()

* fix 0.0 output embd

* fix audio

* nits

* refactor a bit

* nits

* fix non-batching case

* fix comment

2026-06-13 00:10:29 +02:00

..

jinja

…

arg.cpp

mtmd: add batching API (#24384)

2026-06-13 00:10:29 +02:00

arg.h

download: add option to skip_download (#23059)

2026-05-29 16:30:55 +02:00

base64.hpp

…

build-info.cpp.in

…

build-info.h

…

chat-auto-parser-generator.cpp

common : delegate assistant continuation to underlying template handlers (#23089)

2026-05-17 13:36:05 +02:00

chat-auto-parser-helpers.cpp

server: fix checkpoints creation (#22929)

2026-05-25 08:56:18 +03:00

chat-auto-parser-helpers.h

…

chat-auto-parser.h

server: fix checkpoints creation (#22929)

2026-05-25 08:56:18 +03:00

chat-diff-analyzer.cpp

server: fix checkpoints creation (#22929)

2026-05-25 08:56:18 +03:00

chat-peg-parser.cpp

common/chat : unify and fix LFM2/LFM2.5 tool parser (#24178)

2026-06-05 14:31:56 -05:00

chat-peg-parser.h

common/chat : unify and fix LFM2/LFM2.5 tool parser (#24178)

2026-06-05 14:31:56 -05:00

chat.cpp

chat: fix LFM2/LFM2.5 ignoring json_schema (#24377)

2026-06-10 14:41:41 +02:00

chat.h

server: fix checkpoints creation (#22929)

2026-05-25 08:56:18 +03:00

CMakeLists.txt

Move duplicated imatrix code into single common imatrix-loader.cpp (#22445)

2026-06-04 17:45:40 +02:00

common.cpp

common : relax sampler name matching (#23744)

2026-06-07 22:48:11 +02:00

common.h

mtmd: add batching API (#24384)

2026-06-13 00:10:29 +02:00

console.cpp

…

console.h

…

debug.cpp

common: fix missing exports in llama-common (#22340)

2026-04-27 08:06:39 +03:00

debug.h

common: fix missing exports in llama-common (#22340)

2026-04-27 08:06:39 +03:00

download.cpp

download: add option to skip_download (#23059)

2026-05-29 16:30:55 +02:00

download.h

download: add option to skip_download (#23059)

2026-05-29 16:30:55 +02:00

fit.cpp

server: add margin for draft model for fit (#23485)

2026-05-24 14:43:08 +08:00

fit.h

fit : avoid including llama-ext.h in fit.h (#24506)

2026-06-12 15:57:05 +03:00

hf-cache.cpp

common : remove hf cache migration (#23266)

2026-05-18 17:11:47 +02:00

hf-cache.h

common : remove hf cache migration (#23266)

2026-05-18 17:11:47 +02:00

http.h

…

imatrix-loader.cpp

Move duplicated imatrix code into single common imatrix-loader.cpp (#22445)

2026-06-04 17:45:40 +02:00

imatrix-loader.h

Move duplicated imatrix code into single common imatrix-loader.cpp (#22445)

2026-06-04 17:45:40 +02:00

json-partial.cpp

…

json-partial.h

…

json-schema-to-grammar.cpp

…

json-schema-to-grammar.h

…

llguidance.cpp

…

log.cpp

logs : reduce (#23021)

2026-05-14 13:05:52 +03:00

log.h

logs : reduce (#23021)

2026-05-14 13:05:52 +03:00

ngram-cache.cpp

…

ngram-cache.h

…

ngram-map.cpp

llama : MTP clean-up (#23269)

2026-05-19 15:32:58 +03:00

ngram-map.h

…

ngram-mod.cpp

ngram-mod : Add missing include (#23857)

2026-05-29 09:21:37 +03:00

ngram-mod.h

…

peg-parser.cpp

…

peg-parser.h

…

preset.cpp

mtmd, server, common: expose modalities to /v1/models (#22952)

2026-05-12 19:08:07 +02:00

preset.h

mtmd, server, common: expose modalities to /v1/models (#22952)

2026-05-12 19:08:07 +02:00

reasoning-budget.cpp

common : support manually triggering the reasoning budget end sequence (#23949)

2026-06-01 11:37:11 +02:00

reasoning-budget.h

common : support manually triggering the reasoning budget end sequence (#23949)

2026-06-01 11:37:11 +02:00

regex-partial.cpp

…

regex-partial.h

…

sampling.cpp

common : relax sampler name matching (#23744)

2026-06-07 22:48:11 +02:00

sampling.h

common : relax sampler name matching (#23744)

2026-06-07 22:48:11 +02:00

speculative.cpp

spec: add EAGLE3 speculative decoding support (#18039)

2026-06-12 10:21:06 +03:00

speculative.h

qwen35: use post-norm hidden state for MTP (#24025)

2026-06-04 01:29:09 +08:00

unicode.cpp

…

unicode.h

…