Aman Gupta 12e5d99078 mtp: use inp_out_ids for skipping logit computation (#23433) ...

when doing a follow-up decode for the draft model, we were always doing the logit computation even though it is not required.

2026-05-21 15:23:14 +08:00

..

models

mtp: use inp_out_ids for skipping logit computation (#23433)

2026-05-21 15:23:14 +08:00

CMakeLists.txt

…

llama-adapter.cpp

…

llama-adapter.h

…

llama-arch.cpp

llama + spec: MTP Support (#22673)

2026-05-16 20:06:23 +08:00

llama-arch.h

llama + spec: MTP Support (#22673)

2026-05-16 20:06:23 +08:00

llama-batch.cpp

…

llama-batch.h

…

llama-chat.cpp

mtmd, model : merge HunyuanOCR into HunyuanVL and fix OCR vision precision (#23329)

2026-05-21 00:35:37 +02:00

llama-chat.h

mtmd, model : merge HunyuanOCR into HunyuanVL and fix OCR vision precision (#23329)

2026-05-21 00:35:37 +02:00

llama-context.cpp

Move to backend sampling for MTP draft path (#23287)

2026-05-20 22:34:45 +05:30

llama-context.h

llama: avoid copying logits during prompt decode in MTP (#23198)

2026-05-17 23:30:25 +08:00

llama-cparams.cpp

…

llama-cparams.h

llama: avoid copying logits during prompt decode in MTP (#23198)

2026-05-17 23:30:25 +08:00

llama-ext.h

llama: avoid copying logits during prompt decode in MTP (#23198)

2026-05-17 23:30:25 +08:00

llama-grammar.cpp

…

llama-grammar.h

…

llama-graph.cpp

llama-graph: fix null-buffer crash in llm_graph_input_attn_kv_iswa for SWA-only models (#23131)

2026-05-21 09:20:51 +03:00

llama-graph.h

llama : MTP clean-up (#23269)

2026-05-19 15:32:58 +03:00

llama-hparams.cpp

llama + spec: MTP Support (#22673)

2026-05-16 20:06:23 +08:00

llama-hparams.h

llama + spec: MTP Support (#22673)

2026-05-16 20:06:23 +08:00

llama-impl.cpp

…

llama-impl.h

…

llama-io.cpp

…

llama-io.h

…

llama-kv-cache-iswa.cpp

…

llama-kv-cache-iswa.h

…

llama-kv-cache.cpp

…

llama-kv-cache.h

…

llama-kv-cells.h

…

llama-memory-hybrid-iswa.cpp

llama : MTP clean-up (#23269)

2026-05-19 15:32:58 +03:00

llama-memory-hybrid-iswa.h

llama + spec: MTP Support (#22673)

2026-05-16 20:06:23 +08:00

llama-memory-hybrid.cpp

llama : MTP clean-up (#23269)

2026-05-19 15:32:58 +03:00

llama-memory-hybrid.h

llama + spec: MTP Support (#22673)

2026-05-16 20:06:23 +08:00

llama-memory-recurrent.cpp

llama : MTP clean-up (#23269)

2026-05-19 15:32:58 +03:00

llama-memory-recurrent.h

llama : MTP clean-up (#23269)

2026-05-19 15:32:58 +03:00

llama-memory.cpp

…

llama-memory.h

llama + spec: MTP Support (#22673)

2026-05-16 20:06:23 +08:00

llama-mmap.cpp

…

llama-mmap.h

…

llama-model-loader.cpp

llama + spec: MTP Support (#22673)

2026-05-16 20:06:23 +08:00

llama-model-loader.h

llama + spec: MTP Support (#22673)

2026-05-16 20:06:23 +08:00

llama-model-saver.cpp

model : NvFP4 quantized LM head support (#23046)

2026-05-16 11:09:27 +02:00

llama-model-saver.h

…

llama-model.cpp

llama + spec: MTP Support (#22673)

2026-05-16 20:06:23 +08:00

llama-model.h

model : NvFP4 quantized LM head support (#23046)

2026-05-16 11:09:27 +02:00

llama-quant.cpp

…

llama-quant.h

…

llama-sampler.cpp

…

llama-sampler.h

…

llama-vocab.cpp

vocab : add Carbon-3B (HybridDNATokenizer) support (#23410)

2026-05-21 08:34:32 +02:00

llama-vocab.h

…

llama.cpp

…

unicode-data.cpp

…

unicode-data.h

…

unicode.cpp

…

unicode.h

…