Ruixiang Wang 88a39274ec spec: add EAGLE3 speculative decoding support (#18039) ...

* llama : enable layer input extraction

* spec: support eagle3

* eagle3: fix params bug

* eagle3: support Gemma4 eagle3 from RedHatAI

* eagle3: set sync when get features from target

Co-authored-by: tnhnyzc <115956684+tnhnyzc@users.noreply.github.com>

* eagle3 : fix ubatch handling in embd_layer_inp extraction and encoder

Co-authored-by: Doğaç Eldenk <dogacel@gmail.com>

* eagle3: adapt to upstream changes

* eagle3: fix rebase issues and adapt to upstream changes

* eagle3:exclude the eagle3 arch from test-llama-archs

* eagle3: fix editorconfig check failures

* eagle3: fix multi-seq issue in d2t vocab mapping

* cont : minor style / clean-up

* spec : remove `common_speculative_setup_draft_model()`

* llama : clean-up unused API

* eagle3: set d2t vocab mapping in decode graph

* cont : assert layer inputs are configured

* hparams : use n_embd_inp instead of n_embd_target_features

* eagle3: make output.weight optional and inherit from target model when needed

* haparams : generic norm-before-residual param

* llama-ext : consistent names

* cont : fix

* hparams : remove target_hidden_size

* cparams : rename output_layer_inp -> embeddings_layer_inp

* arch : reuse ATTN_NORM_2 instead of adding new hidden norm

* llama : clean-up names

* cont : add assert + comment

* Update conversion/llama.py

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Co-authored-by: tnhnyzc <115956684+tnhnyzc@users.noreply.github.com>
Co-authored-by: Doğaç Eldenk <dogacel@gmail.com>
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

2026-06-12 10:21:06 +03:00

..

peg-parser

common/gemma4 : handle parsing edge cases (#21760)

2026-04-13 18:18:18 -05:00

snapshots

tests : add unit test coverage for llama_tensor_get_type (#20112)

2026-04-02 22:53:58 +02:00

.gitignore

tests : add unit test coverage for llama_tensor_get_type (#20112)

2026-04-02 22:53:58 +02:00

CMakeLists.txt

ggml : add GGML_OP_COL2IM_1D (#24206)

2026-06-09 12:01:37 +03:00

export-graph-ops.cpp

tests: allow exporting graph ops from HF file without downloading weights (#21182)

2026-04-02 18:19:20 +02:00

get-model.cpp

…

get-model.h

…

gguf-model-data.cpp

ci : add [no release] keyword + fix sanitizer builds (#23728)

2026-05-26 19:05:48 +03:00

gguf-model-data.h

tests : add unit test coverage for llama_tensor_get_type (#20112)

2026-04-02 22:53:58 +02:00

test-alloc.cpp

chore : correct typos [no ci] (#20041)

2026-03-05 08:50:21 +01:00

test-arg-parser.cpp

spec : refactor params (#22397)

2026-04-28 09:07:33 +03:00

test-autorelease.cpp

docs : Minor cleanups (#19252)

2026-02-02 08:38:55 +02:00

test-backend-ops.cpp

ggml: support concat for scalar types at cuda backend (#24011)

2026-06-12 09:32:44 +03:00

test-backend-sampler.cpp

llama : deprecate llama_set_warmup (#24009)

2026-06-02 10:30:38 +03:00

test-barrier.cpp

…

test-c.c

…

test-chat-auto-parser.cpp

server: fix checkpoints creation (#22929)

2026-05-25 08:56:18 +03:00

test-chat-peg-parser.cpp

common/parser: add proper reasoning tag prefill reading (#20424)

2026-03-19 16:58:21 +01:00

test-chat-template.cpp

chat : add Granite 4.1 chat template (#23518)

2026-05-28 13:13:33 +02:00

test-chat.cpp

common/chat : fix LFM2/LFM2.5 reasoning round-trip and <think> leak (#24234)

2026-06-06 22:39:21 +02:00

test-col2im-1d.cpp

ggml : add GGML_OP_COL2IM_1D (#24206)

2026-06-09 12:01:37 +03:00

test-double-float.cpp

…

test-gbnf-validator.cpp

…

test-gguf-model-data.cpp

tests : add unit test coverage for llama_tensor_get_type (#20112)

2026-04-02 22:53:58 +02:00

test-gguf.cpp

ggml: gguf_init_from_callback and gguf_init_from_buffer (#22341)

2026-05-25 11:33:29 +02:00

test-grammar-integration.cpp

common/grammar: fix grammar parsing issues to prevent stack overflow and hangs (#18604)

2026-03-21 18:43:35 +01:00

test-grammar-llguidance.cpp

tool/ex/tests: consistently free ctx, then model (#18168)

2025-12-22 11:00:37 +01:00

test-grammar-parser.cpp

common/grammar: fix grammar parsing issues to prevent stack overflow and hangs (#18604)

2026-03-21 18:43:35 +01:00

test-jinja.cpp

jinja : support ensure_ascii=true, string repetition and int/float self-filtering (#21623)

2026-04-09 11:28:33 +02:00

test-json-partial.cpp

…

test-json-schema-to-grammar.cpp

tests : remove obsolete .mjs script (#21615)

2026-04-08 13:20:46 +03:00

test-llama-archs.cpp

spec: add EAGLE3 speculative decoding support (#18039)

2026-06-12 10:21:06 +03:00

test-llama-grammar.cpp

common/grammar: fix grammar parsing issues to prevent stack overflow and hangs (#18604)

2026-03-21 18:43:35 +01:00

test-log.cpp

common: Intentionally leak logger instance to fix hanging on Windows (#22273)

2026-04-29 10:58:43 +03:00

test-lora-conversion-inference.sh

…

test-model-load-cancel.cpp

…

test-mtmd-c-api.c

mtmd : add video input support (#24269)

2026-06-08 14:40:12 +03:00

test-opt.cpp

…

test-peg-parser.cpp

Autoparser - complete refactoring of parser architecture (#18675)

2026-03-06 21:01:00 +01:00

test-quant-type-selection.cpp

tests : add unit test coverage for llama_tensor_get_type (#20112)

2026-04-02 22:53:58 +02:00

test-quantize-fns.cpp

ggml: add Q1_0 1-bit quantization support (CPU) (#21273)

2026-04-06 20:55:21 +02:00

test-quantize-perf.cpp

…

test-quantize-stats.cpp

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

test-reasoning-budget.cpp

common : support manually triggering the reasoning budget end sequence (#23949)

2026-06-01 11:37:11 +02:00

test-recurrent-state-rollback.cpp

llama + spec: MTP Support (#22673)

2026-05-16 20:06:23 +08:00

test-regex-partial.cpp

common/grammar : replace problematic backtracking regex [\s\S]* (#18342)

2026-01-03 16:02:43 -06:00

test-rope.cpp

…

test-sampling.cpp

…

test-save-load-state.cpp

tests : refactor test-save-load-state to accept token input (#24073)

2026-06-04 08:06:36 +03:00

test-state-restore-fragmented.cpp

common : only load backends when required (#22290)

2026-05-05 09:23:50 +02:00

test-thread-safety.cpp

common : move up common_init() and fix Windows UTF-8 logs (#21176)

2026-03-31 12:53:41 +02:00

test-tokenizer-0.cpp

tool/ex/tests: consistently free ctx, then model (#18168)

2025-12-22 11:00:37 +01:00

test-tokenizer-0.py

requirements : update transformers to 5.5.1 (#21617)

2026-04-09 12:36:29 +02:00

test-tokenizer-0.sh

model : add Jina Embeddings v5 Nano (partial EuroBERT) support (#19826)

2026-02-26 12:14:09 +01:00

test-tokenizer-1-bpe.cpp

tool/ex/tests: consistently free ctx, then model (#18168)

2025-12-22 11:00:37 +01:00

test-tokenizer-1-spm.cpp

tool/ex/tests: consistently free ctx, then model (#18168)

2025-12-22 11:00:37 +01:00

test-tokenizer-random.py

requirements : update transformers to 5.5.1 (#21617)

2026-04-09 12:36:29 +02:00

test-tokenizers-repo.sh

…

testing.h

common : implement new jinja template engine (#18462)

2026-01-16 11:22:06 +01:00