Jeff Bolz c74759a244 vulkan: Use cm2 decode_vector for mul_mat_id B matrix loads (#23991) ...

This allows vec4 loads of the B elements. Also increase BK to 64 when this is
enabled. Neither of these alone is consistently faster, but together these give
a nice speedup.

In ggml-vulkan.cpp, we need to make sure the B matrix alignment and stride are
multiples of 4.

2026-06-08 10:40:37 +02:00

..

peg-parser

common/gemma4 : handle parsing edge cases (#21760)

2026-04-13 18:18:18 -05:00

snapshots

tests : add unit test coverage for llama_tensor_get_type (#20112)

2026-04-02 22:53:58 +02:00

.gitignore

tests : add unit test coverage for llama_tensor_get_type (#20112)

2026-04-02 22:53:58 +02:00

CMakeLists.txt

tests : move save-load-state from examples to tests (#23336)

2026-05-21 14:41:50 +03:00

export-graph-ops.cpp

tests: allow exporting graph ops from HF file without downloading weights (#21182)

2026-04-02 18:19:20 +02:00

get-model.cpp

…

get-model.h

…

gguf-model-data.cpp

ci : add [no release] keyword + fix sanitizer builds (#23728)

2026-05-26 19:05:48 +03:00

gguf-model-data.h

tests : add unit test coverage for llama_tensor_get_type (#20112)

2026-04-02 22:53:58 +02:00

test-alloc.cpp

…

test-arg-parser.cpp

spec : refactor params (#22397)

2026-04-28 09:07:33 +03:00

test-autorelease.cpp

…

test-backend-ops.cpp

vulkan: Use cm2 decode_vector for mul_mat_id B matrix loads (#23991)

2026-06-08 10:40:37 +02:00

test-backend-sampler.cpp

llama : deprecate llama_set_warmup (#24009)

2026-06-02 10:30:38 +03:00

test-barrier.cpp

…

test-c.c

…

test-chat-auto-parser.cpp

server: fix checkpoints creation (#22929)

2026-05-25 08:56:18 +03:00

test-chat-peg-parser.cpp

common/parser: add proper reasoning tag prefill reading (#20424)

2026-03-19 16:58:21 +01:00

test-chat-template.cpp

chat : add Granite 4.1 chat template (#23518)

2026-05-28 13:13:33 +02:00

test-chat.cpp

common/chat : fix LFM2/LFM2.5 reasoning round-trip and <think> leak (#24234)

2026-06-06 22:39:21 +02:00

test-double-float.cpp

…

test-gbnf-validator.cpp

…

test-gguf-model-data.cpp

tests : add unit test coverage for llama_tensor_get_type (#20112)

2026-04-02 22:53:58 +02:00

test-gguf.cpp

ggml: gguf_init_from_callback and gguf_init_from_buffer (#22341)

2026-05-25 11:33:29 +02:00

test-grammar-integration.cpp

common/grammar: fix grammar parsing issues to prevent stack overflow and hangs (#18604)

2026-03-21 18:43:35 +01:00

test-grammar-llguidance.cpp

…

test-grammar-parser.cpp

common/grammar: fix grammar parsing issues to prevent stack overflow and hangs (#18604)

2026-03-21 18:43:35 +01:00

test-jinja.cpp

jinja : support ensure_ascii=true, string repetition and int/float self-filtering (#21623)

2026-04-09 11:28:33 +02:00

test-json-partial.cpp

…

test-json-schema-to-grammar.cpp

tests : remove obsolete .mjs script (#21615)

2026-04-08 13:20:46 +03:00

test-llama-archs.cpp

llama : add Gemma4 MTP (#23398)

2026-06-07 20:50:54 +08:00

test-llama-grammar.cpp

common/grammar: fix grammar parsing issues to prevent stack overflow and hangs (#18604)

2026-03-21 18:43:35 +01:00

test-log.cpp

common: Intentionally leak logger instance to fix hanging on Windows (#22273)

2026-04-29 10:58:43 +03:00

test-lora-conversion-inference.sh

…

test-model-load-cancel.cpp

…

test-mtmd-c-api.c

mtmd: add pos_0 to mtmd_image_tokens_get_decoder_pos (breaking change) (#22082)

2026-04-19 11:57:21 +02:00

test-opt.cpp

…

test-peg-parser.cpp

…

test-quant-type-selection.cpp

tests : add unit test coverage for llama_tensor_get_type (#20112)

2026-04-02 22:53:58 +02:00

test-quantize-fns.cpp

ggml: add Q1_0 1-bit quantization support (CPU) (#21273)

2026-04-06 20:55:21 +02:00

test-quantize-perf.cpp

…

test-quantize-stats.cpp

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

test-reasoning-budget.cpp

common : support manually triggering the reasoning budget end sequence (#23949)

2026-06-01 11:37:11 +02:00

test-recurrent-state-rollback.cpp

llama + spec: MTP Support (#22673)

2026-05-16 20:06:23 +08:00

test-regex-partial.cpp

…

test-rope.cpp

…

test-sampling.cpp

…

test-save-load-state.cpp

tests : refactor test-save-load-state to accept token input (#24073)

2026-06-04 08:06:36 +03:00

test-state-restore-fragmented.cpp

common : only load backends when required (#22290)

2026-05-05 09:23:50 +02:00

test-thread-safety.cpp

common : move up common_init() and fix Windows UTF-8 logs (#21176)

2026-03-31 12:53:41 +02:00

test-tokenizer-0.cpp

…

test-tokenizer-0.py

requirements : update transformers to 5.5.1 (#21617)

2026-04-09 12:36:29 +02:00

test-tokenizer-0.sh

…

test-tokenizer-1-bpe.cpp

…

test-tokenizer-1-spm.cpp

…

test-tokenizer-random.py

requirements : update transformers to 5.5.1 (#21617)

2026-04-09 12:36:29 +02:00

test-tokenizers-repo.sh

…

testing.h

…