3 people 68f30663cf vocab : refactor normalizer flags into options struct, add strip_accents (#24371) ...

* vocab : refactor normalizer flags into options struct, add strip_accents

* Update src/llama-vocab.h

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

* Update src/llama-vocab.cpp

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

---------

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

2026-06-11 10:36:50 +03:00

..

scripts

ggml : add NVFP4 quantization type support (#19769)

2026-03-11 21:02:54 +01:00

__init__.py

convert-*.py: GGUF Naming Convention Refactor and Metadata Override Refactor (#7499)

2024-07-18 20:40:15 +10:00

constants.py

vocab : refactor normalizer flags into options struct, add strip_accents (#24371)

2026-06-11 10:36:50 +03:00

gguf_reader.py

ggml/gguf : prevent integer overflows (#19856)

2026-02-24 20:17:11 +02:00

gguf_writer.py

vocab : refactor normalizer flags into options struct, add strip_accents (#24371)

2026-06-11 10:36:50 +03:00

gguf.py

gguf-py: Refactor and allow reading/modifying existing GGUF files (#3981)

2023-11-11 08:04:50 +03:00

lazy.py

ci : switch from pyright to ty (#20826)

2026-03-21 08:54:34 +01:00

metadata.py

chore : correct typos [no ci] (#20041)

2026-03-05 08:50:21 +01:00

py.typed

convert : various script cleanups/fixes + merges and special token handling (#2842)

2023-08-30 11:25:50 +03:00

quants.py

convert : minor fixes for numpy 2.x (#23571)

2026-05-24 09:51:31 +02:00

tensor_mapping.py

mtp: support for gemma-4 E2B and E4B assistants (#24282)

2026-06-08 13:48:52 -07:00

utility.py

gguf-py : do not align the data start offset (#18291)

2025-12-22 20:25:16 +01:00

vocab.py

vocab : refactor normalizer flags into options struct, add strip_accents (#24371)

2026-06-11 10:36:50 +03:00