Piotr Wilkin (ilintar) and GitHub
acc1b008cf
model-conversion : add extra debugging support for model conversion ( #15877 )
...
* feat: Extra debugging support for model conversion - added BF16 support for llama-callback-eval and support for dumping intermediate steps in run-org-model.py
2025-09-09 06:05:55 +02:00
Piotr Wilkin (ilintar) and GitHub
b2426e469e
chat : nemotron thinking & toolcalling support ( #15676 )
...
* feat: nemotron thinking & toolcalling support
* Trailing whitespaces
* Corrected template for Nemotron
* Template and parser fixes
* Final template and grammar changes
* Whitespace
* Always do lazy grammar processing since </think> tag will always be there.
* Allow extra content after toolcall
* Whitespace
* New tests: thinking + tools, tools + content, thinking + tools + content (new!)
* Whitespace
* Remove cURL test script
2025-09-05 01:22:22 +02:00
9e2b1e83c6
scripts : add Jinja tester PySide6 simple app ( #15756 )
...
* feat: add Jinja tester PySide6 simple app
* Linter fixes
* Pylint fixes
* Whitespace
* Add commandline support; add formatter; add extensions
* Remove testing actions
* Silence flake8 warnings for commandline mode
* Apply suggestions from code review
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
* Fix trailing whitespace/newline logic
* Update scripts/jinja/jinja-tester.py
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
* Update scripts/jinja/jinja-tester.py
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
---------
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
2025-09-05 01:05:12 +02:00
60e5eee31f
chat : Seed OSS thinking + tool call support ( #15552 )
...
* Reasoning and tool-calling support for Seed OSS
* Fix grammar and partial parsing
* Whitespace
* New chat template
* Update common/chat.cpp
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
* Update common/chat.cpp
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
* Remove unused 'purge_healing_marker' helper
---------
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
2025-08-29 14:53:41 +02:00
b1afcab804
model : add support for Seed-OSS ( #15490 )
...
* First draft
* Fix linter errors
* Added missing sinks nullptr
* Don't forget the llama-arch!
* We're through to the generation stage.
* Fix post-attention norm
* Apply suggestions from code review
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
* Fix RoPE type
* Fix tensor name and reorder llm_types
* Update gguf-py/gguf/constants.py
Remove nonexistent FFN_POST_NORM tensor
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
* Update src/llama-model.h
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
* Add basic chat template
* Add chat template tests
* Remake chat template test
* Apply suggestions from code review
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
* Update src/llama-chat.cpp
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
* Reorder llm type descriptions
* Update src/llama-model.cpp
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
---------
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
2025-08-23 15:21:52 +02:00
Piotr Wilkin (ilintar) and GitHub
670e1360cd
convert : fix Ernie4.5 MoE without shared experts ( #14746 )
2025-07-18 01:17:16 +02:00
cb887f1bc1
model: add Ernie 4.5 MoE support ( #14658 )
...
* Add Ernie4.5 MoE
* Fix Flake errors.
* Properly encode/decode MoE layer step
* Correct tensor mappings (.weight)
* Pass and read n_ff_exp
* n_ff_shexp calculation and further minor changes
* Rope fixes.
* .gitignore fix
* Add unit32 cast for Linux builds
* Apply suggestions from code review
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
* Further fixes from code review
* Fix trailing whitespace
* Reenable missing experts error
* Code style from code review
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
* Fix non-MoE regression
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
---------
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
2025-07-17 23:15:32 +02:00
Piotr Wilkin (ilintar) and GitHub
c753d7bed0
server : proper error handling for missing elements in messages array (OpenAI compatible backend) ( #13540 )
2025-05-15 08:40:58 +02:00
