nopperl and GitHub
f99d3f8367
py : add model class for Chameleon conversion ( #9683 )
2024-09-29 15:02:06 +03:00
9a913110cf
llama : add support for Chameleon ( #8543 )
...
* convert chameleon hf to gguf
* add chameleon tokenizer tests
* fix lint
* implement chameleon graph
* add swin norm param
* return qk norm weights and biases to original format
* implement swin norm
* suppress image token output
* rem tabs
* add comment to conversion
* fix ci
* check for k norm separately
* adapt to new lora implementation
* fix layer input for swin norm
* move swin_norm in gguf writer
* add comment regarding special token regex in chameleon pre-tokenizer
* Update src/llama.cpp
Co-authored-by: compilade <git@compilade.net >
* fix punctuation regex in chameleon pre-tokenizer (@compilade)
Co-authored-by: compilade <git@compilade.net >
* fix lint
* trigger ci
---------
Co-authored-by: compilade <git@compilade.net >
2024-09-28 15:08:43 +03:00
nopperl and GitHub
b6aa670203
Fix OLMo HF to GGUF conversion ( #6910 )
2024-05-07 21:39:43 +02:00
nopperl and GitHub
9958c81b79
Implement the OLMo architecture ( #6741 )
...
* implement olmo architecture
* remove unused variable
* remove unused moe branch
* remove check for weight
* remove superfluous moe, bias and rope tensors
* clarified comment
* fix clamp_kqv setting
* remove obsolete parameter name filter
2024-04-19 11:35:54 +02:00
9d679f0fcc
examples : support minItems/maxItems in JSON grammar converter ( #5039 )
...
* support minLength and maxLength in JSON schema grammar converter
* Update examples/json-schema-to-grammar.py
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
2024-02-19 16:14:07 +02:00