|
d94c6e0ccb
|
llama : add support for SmolLm pre-tokenizer (#8609)
* Adding SmolLM Pre Tokenizer
* Update convert_hf_to_gguf_update.py
Co-authored-by: compilade <git@compilade.net>
* Update src/llama.cpp
Co-authored-by: compilade <git@compilade.net>
* handle regex
* removed .inp and out .out ggufs
---------
Co-authored-by: compilade <git@compilade.net>
|
2024-07-22 17:43:01 +03:00 |
|