4 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
3 people	6102037bbb	vocab : refactor tokenizer to reduce init overhead (#9449) ... * refactor tokenizer * llama : make llm_tokenizer more private ggml-ci * refactor tokenizer * refactor tokenizer * llama : make llm_tokenizer more private ggml-ci * remove unused files * remove unused fileds to avoid unused filed build error * avoid symbol link error * Update src/llama.cpp * Update src/llama.cpp --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>	2024-09-28 15:10:58 +03:00
Zhenwei JinandGitHub	f1485161e5	src: make tail invalid when kv cell is intersection for mamba (#9249)	2024-09-02 13:53:23 -04:00
Zhenwei JinandGitHub	4af8420afb	common : remove duplicate function llama_should_add_bos_token (#8778)	2024-08-15 10:23:23 +03:00
3 people	506122d854	llama-bench : add support for getting cpu info on Windows (#8824) ... * Add support for getting cpu info on Windows for llama_bench * refactor --------- Co-authored-by: slaren <slarengh@gmail.com>	2024-08-07 03:01:06 +02:00