Zhenwei Jin and GitHub
e597e50794
build: fix build error in Windows env with OneAPI setup ( #10107 )
2024-11-01 11:09:59 +08:00
ab3d71f97f
loader: refactor tensor weights storage ( #9935 )
...
* loader: refactor tensor weights storage
* use sorted map, sort weights by layer
---------
Co-authored-by: slaren <slarengh@gmail.com >
2024-10-31 19:50:39 +01:00
76b37d1541
gguf-split : improve --split and --merge logic ( #9619 )
...
* make sure params --split and --merge are not specified at same time
* update gguf-split params parse logic
* Update examples/gguf-split/gguf-split.cpp
Co-authored-by: slaren <slarengh@gmail.com >
---------
Co-authored-by: Xuan Son Nguyen <thichthat@gmail.com >
Co-authored-by: slaren <slarengh@gmail.com >
2024-10-02 10:21:57 +03:00
6102037bbb
vocab : refactor tokenizer to reduce init overhead ( #9449 )
...
* refactor tokenizer
* llama : make llm_tokenizer more private
ggml-ci
* refactor tokenizer
* refactor tokenizer
* llama : make llm_tokenizer more private
ggml-ci
* remove unused files
* remove unused fileds to avoid unused filed build error
* avoid symbol link error
* Update src/llama.cpp
* Update src/llama.cpp
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
2024-09-28 15:10:58 +03:00
Zhenwei Jin and GitHub
f1485161e5
src: make tail invalid when kv cell is intersection for mamba ( #9249 )
2024-09-02 13:53:23 -04:00
Zhenwei Jin and GitHub
4af8420afb
common : remove duplicate function llama_should_add_bos_token ( #8778 )
2024-08-15 10:23:23 +03:00
506122d854
llama-bench : add support for getting cpu info on Windows ( #8824 )
...
* Add support for getting cpu info on Windows for llama_bench
* refactor
---------
Co-authored-by: slaren <slarengh@gmail.com >
2024-08-07 03:01:06 +02:00
