nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 15 Packages Projects Releases Wiki Activity
9,897 Commits 1 Branch 0 Tags
nik
Commit Graph
5 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Frank MaiandGitHub 1d8ee06000 rpc: fix register position (#11424) 
Signed-off-by: thxCode <thxcode0824@gmail.com>
 2025-01-26 16:20:34 +01:00
Frank MaiandGitHub 84eb2f4fad docs: introduce gpustack and gguf-parser (#8873) 
* readme: introduce gpustack

GPUStack is an open-source GPU cluster manager for running large
language models, which uses llama.cpp as the backend.

Signed-off-by: thxCode <thxcode0824@gmail.com>

* readme: introduce gguf-parser

GGUF Parser is a tool to review/check the GGUF file and estimate the
memory usage without downloading the whole model.

Signed-off-by: thxCode <thxcode0824@gmail.com>

---------

Signed-off-by: thxCode <thxcode0824@gmail.com>
 2024-08-12 14:45:50 +02:00
Frank MaiandGitHub f299aa98ec fix: typo of chatglm4 chat tmpl (#8586) 
Signed-off-by: thxCode <thxcode0824@gmail.com>
 2024-07-19 11:44:41 +02:00
Frank MaiandGitHub b96f9afb0d chore: clean useless beam search param (#7985) 
Signed-off-by: thxCode <thxcode0824@gmail.com>
 2024-06-18 10:11:40 +03:00
Frank MaiandGitHub c637fcd34d fix: divide 0 exception in mamba (#7932) 
Signed-off-by: thxCode <thxcode0824@gmail.com>
 2024-06-17 16:11:08 +02:00