nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 23 Packages Projects Releases Wiki Activity

common: mark --split-mode tensor as experimental (#21684)

Browse Source
This commit is contained in:
Johannes Gäßler
2026-04-10 12:27:27 +02:00
committed by GitHub
parent f989a6e39e
commit 0893f50f2d
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
common/arg.cpp
+1 -1
View File
@@ -2353,7 +2353,7 @@ common_params_context common_params_parser_init(common_params & params, llama_ex
"- none: use one GPU only\n" "- none: use one GPU only\n"
"- layer (default): split layers and KV across GPUs (pipelined)\n" "- layer (default): split layers and KV across GPUs (pipelined)\n"
"- row: split weight across GPUs by rows (parallelized)\n" "- row: split weight across GPUs by rows (parallelized)\n"
"- tensor: split weights and KV across GPUs (parallelized)", "- tensor: split weights and KV across GPUs (parallelized, EXPERIMENTAL)",
[](common_params & params, const std::string & value) { [](common_params & params, const std::string & value) {
if (value == "none") { if (value == "none") {
params.split_mode = LLAMA_SPLIT_MODE_NONE; params.split_mode = LLAMA_SPLIT_MODE_NONE;