nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 19 Packages Projects Releases Wiki Activity

docs: fix export-lora --lora-scaled syntax [no release] (#24703)

Browse Source 
Assisted-by: Codex
This commit is contained in:
Kangjia Gao
2026-06-18 16:46:17 +02:00
committed by GitHub
parent fe7c8b2414
commit 7b6c5a2aed
1 changed files with 6 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files
tools/export-lora/README.md
+6 -8
View File
@@ -6,11 +6,10 @@ Apply LORA adapters to base model and export the resulting model.
usage: llama-export-lora [options] usage: llama-export-lora [options]
options: options:
-m, --model model path from which to load base model (default '') -m, --model FNAME model path from which to load base model
--lora FNAME path to LoRA adapter (can be repeated to use multiple adapters) --lora FNAME path to LoRA adapter (use comma-separated values to load multiple adapters)
--lora-scaled FNAME S path to LoRA adapter with user defined scaling S (can be repeated to use multiple adapters) --lora-scaled FNAME:SCALE,... path to LoRA adapter with user defined scaling (format: FNAME:SCALE,...)
-t, --threads N number of threads to use during computation (default: 4) -o, --output, --output-file FNAME output file (default: 'ggml-lora-merged-f16.gguf')
-o, --output FNAME output file (default: 'ggml-lora-merged-f16.gguf')
``` ```
For example: For example:
@@ -22,12 +21,11 @@ For example:
--lora lora-open-llama-3b-v2-english2tokipona-chat-LATEST.gguf --lora lora-open-llama-3b-v2-english2tokipona-chat-LATEST.gguf
``` ```
Multiple LORA adapters can be applied by passing multiple `--lora FNAME` or `--lora-scaled FNAME S` command line parameters: Multiple LORA adapters can be applied by passing comma-separated values to `--lora FNAME` or `--lora-scaled FNAME:SCALE,...`:
```bash ```bash
./bin/llama-export-lora \ ./bin/llama-export-lora \
-m your_base_model.gguf \ -m your_base_model.gguf \
-o your_merged_model.gguf \ -o your_merged_model.gguf \
--lora-scaled lora_task_A.gguf 0.5 \ --lora-scaled lora_task_A.gguf:0.5,lora_task_B.gguf:0.5
--lora-scaled lora_task_B.gguf 0.5
``` ```