Xuan-Son Nguyen 6c2131773c cli: new CLI experience (#17824) ...

* wip

* wip

* fix logging, add display info

* handle commands

* add args

* wip

* move old cli to llama-completion

* rm deprecation notice

* move server to a shared library

* move ci to llama-completion

* add loading animation

* add --show-timings arg

* add /read command, improve LOG_ERR

* add args for speculative decoding, enable show timings by default

* add arg --image and --audio

* fix windows build

* support reasoning_content

* fix llama2c workflow

* color default is auto

* fix merge conflicts

* properly fix color problem

Co-authored-by: bandoti <bandoti@users.noreply.github.com>

* better loading spinner

* make sure to clean color on force-exit

* also clear input files on "/clear"

* simplify common_log_flush

* add warning in mtmd-cli

* implement console writter

* fix data race

* add attribute

* fix llama-completion and mtmd-cli

* add some notes about console::log

* fix compilation

---------

Co-authored-by: bandoti <bandoti@users.noreply.github.com>

2025-12-10 15:28:59 +01:00

..

apple

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

jinja

scripts : add Jinja tester PySide6 simple app (#15756)

2025-09-05 01:05:12 +02:00

snapdragon

cli: new CLI experience (#17824)

2025-12-10 15:28:59 +01:00

bench-models.sh

scripts : add script to bench models (#16894)

2025-11-02 00:15:31 +02:00

build-info.sh

…

check-requirements.sh

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

compare-commits.sh

scripts: add sqlite3 check for compare-commits.sh (#15633)

2025-08-28 19:23:22 +08:00

compare-llama-bench.py

scripts: strip "AMD Instinct" from GPU name (#15668)

2025-08-29 22:04:08 +02:00

create_ops_docs.py

Docs: add instructions for adding backends (#14889)

2025-07-27 09:36:43 +08:00

debug-test.sh

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

fetch_server_test_models.py

llama : move end-user examples to tools directory (#13249)

2025-05-02 20:27:13 +02:00

gen-authors.sh

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

gen-unicode-data.py

…

get_chat_template.py

scripts: corrected encoding when getting chat template (#11866) (#11907)

2025-02-18 10:30:16 +01:00

get-flags.mk

…

get-hellaswag.sh

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

get-pg.sh

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

get-wikitext-2.sh

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

get-wikitext-103.sh

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

get-winogrande.sh

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

hf.sh

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

install-oneapi.bat

…

serve-static.js

ggml webgpu: add support for emscripten builds (#17184)

2025-12-03 10:25:34 +01:00

server-bench.py

llama: use FA + max. GPU layers by default (#15434)

2025-08-30 16:32:10 +02:00

sync_vendor.py

server: introduce API for serving / loading / unloading multiple models (#17470)

2025-12-01 19:41:04 +01:00

sync-ggml-am.sh

scripts : update sync scripts

2025-08-18 22:06:44 +03:00

sync-ggml.last

sync : ggml

2025-11-24 15:26:31 +02:00

sync-ggml.sh

scripts : update sync scripts

2025-08-18 22:06:44 +03:00

tool_bench.py

server : speed up tests (#15836)

2025-09-06 14:45:24 +02:00

tool_bench.sh

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

verify-checksum-models.py

…

xxd.cmake

llama : move end-user examples to tools directory (#13249)

2025-05-02 20:27:13 +02:00