Xuan-Son Nguyen 6c2131773c cli: new CLI experience (#17824) ...

* wip

* wip

* fix logging, add display info

* handle commands

* add args

* wip

* move old cli to llama-completion

* rm deprecation notice

* move server to a shared library

* move ci to llama-completion

* add loading animation

* add --show-timings arg

* add /read command, improve LOG_ERR

* add args for speculative decoding, enable show timings by default

* add arg --image and --audio

* fix windows build

* support reasoning_content

* fix llama2c workflow

* color default is auto

* fix merge conflicts

* properly fix color problem

Co-authored-by: bandoti <bandoti@users.noreply.github.com>

* better loading spinner

* make sure to clean color on force-exit

* also clear input files on "/clear"

* simplify common_log_flush

* add warning in mtmd-cli

* implement console writter

* fix data race

* add attribute

* fix llama-completion and mtmd-cli

* add some notes about console::log

* fix compilation

---------

Co-authored-by: bandoti <bandoti@users.noreply.github.com>

2025-12-10 15:28:59 +01:00

..

arg.cpp

cli: new CLI experience (#17824)

2025-12-10 15:28:59 +01:00

arg.h

common: move download functions to download.(cpp|h) (#17059)

2025-11-07 11:23:34 +01:00

base64.hpp

…

build-info.cpp.in

…

chat-parser-xml-toolcall.cpp

Fix Kimi-K2 tool-call parsing issues (#17376)

2025-12-08 14:32:04 +01:00

chat-parser-xml-toolcall.h

Fix Kimi-K2 tool-call parsing issues (#17376)

2025-12-08 14:32:04 +01:00

chat-parser.cpp

Fix Kimi-K2 tool-call parsing issues (#17376)

2025-12-08 14:32:04 +01:00

chat-parser.h

common : Generalized XML-style tool-call parsing with streaming support (GLM 4.5/4.6 + MiniMax M2 + SeedOSS + Kimi-K2 + Qwen3-Coder + Apriel-1.5 + Xiaomi-MiMo) (#16932)

2025-11-18 18:54:15 +01:00

chat-peg-parser.cpp

common : introduce composable PEG parser combinators for chat parsing (#17136)

2025-12-03 12:45:32 +02:00

chat-peg-parser.h

common : introduce composable PEG parser combinators for chat parsing (#17136)

2025-12-03 12:45:32 +02:00

chat.cpp

common : add parser for ministral/mistral large 3/devstral 2 (#17713)

2025-12-09 17:31:04 -06:00

chat.h

chat : reserve memory in compute_diffs and improve naming (#17729)

2025-12-03 17:22:10 +02:00

CMakeLists.txt

common : introduce composable PEG parser combinators for chat parsing (#17136)

2025-12-03 12:45:32 +02:00

common.cpp

common : change --color to accept on/off/auto, default to auto (#17827)

2025-12-07 03:43:50 +01:00

common.h

cli: new CLI experience (#17824)

2025-12-10 15:28:59 +01:00

console.cpp

cli: new CLI experience (#17824)

2025-12-10 15:28:59 +01:00

console.h

cli: new CLI experience (#17824)

2025-12-10 15:28:59 +01:00

download.cpp

ggml webgpu: add support for emscripten builds (#17184)

2025-12-03 10:25:34 +01:00

download.h

server: introduce API for serving / loading / unloading multiple models (#17470)

2025-12-01 19:41:04 +01:00

http.h

common: introduce http.h for httplib-based client (#16373)

2025-10-01 20:22:18 +03:00

json-partial.cpp

common : Generalized XML-style tool-call parsing with streaming support (GLM 4.5/4.6 + MiniMax M2 + SeedOSS + Kimi-K2 + Qwen3-Coder + Apriel-1.5 + Xiaomi-MiMo) (#16932)

2025-11-18 18:54:15 +01:00

json-partial.h

…

json-schema-to-grammar.cpp

Server: Change Invalid Schema from Server Error (500) to User Error (400) (#17572)

2025-12-02 17:33:50 +01:00

json-schema-to-grammar.h

common : Generalized XML-style tool-call parsing with streaming support (GLM 4.5/4.6 + MiniMax M2 + SeedOSS + Kimi-K2 + Qwen3-Coder + Apriel-1.5 + Xiaomi-MiMo) (#16932)

2025-11-18 18:54:15 +01:00

llguidance.cpp

…

log.cpp

cli: new CLI experience (#17824)

2025-12-10 15:28:59 +01:00

log.h

cli: new CLI experience (#17824)

2025-12-10 15:28:59 +01:00

ngram-cache.cpp

…

ngram-cache.h

…

peg-parser.cpp

common : introduce composable PEG parser combinators for chat parsing (#17136)

2025-12-03 12:45:32 +02:00

peg-parser.h

common : introduce composable PEG parser combinators for chat parsing (#17136)

2025-12-03 12:45:32 +02:00

regex-partial.cpp

…

regex-partial.h

…

sampling.cpp

common : more accurate sampling timing (#17382)

2025-11-20 13:40:10 +02:00

sampling.h

…

speculative.cpp

…

speculative.h

…

unicode.cpp

common : introduce composable PEG parser combinators for chat parsing (#17136)

2025-12-03 12:45:32 +02:00

unicode.h

common : introduce composable PEG parser combinators for chat parsing (#17136)

2025-12-03 12:45:32 +02:00