nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 29 Packages Projects Releases Wiki Activity
6,369 Commits 1 Branch 0 Tags
407c23786dd0d3a503e9429eead96e611d3950c9
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Georgi GerganovandGitHub cdedb70a99 sampling : optimize dist sampler (#15704) 
ggml-ci
 2025-09-03 18:16:26 +03:00
Georgi GerganovGitHubJohannes Gäßler
 		e92d53b29e sampling : optimize samplers by reusing bucket sort (#15665) 
* sampling : optimize sorting using bucket sort in more places

ggml-ci

* sampling : do not sort in dist sampler

ggml-ci

* sampling : avoid heap allocations for sort buffers

ggml-ci

* common : add option to sort sampling candidates by probability

ggml-ci

* sampling : revert the change for preserving sort buffers

* sampling : use std::copy instead of memcpy

* sampling : clarify purpose of partial sort helpers

ggml-ci

* cont : remove wrong comment [no ci]

* common : update comment

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

---------

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
 2025-08-31 20:41:02 +03:00
Georgi GerganovandGitHub 0d161f021a server : enable /slots by default and make it secure (#15630) 
* server : enable /slots by default and make it secure

ggml-ci

* server : fix tests to pass `--no-slots` when necessary

* server : extend /props with info about enabled endpoints
 2025-08-31 20:11:58 +03:00
Georgi GerganovandGitHub 4efd5a8316 metal : fix checks for available FA kernels (#15700) 
* metal : fix checks for available FA kernels

ggml-ci

* cont : fix comment [no ci]
 2025-08-31 19:43:30 +03:00
Georgi GerganovandGitHub c8d0d14e77 kv-cache : fix find_slot to not search for continuous slot (#15638) 
ggml-ci
 2025-08-28 17:09:05 +03:00
Georgi GerganovandGitHub 8a4280ce43 kv-cache : remove LLAMA_SET_ROWS checks (#15505) 
ggml-ci
 2025-08-28 12:27:02 +03:00
Georgi GerganovandGitHub da54f9f1a2 presets : add qwen3-30B-a3b FIM (#15616) 2025-08-27 15:48:07 +03:00
Georgi GerganovandGitHub 1bded5a3b3 kv-cache : better estimate of n_kv for multi-sequence batches (#15610) 
ggml-ci
 2025-08-27 13:55:12 +03:00
Georgi GerganovandGitHub 0373486dbc graph : fix assert in memory-less build_attn (#15590) 
ggml-ci
 2025-08-26 17:45:17 +03:00
Georgi GerganovandGitHub b3964c1e89 metal : optimize FA vec for large sequences and BS <= 8 (#15566) 
* metal : optmize FA vec for large heads and sequences

* metal : adjust small-batch mul mv kernels

ggml-ci

* batched-bench : fix total speed computation

ggml-ci

* cont : add comments

ggml-ci
 2025-08-26 14:22:14 +03:00
Georgi GerganovandGitHub 85cc1ae998 context : print graph stats for memory-less contexts (#15586) 
ggml-ci
 2025-08-26 12:47:00 +03:00
Georgi GerganovandGitHub 1d8d83deaa metal : improve MUL_MAT_ID (#15541) 
* metal : mul_mm_id remove hdst

* metal : remove mul_mm_id hsrc1

* metal : mul_mm_id simplify + add test

* metal : opt mul_mm_id map0

* metal : optimize mul_mm_id id gathering

* metal : mul/div opt

* metal : optimize mul_mm_id_map0

ggml-ci
 2025-08-26 12:46:15 +03:00
Georgi GerganovandGitHub 6b64f74b55 batched-bench : fix unified KV cache handling + pp timing (#15562) 
* batched-bench : fix unified KV cache handling + pp timing

* cont : run dummy token only with split KV cache
 2025-08-25 13:56:43 +03:00
Georgi GerganovandGitHub b0ba31f525 metal : add FA kernels for HS=40 (#15559) 
ggml-ci
 2025-08-25 10:14:48 +03:00
Georgi GerganovandGitHub b730706a49 kv-cache : support layer reuse (#15504) 
* kv-cache : support layer reuse

ggml-ci

* cont : update comments [no ci]
 2025-08-24 13:07:07 +03:00
Georgi GerganovandGitHub 9ebebef62f llama : remove KV cache defragmentation logic (#15473) 
ggml-ci
 2025-08-22 12:22:13 +03:00
Georgi GerganovandGitHub cd36b5e5c7 llama : remove deprecated llama_kv_self API (#15472) 
ggml-ci
 2025-08-21 19:13:45 +03:00
Georgi GerganovandGitHub 3f196be84b graph : remove build_attn_with_sinks overload (#15469) 
ggml-ci
 2025-08-21 18:44:45 +03:00
Georgi GerganovandGitHub 715a6db02c kv-cache : drop the "unified" prefix (#15467) 
* kv-cache : drop the "unified" prefix

ggml-ci

* cont : fix comment [no ci]
 2025-08-21 17:00:33 +03:00
Georgi GerganovandGitHub 30649cab65 ci : continue file download with wget (#15471) 
ggml-ci
 2025-08-21 13:42:55 +03:00
Georgi GerganovandGitHub 2f37014073 lookahead : add sample command to readme (#15447) 
* lookahead : add sample command to readme

* cont : build-agnostic command
 2025-08-20 13:30:46 +03:00
Georgi GerganovandGitHub 9ef6b0b835 model : add gpt-oss type strings (#15424) 2025-08-19 19:58:28 +03:00
Georgi GerganovandGitHub d2fcd91cf9 server : disable context shift by default (#15416) 
* server : disable context shift by default

ggml-ci

* server : make scopr of test parameters local
 2025-08-19 16:46:37 +03:00
Georgi GerganovandGitHub 9d262f4bad server : remove swa_full warning (#15399) 2025-08-19 08:45:26 +03:00
Georgi GerganovandGitHub f0d3c7405c batched-bench : use rand tokens (#15398) 2025-08-19 08:45:12 +03:00
Georgi Gerganov 6d7f1117e3 codeowners : remove mmv.* 2025-08-18 22:06:44 +03:00
Georgi Gerganov 60212f1ead sync : ggml 2025-08-18 22:06:44 +03:00
Georgi Gerganov f0c541d315 scripts : update sync scripts 2025-08-18 22:06:44 +03:00
Georgi GerganovandGitHub 3007baf201 readme : update hot topics (#15397) 2025-08-18 18:11:44 +03:00
Georgi GerganovandGitHub 5edf1592fd vulkan : fix out-of-bounds access in argmax kernel (#15342) 
ggml-ci
 2025-08-15 16:16:36 +02:00
Georgi GerganovandGitHub db3010bd23 vulkan : fix compile warnings on macos (#15340) 
ggml-ci
 2025-08-15 15:28:28 +02:00
Georgi GerganovandGitHub df36bce667 eval-callback : stop on first NaN (#15320) 
* eval-callback : stop on first NaN

* cont : log error
 2025-08-14 22:10:51 +03:00
Georgi GerganovandGitHub 1a01899b61 readme : update hot topics (#15315) 2025-08-14 17:16:03 +03:00
Georgi GerganovandGitHub d32e03f449 server : add SWA checkpoints (#15293) 
* server : add SWA checkpoints

ggml-ci

* cont : server clean-up

* server : handle state restore fails

* llama : add extended llama_state_seq_ API

* server : do not make checkpoints if --swa-full

ggml-ci

* llama : remove flags value for NONE

* server : configure number of SWA checkpoints with CLI arg

ggml-ci

* args : fix scope of new argument
 2025-08-14 14:59:50 +03:00
Georgi Gerganov 3973163bff sync : ggml 
ggml-ci
 2025-08-14 14:59:27 +03:00
Georgi Gerganov 8b2483730f tests : remove unused includes (ggml/0) 2025-08-14 14:59:27 +03:00
Georgi GerganovandGitHub 00f35d509e ggml : repack block_iq4_nlx8 (#14904) 
ggml-ci
 2025-08-13 11:09:39 +03:00
Georgi GerganovandGitHub 228f724d9c kv-cache : fix seq_rm with seq_id == -1 (#15226) 
* kv-cache : fix seq_rm with seq_id == -1

ggml-ci

* cont : iterate over streams

ggml-ci
 2025-08-11 13:58:24 +03:00
Georgi GerganovGitHubslarenXuan Son Nguyen
 		fd1234cb46 llama : add gpt-oss (#15091) 
* oai moe

* compat with new checkpoint

* add attn sink impl

* add rope scaling yarn

* logits match with latest transformers code

* wip chat template

* rm trailing space

* use ggml_scale_bias

* rm redundant is_swa_all

* convert interleaved gate_up

* graph : fix activation function to match reference (#7)

* vocab : handle o200k_harmony special tokens

* ggml : add attention sinks support (#1)

* llama : add attn sinks

* ggml : add attn sinks

* cuda : add attn sinks

* vulkan : add support for sinks in softmax

remove unnecessary return

* ggml : add fused swiglu_oai op (#11)

* ggml : add fused swiglu_oai op

* Update ggml/src/ggml-cpu/ops.cpp

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

* update CUDA impl

* cont : metal impl

* add vulkan impl

* test-backend-ops : more test cases, clean up

* llama : remove unfused impl

* remove extra lines

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

---------

Co-authored-by: slaren <slarengh@gmail.com>

* repack mxfp4 upon conversion

* clean up a bit

* enable thinking

* add quick hack to render only some special tokens

* fix bf16 conversion

* remove vocab hack

* webui ok

* support chat parsing for gpt-oss

* fix webui

* direct mapping mxfp4, FINALLY

* force using mxfp4

* properly use lazy tensor

* ggml : add mxfp4

ggml : use e8m0 conversion instead of powf

Co-authored-by: Diego Devesa <slarengh@gmail.com>

change kvalues_mxfp4 table to match e2m1 (#6)

metal : remove quantization for now (not used)

cuda : fix disabled CUDA graphs due to ffn moe bias

vulkan : add support for mxfp4

cont : add cm2 dequant

* ggml : add ggml_add_id (#13)

* ggml : add ggml_add_id

* add cuda impl

* llama : add weight support check for add_id

* perf opt

* add vulkan impl

* rename cuda files

* add metal impl

* allow in-place ggml_add_id

* llama : keep biases on CPU with --cpu-moe

* llama : fix compile error

ggml-ci

* cuda : add fallback for __nv_cvt_e8m0_to_bf16raw

ggml-ci

* cleanup

ggml-ci

* sycl : fix supports_op for MXFP4

ggml-ci

* fix Unknown reasoning format

* ggml-cpu : fix AVX build

ggml-ci

* fix hip build

ggml-ci

* cuda : add mxfp4 dequantization support for cuBLAS

ggml-ci

* ggml-cpu : fix mxfp4 fallback definitions for some architectures

ggml-ci

* cuda : fix version required for __nv_cvt_e8m0_to_bf16raw

---------

Co-authored-by: Xuan Son Nguyen <son@huggingface.co>
Co-authored-by: slaren <slarengh@gmail.com>
 2025-08-05 22:10:36 +03:00
Georgi GerganovandGitHub be42642581 readme : update hot topics (#15097) 2025-08-05 20:19:33 +03:00
Georgi GerganovandGitHub a4569c41fd llama : enable LLAMA_SET_ROWS=1 by default (#14959) 
ggml-ci
 2025-08-02 17:14:21 +03:00
Georgi GerganovandGitHub 15e92fd337 cuda, sycl : fix batched gemm when ne02 == 1 && ne03 > 1 (#15038) 
* cuda, sycl : fix batched gemm when ne02 == 1 && ne03 > 1

ggml-ci

* cont : fix cont types

ggml-ci

* cont : adopt variable names and comment from the other branch
 2025-08-02 17:13:05 +03:00
Georgi GerganovandGitHub ba42794c9e graph : fix equal_seq() check (#14986) 
ggml-ci
 2025-08-01 06:38:12 +03:00
Georgi Gerganov e32a4ec60e sync : ggml 
ggml-ci
 2025-07-30 17:33:11 +03:00
Georgi GerganovandGitHub 00131d6eaf tests : update for LLAMA_SET_ROWS=1 (#14961) 
* test-thread-safety : each context uses a single sequence

* embedding : handle --parallel argument

ggml-ci

* save-load : handle -np 1

ggml-ci

* thread-safety : avoid overriding threads, reduce test case arg

ggml-ci
 2025-07-30 15:12:02 +03:00
Georgi GerganovandGitHub 1e15bfd42c graph : fix stack-use-after-return (#14960) 
ggml-ci
 2025-07-30 13:52:11 +03:00
Georgi GerganovandGitHub a5771c9eea ops : update BLAS (#14914) 2025-07-28 10:01:03 +02:00
Georgi GerganovandGitHub c35f9eaf09 ops : update Metal (#14912) 2025-07-28 08:22:56 +03:00
Georgi Gerganov 1f45f2890e sync : ggml 2025-07-28 08:15:01 +03:00
Georgi GerganovandGitHub c1dbea752a context : restore preemptive sched reset when LLAMA_SET_ROWS=0 (#14870) 
ggml-ci
 2025-07-25 14:28:06 +03:00
Georgi Gerganov 2df255da3c sync : ggml 
ggml-ci
 2025-07-24 20:27:23 +03:00
Georgi GerganovandGitHub e4868d16d2 context : perform output reorder lazily upon access after sync (#14853) 
* context : perform output reorder after lazily upon access after sync

ggml-ci

* cont : add TODO
 2025-07-24 16:31:48 +03:00
Georgi GerganovandGitHub 065908cb09 metal : fix fusion across different encoders (#14849) 
* metal : fix fusion across different encoders

ggml-ci

* cont : add assertion

ggml-ci
 2025-07-24 10:24:05 +03:00
Georgi Gerganov 18f3b5ff9e tests : add non-cont K,V FA tests 
ggml-ci
 2025-07-23 14:08:09 +03:00
Georgi Gerganov b17230917c sync : ggml 2025-07-19 11:46:50 +03:00
Georgi GerganovandGitHub bf9087f59a metal : fuse add, mul + add tests (#14596) 
ggml-ci
 2025-07-18 20:37:26 +03:00
Georgi GerganovandGitHub 9fb1042ce6 graph : fix graph reuse reset of params (#14760) 
ggml-ci
 2025-07-18 20:08:33 +03:00
Georgi GerganovandGitHub 2adf8d83ac parallel : add option for different RNG seeds (#14757) 
ggml-ci
 2025-07-18 17:33:41 +03:00
Georgi GerganovandGitHub d498af3d5a graph : avoid huge warm-up graphs for MoE models (#14753) 
* graph : avoid huge warm-up graphs for MoE models

ggml-ci

* cont : bump max nodes to 8x model tensors
 2025-07-18 14:31:15 +03:00
Georgi GerganovandGitHub eacdeb5bfc model : fix build after merge conflict (#14754) 2025-07-18 11:53:55 +03:00
Georgi GerganovandGitHub 8f974bc1e9 graph : refactor context to not pass gf explicitly (#14629) 
ggml-ci
 2025-07-18 08:29:28 +03:00
Georgi GerganovandGitHub d6fb3f6b49 kv-cache : fix k-shift for multiple streams (#14742) 
ggml-ci
 2025-07-17 20:52:33 +03:00
Georgi GerganovandGitHub 01612b7409 llama : reuse compute graphs (#14482) 
* llama : reuse compute graphs

ggml-ci

* llama-bench : add graph reuse parameter

ggml-ci

* cont : remove the parameter and the sched resets

ggml-ci

* graph : rename update() to can_reuse()

ggml-ci

* params : remove is_same()

ggml-ci

* graph : set res->params in llm_graph_context constructor

ggml-ci

* graph : avoid set_max_nodes in llm_graph_result

ggml-ci

* kv-cache : reuse llama_context's graph result instance

ggml-ci

* context : reset the previous graph result upon memory updates

ggml-ci

* batch : llama_ubatch now carries its data instead of pointing to balloc

ggml-ci

* merge : fix build

ggml-ci

* graph : fix can_reuse() checks when flash-attention is disabled

* graph : move llm_graph_result impl in source file + debug env

ggml-ci
 2025-07-17 19:08:33 +03:00
Georgi GerganovandGitHub d9b691081c kv-cache : opt mask set input (#14600) 
ggml-ci
 2025-07-17 09:49:15 +03:00
Georgi GerganovandGitHub ad57d3edd2 batch : fix uninitialized has_cpl flag (#14733) 
ggml-ci
 2025-07-17 09:45:54 +03:00
Georgi GerganovGitHubJohannes Gäßler
 		225e7a1438 llama : add high-throughput mode (#14363) 
* kv-cache : prepare K/V buffers for separation

ggml-ci

* batched-bench : fix oob write

ggml-ci

* llama : add "virtual sequences"

ggml-ci

* llama : use "stream" vs "virtual sequence"

ggml-ci

* graph : fix stream splitting when KV cache is not used

ggml-ci

* kv-cache : add multi-stream save/load support

ggml-ci

* llama : add "--attn-streams" flag

ggml-ci

* kv-cache : fix handling when find_slot fails

ggml-ci

* kv-cache : restore find_slot impl

ggml-ci

* kv-cache : add comments

* kv-cache : add bounds checks for sequence id

ggml-ci

* cont : add n_seq_max to batch allocr

ggml-ci

* kv-cache : perform stream copies lazily after llama_synchronize

ggml-ci

* kv-cache : avoid throwing exceptions across the C boundary

ggml-ci

* CUDA: 4D FlashAttention support (#14628)

* CUDA: 4D FlashAttention support

* CUDA: fix WMMA FA kernel

* llama : rename attn_streams -> kv_unified

ggml-ci

* common : rename kv_split -> kv_unified

ggml-ci

---------

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
 2025-07-16 16:35:42 +03:00
Georgi GerganovGitHubDiego Devesa
 		64978340b0 ggml : add asserts (#14720) 
* ggml : add asserts

ggml-ci

* cont : fix constant type

Co-authored-by: Diego Devesa <slarengh@gmail.com>

---------

Co-authored-by: Diego Devesa <slarengh@gmail.com>
 2025-07-16 14:43:32 +03:00
Georgi GerganovandGitHub 6ffd4e9c44 server : pre-calculate EOG logit biases (#14721) 
ggml-ci
 2025-07-16 14:04:12 +03:00
Georgi GerganovandGitHub 538cc77f7f server : fix handling of the ignore_eos flag (#14710) 
ggml-ci
 2025-07-16 12:13:57 +03:00
Georgi GerganovandGitHub 05fec5bd29 ggml : add build-time message to remind about ggml_set_rows (#14661) 
ggml-ci
 2025-07-13 10:36:33 +03:00
Georgi Gerganov 8eff95544e sync : ggml 2025-07-12 16:13:27 +03:00
Georgi Gerganov 3120413ccd vulkan : remove unused vars (#0) 
ggml-ci
 2025-07-12 14:25:44 +03:00
Georgi Gerganov 215535701d sync : ggml 
ggml-ci
 2025-07-12 14:25:44 +03:00
Georgi GerganovandGitHub aaa088d87f readme : add hot PRs (#14636) 
* readme : add hot PRs

* cont

* readme : update title

* readme : hot PRs links

* cont
 2025-07-11 16:07:55 +03:00
Georgi GerganovandGitHub 0d5375d54b llama : move enum llama_vocab_pre_type to implementation (#14631) 
ggml-ci
 2025-07-11 13:46:07 +03:00
Georgi GerganovandGitHub 4d0dcd4a06 cuda : fix rope with partial rotation and non-cont src (#14580) 
* cuda : fix rope non-cont

ggml-ci

* cont : fix multi-rope + add test

ggml-ci

* sycl : try fix

ggml-ci

* cont : fix sycl + clean-up cuda

ggml-ci
 2025-07-08 10:15:21 +03:00
Georgi GerganovandGitHub bac8bed248 eval-callback : check for empty input (#14539) 2025-07-05 07:18:09 +03:00
Georgi GerganovandGitHub ef797db357 metal : disable fast math in all quantize kernels (#14528) 
ggml-ci
 2025-07-04 19:19:09 +03:00
Georgi GerganovandGitHub 67d1ef23c6 batch : add optional for sequential equal split (#14511) 
ggml-ci
 2025-07-04 09:08:59 +03:00
Georgi GerganovandGitHub 7b50f7c025 graph : prepare for 4D mask (#14515) 
ggml-ci
 2025-07-04 09:05:36 +03:00
Georgi GerganovandGitHub c79184d2d1 batch : add n_used count (#14512) 
ggml-ci
 2025-07-04 09:04:59 +03:00
Georgi GerganovandGitHub a70c8a0c4b kv-cache : use ggml_set_rows (#14285) 
* kv-cache : use ggml_set_rows

ggml-ci

* graph : separate k and v indices

ggml-ci

* cont : remove redundant ifs

ggml-ci

* kv-cache : improve find_slot impl

* kv-cache : bounds-check when accessing slot_info indices

* kv-cache : add comments

ggml-ci

* ggml : add TODOs for adding GGML_OP_SET_ROWS support in the backends

ggml-ci
 2025-07-03 10:53:35 +03:00
Georgi GerganovandGitHub 9067487c44 ggml : fix FA mask dim 2 and 3 (#14505) 
* ggml : fix FA mask dim 2 and 3

ggml-ci

* backends : unsupport batched FA in CUDA and Vulkan

ggml-ci

* vulkan : disable FA for mask->ne[2] != 1
 2025-07-03 10:46:57 +03:00
Georgi GerganovandGitHub d4cdd9c1c3 ggml : remove kompute backend (#14501) 
ggml-ci
 2025-07-03 07:48:32 +03:00
Georgi Gerganov e17991c466 sync : ggml 
ggml-ci
 2025-07-02 20:08:45 +03:00
Georgi Gerganov ec68e84c32 ggml : support bcast ggml_soft_max_ext, ggml_flash_attn_ext (#14435) 
ggml-ci
 2025-07-02 15:48:33 +03:00
Georgi GerganovandGitHub d7f5f4e578 simple-chat : fix context-exceeded condition (#14494) 
* simple-chat : fix context-exceeded condition

ggml-ci

* cont : fix n_ctx_used computation

ggml-ci
 2025-07-02 14:12:07 +03:00
Georgi GerganovandGitHub de56944147 ci : disable fast-math for Metal GHA CI (#14478) 
* ci : disable fast-math for Metal GHA CI

ggml-ci

* cont : remove -g flag

ggml-ci
 2025-07-01 18:04:08 +03:00
Georgi Gerganov a6a47958a1 ggml : remove trailing whitespace (#0) 2025-07-01 11:06:39 +03:00
Georgi Gerganov f61c05d4b1 sync : ggml 
ggml-ci
 2025-07-01 11:06:39 +03:00
Georgi GerganovandGitHub 745f11fed0 memory : correctly handle failure in apply() (#14438) 
ggml-ci
 2025-06-30 18:03:03 +03:00
Georgi GerganovandGitHub 5dd942de59 metal : disable fast-math for some cpy kernels (#14460) 
* metal : disable fast-math for some cpy kernels

ggml-ci

* cont : disable for q4_1

ggml-ci

* cont : disable for iq4_nl

ggml-ci
 2025-06-30 17:04:05 +03:00
Georgi GerganovandGitHub 72babea5de graph : make llm_graph_context destructor virtual (#14410) 
ggml-ci
 2025-06-27 21:42:02 +03:00
Georgi GerganovandGitHub 43678060c1 recurrent : call balloc split_reset() in init_batch() (#14414) 
ggml-ci
 2025-06-27 17:55:45 +03:00
Georgi GerganovandGitHub e8215dbb96 metal : add special-case mat-vec mul for ne00 == 4 (#14385) 
ggml-ci
 2025-06-26 15:51:19 +03:00
Georgi GerganovandGitHub 5783ae4359 metal : batch rows copy in a single threadgroup (#14384) 
* metal : batch rows copy in a single threadgroup

ggml-ci

* metal : handle some edge cases when threadgroup size is not a power of 2

ggml-ci
 2025-06-26 15:50:15 +03:00
Georgi GerganovandGitHub 62af464227 batch : fix check for empty sequences in memory (#14364) 
* batch : fix check for empty sequences in memory

ggml-ci

* cont : reuse the var

ggml-ci
 2025-06-24 18:26:30 +03:00
Georgi GerganovandGitHub 7b50d589a8 kv-cells : fix tracking of seq_pos (#14339) 
* kv-cells : fix tracking of seq_pos during cache reuse

ggml-ci

* cont : improve error message

ggml-ci

* cont : add more comments
 2025-06-23 12:27:35 +03:00
Georgi GerganovandGitHub f1f5e82df6 examples : fix is_first logic for tokenization (#14329) 
ggml-ci
 2025-06-22 20:10:07 +03:00
Georgi GerganovandGitHub 67ae5312e2 metal : fix thread-safety (#14300) 
ggml-ci
 2025-06-21 08:04:18 +03:00