nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 4 Packages Projects Releases Wiki Activity

Commit Graph

  • 7bc5ef5285 open_blast nik Nikola Petrov 2026-07-07 09:32:04 +02:00
  • 1a7c25bfdb ggml : make ggml_time_init idempotent (#24422) An Long 2026-07-07 16:29:17 +09:00
  • defa95c306 speculative : fix out-of-bounds read in ngram-map on prompt shrink (#23936) o7si 2026-07-07 15:25:04 +08:00
  • a8cfdbb9e4 vulkan : check src0 type in GGML_OP_SET_ROWS to avoid failures due to unimplemented f16 support (#25351) fairydreaming 2026-07-07 06:56:02 +02:00
  • 6f8895feec opencl: general flash attention decode performance optimizations (#25366) Hongqiang Wang 2026-07-06 19:57:52 -07:00
  • ee445f93d8 common: Set optimal default thread count for ppc ( linux as well as AIX) (#25237) shalinib-ibm 2026-07-07 03:05:20 +05:30
  • f36e5c348b metal: add col2im_1d op (f32/f16/bf16) (#25176) Pascal 2026-07-06 20:47:36 +02:00
  • 74976e1aef CUDA: remove -sm row, refactor cuBLAS (#24216) Johannes Gäßler 2026-07-06 20:04:53 +02:00
  • 9abce7473a server: fix deadlock in load_models() when erasing a finished download (#25358) Pascal 2026-07-06 19:26:06 +02:00
  • cb295bf596 CUDA: extend K-type validation to V-types for flash attention (#24403) Alexey Kopytko 2026-07-06 23:26:50 +09:00
  • bfdf581b8b server: temporary skip model downloading API test (#25355) Xuan-Son Nguyen 2026-07-06 16:10:04 +02:00
  • 20a04b2206 ggml-cpu: use UE4M3 LUT in ARM NVFP4 dot product (#25331) ragz4125 2026-07-06 16:36:40 +05:30
  • 3b4fca11ac ggml-cpu: Enable tiled matmul on AIX (#25199) shalinib-ibm 2026-07-06 15:48:17 +05:30
  • 86961efd56 vulkan: fix 32-bit integer overflow in CEIL_DIV (#25245) hokanosekai 2026-07-06 10:35:57 +02:00
  • d80e878501 ui: restore Ctrl+B sidebar toggle shortcut (#25307) Pascal 2026-07-06 10:30:07 +02:00
  • 48719618e8 scripts : use HF_TOKEN when downloading UI assets (#25280) Adrien Gallouët 2026-07-06 09:53:35 +02:00
  • d06ddd3589 ggml-hip: enable -ffast-math for HIP builds (#23862) a-huk 2026-07-06 09:02:26 +02:00
  • 898b08854d ui: fake 200 for proxy DELETE req (#25298) Xuan-Son Nguyen 2026-07-06 08:41:39 +02:00
  • 72874f559c ggml-cuda: optimize conv_transpose_1d indexing (#25310) adavyas 2026-07-05 20:49:06 -07:00
  • 2da6686176 Fix stale tensor-split params for draft models (#24814) Al G 2026-07-05 19:39:36 +01:00
  • 3e5036fbfb abort if we see a multi buffer (#25276) Eve 2026-07-05 18:38:47 +00:00
  • 4b2a0cdee1 ggml : fix tensor-parallel + -ncmoe crash on MoE models (#25028) liminfei-amd 2026-07-06 01:56:11 +08:00
  • 7a63fdede1 ggml: Update VMM Pool allocation ggml-cuda.cu - Turing P2P access fix (fixes #24489) (#24491) Vexxie 2026-07-05 18:10:09 +01:00
  • 78d2f52468 cuda : concat implementation for quantized types (#25303) fairydreaming 2026-07-05 17:26:24 +02:00
  • a4107133a6 llama : add guard for K/V rotation input when buffer is unallocated (#25215) liminfei-amd 2026-07-05 04:37:38 +08:00
  • 665892536d ui: add sync blocks so display/behavior settings can be set via --ui-config-file (#25132) Pascal 2026-07-04 16:12:27 +02:00
  • ef2d770117 ggml : fix broken CPU concat implementation for quantized types (#25247) fairydreaming 2026-07-04 13:37:37 +02:00
  • 2d973636e2 chat: trim messages sent to StepFun parser (fixes long reasoning loops) (#25238) Piotr Wilkin (ilintar) 2026-07-03 23:12:11 +02:00
  • d4cff114c0 ui: Improve performance when streaming (#25225) Nick Towle 2026-07-03 10:03:51 -07:00
  • f113e02d5a ui: strip path and weight extension from model id in single model mode (#25137) Pascal 2026-07-03 17:32:48 +02:00
  • 152d337fad spec: support spec-draft-p-min in DFlash (#25246) Ruixiang Wang 2026-07-03 15:40:06 +02:00
  • 75a48a9055 cuda: enable topk-moe fusion for 288 experts (#25267) Piotr Wilkin (ilintar) 2026-07-03 15:36:55 +02:00
  • 067de93718 ui: align persisted config with strict server schema and enable thinking by default (#25242) Pascal 2026-07-03 13:14:52 +02:00
  • b5315e16e0 server + ui: ping silent SSE streams every 1s and kick only after 3s so slow prefill never drops healthy connections (#25241) Pascal 2026-07-03 12:47:04 +02:00
  • 94875285e4 ui: Add MCP Servers Opt-In for first time visitors (#25239) Aleksander Grygier 2026-07-03 12:16:29 +02:00
  • 5a460dea9f Remove redundant CUDA copies after gated_delta_net. (#23940) Gaurav Garg 2026-07-03 14:36:29 +05:30
  • c8ae9a750c vendor : update cpp-httplib to 0.49.0 (#25218) Alessandro de Oliveira Faria (A.K.A.CABELO) 2026-07-03 05:26:54 -03:00
  • fdb1db877c llama : add llama_model_ftype_name() (#25134) Adrien Gallouët 2026-07-02 17:26:47 +02:00
  • 4fc4ec5541 opencl: allow loading precompiled binary kernels from library (#23042) lhez 2026-07-01 10:29:22 -07:00
  • a6647b1a32 common : use hf primary split as model path (#25194) Adrien Gallouët 2026-07-01 18:33:00 +02:00
  • 13e673863b hexagon: flash attention rework (optimizations, accuracy improvements, etc) (#25085) Max Krasnyansky 2026-07-01 06:59:19 -07:00
  • b820cc8e6f CUDA: consistent use of __restrict__ + PDL for FA (#25185) Johannes Gäßler 2026-07-01 10:55:14 +02:00
  • 6dbc1174b8 ggml-cpu: add AVX2 optimization for nvfp4 dot product and use UE4M3 LUT (#23961) ragz4125 2026-07-01 13:01:20 +05:30
  • 9d88e7cedd ui Prevent tool messages from incorrectly appending to other conversations (#25177) Aleksander Grygier 2026-07-01 09:25:18 +02:00
  • 7af4279f45 ui: Remove PWA navigate fallback to prevent caching API endpoint requests (#25174) Aleksander Grygier 2026-07-01 07:32:55 +02:00
  • fd1a05791d opencl: initial q1_0 support (#25160) lhez 2026-06-30 21:43:20 -07:00
  • 0eca4d490e cuda : prevent integer truncation and overflow errors when using KQ mask strides in flash_attn_mask_to_KV_max kernel (#24945) fairydreaming 2026-06-30 20:47:05 +02:00
  • 4f31eedb0c model : register t_layer_inp for qwen3next (#25141) Jürgen Schmied 2026-06-30 17:57:14 +02:00
  • 799fcc04a5 common,server: handle bracketed IPv6 literals in URL authority (#25140) Pascal 2026-06-30 16:16:44 +02:00
  • 931eb37f8c CUDA: fix get_rows_back for tables with more than 65535 rows (grid-y clamp + stride) (#25103) Matt Jallo 2026-06-30 05:16:24 -07:00
  • e495d1e748 CUDA: fix Gemma E4B MTP FlashAttention (#25148) Johannes Gäßler 2026-06-30 14:06:54 +02:00
  • f708a5b2ca vulkan: roll bk loop in matmul for asahi linux (#24663) Kevin Liu 2026-06-30 06:27:38 -04:00
  • d9df11006f HIP: use hipBLAS for dense prefill on gfx900, keep MMQ for MoE (#24588) zduford 2026-06-30 05:51:38 -04:00
  • 6c5de1cc83 ggml-webgpu: add support for NVFP4 (#25143) Masashi Yoshimura 2026-06-30 17:20:04 +09:00
  • 86b94708f2 Revert "sched : reintroduce less synchronizations during split compute (#20793)" (#25138) Oliver Simons 2026-06-30 02:41:45 +02:00
  • 6f4f53f2b7 common : dedup preset and cached model entries in /v1/models (#25131) Adrien Gallouët 2026-06-29 17:37:23 +02:00
  • 25a1d63f43 vulkan: use flops instead of weight tensor size for submission heuristic (#25005) Ruben Ortlam 2026-06-29 15:24:44 +02:00
  • 8c146a8366 DeepSeek V4 (#24162) Aman Gupta 2026-06-29 16:58:51 +08:00
  • 6cb18b2f2e tools/ui: restore Tailwind scanning in ignored worktrees (#24879) seryogakovalyov 2026-06-29 11:55:52 +03:00
  • 277a105dc8 common : remove unused regex-partial (#25118) o7si 2026-06-29 14:48:39 +08:00
  • b3fed31b99 jinja, chat: add --reasoning-preserve flag (#25105) Xuan-Son Nguyen 2026-06-28 23:33:51 +02:00
  • dbdaece23d Revert "ui: fix accessibility for hover-gated interactive elements assisted by claude(in debugging and tests) (#24727)" (#25098) Aleksander Grygier 2026-06-28 21:30:03 +02:00
  • 7cb8576e7c ui: fix stop and reasoning skip in single-model mode (#25084) Pascal 2026-06-28 21:06:43 +02:00
  • fa72bc6826 dflash: refactor draft model conversion (#25110) Ruixiang Wang 2026-06-28 20:31:48 +02:00
  • c818263f2a chat : implement minicpm5 parser (#24889) Aldehir Rojas 2026-06-28 09:53:32 -05:00
  • f68a788b0b jinja: add --dump-prog for debugging (#25086) Xuan-Son Nguyen 2026-06-28 15:50:31 +02:00
  • d1b34251bc spec : add DFlash support (#22105) Ruixiang Wang 2026-06-28 15:01:34 +02:00
  • c1a1c8ee94 common : allow --offline in llama download (#25091) Adrien Gallouët 2026-06-28 12:34:11 +02:00
  • 27c8bb4f63 logs : reduce v2 (#25078) Georgi Gerganov 2026-06-28 08:52:15 +03:00
  • ebd048fc5e opencl: flash attention improvement (#25069) Hongqiang Wang 2026-06-27 15:36:06 -07:00
  • 0ed235ea2c [CUDA] Added a cudaMemcpy2DAsync fast path to ggml_cuda_cpy (#25057) Gaurav Garg 2026-06-27 17:46:21 +05:30
  • 9bebfcb4bc sycl : fix failed ut cases of norm (#25044) Neo Zhang 2026-06-27 17:13:43 +08:00
  • 0b6529d818 vulkan: fix step operator for 0 input (#25036) Ruben Ortlam 2026-06-27 10:57:31 +02:00
  • c299a92c38 binaries : Improve rpc-server and export-graph-ops names. (#25045) Christian Kastner 2026-06-27 09:31:29 +02:00
  • 0275c0f800 ci : add windows-openvino to check-release (#25022) Sigbjørn Skjæret 2026-06-27 09:30:56 +02:00
  • 83d385b429 tests : fix test-chat-template --no-common option (#25075) Sigbjørn Skjæret 2026-06-27 09:30:19 +02:00
  • 050ee92d04 app : allow --version, --licenses & --help (#25054) Adrien Gallouët 2026-06-26 23:18:11 +02:00
  • 3fc4e10527 sched : reintroduce less synchronizations during split compute (#20793) Andreas Kieslinger 2026-06-26 16:18:30 +02:00
  • 5d8ccdf9d1 devops : add llama in all docker images (#25035) Adrien Gallouët 2026-06-26 15:15:48 +02:00
  • 024930c6ad arg: fix handling --spec-draft-hf and --hf-repo-v (#25043) Xuan-Son Nguyen 2026-06-26 14:36:03 +02:00
  • 5397c36194 openvino: Update to OV 2026.2.1, self-contained release packages, operator improvements (#24974) Ravi Panchumarthy 2026-06-26 05:07:19 -07:00
  • e7ea94afcb sync : ggml Georgi Gerganov 2026-06-26 15:04:05 +03:00
  • 96183e9820 ggml : bump version to 0.15.3 (ggml/1550) Georgi Gerganov 2026-06-26 14:37:43 +03:00
  • 487a6cc164 vulkan: opt mul_mat_vecq for mi50 (#22933) nullname 2026-06-26 19:49:24 +08:00
  • 5a6a0dd7e1 vulkan: add INTEL_XE1 arch enum and enable coopmat1 on Intel Xe-LPG Plus (#24404) Jiang, Fish 2026-06-26 11:26:22 +00:00
  • ded1561b42 ui: fix accessibility for hover-gated interactive elements assisted by claude(in debugging and tests) (#24727) Sanjay Ahari 2026-06-26 16:25:38 +05:30
  • 9df06805ee vulkan: Workaround compiler bug in conv2d coopmat2 path (#24924) Jeff Bolz 2026-06-26 04:53:32 -05:00
  • 2f18fe13c5 CUDA: add cublasSgemmBatched mapping for HIP/MUSA vendor headers (#25033) leonardHONG 2026-06-26 17:42:56 +08:00
  • c16c35b814 ggml-cpu: fix SVE leftover path in ggml_vec_dot_f32 (#24699) Tarek Dakhran 2026-06-26 09:41:56 +02:00
  • 1a87dcdc45 server + ui: SSE Replay Buffer (#23226) Pascal 2026-06-26 09:31:29 +02:00
  • e7e3f35090 sycl : clamp softmax input to avoid underflow (#24941) Jassieluo 2026-06-26 15:02:42 +08:00
  • b11f7c16bc mtmd: add more validations (#25013) Xuan-Son Nguyen 2026-06-26 08:43:29 +02:00
  • f818065d75 CUDA: batch out_prod broadcast (dps2>1) path with cublasSgemmBatched (#24426) leonardHONG 2026-06-26 13:51:25 +08:00
  • 960d628f46 mamba2: remove hardcoded 2x expansion factor and invalid d_inner % d_state check (#23082) Arsen Arutunan 2026-06-26 08:50:54 +03:00
  • 5c7c22c3e1 opencl: flush profiling batch at shutdown for incomplete batches (#25016) shaofeiqi 2026-06-25 18:48:24 -07:00
  • beac5309f1 xcframework : disable mtmd video on i/tv/visionos (#25018) Sigbjørn Skjæret 2026-06-26 00:13:59 +02:00
  • 9d5d882d8c model : Add label for LFM2.5-230M (#25008) Tarek Dakhran 2026-06-25 18:58:52 +02:00
  • 1ec44d178d CUDA: Various fixes to cpy.cu (#25000) Oliver Simons 2026-06-25 17:29:23 +02:00
  • c7cddefcbd misc: fix labeler (#25012) Xuan-Son Nguyen 2026-06-25 17:23:37 +02:00
  • e9d1b76d0a server: use status code 403 for disabled features (#24970) Xuan-Son Nguyen 2026-06-25 16:36:40 +02:00