nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 30 Packages Projects Releases Wiki Activity
8,661 Commits 1 Branch 0 Tags
b7ad48ebda2287c778fd826606d7b3b3570f60ab
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Sigbjørn SkjæretandGitHub 1f34806c44 jinja: coerce input for string-specific filters (#21370) 2026-04-03 15:03:33 +02:00
Sigbjørn SkjæretandGitHub e2eb39e81c ci : bump ty to 0.0.26 (#21156) 
* fix incorrect type ignore comments

* bump ty to 0.0.26
 2026-03-30 09:29:15 +02:00
Sigbjørn SkjæretandGitHub 7c203670f8 add missing ROPE_FACTORS_LONG/SHORT for MiniCPM (#21150) 2026-03-29 19:45:40 +02:00
Sigbjørn SkjæretandGitHub 65097181e4 fix **/x glob matching (#21129) 2026-03-28 22:27:38 +01:00
Sigbjørn SkjæretandGitHub 3a14a542f5 common : add character class support to glob_match (#21111) 
* add character class support to glob_match

* remove pointless reference
 2026-03-28 19:57:37 +01:00
Sigbjørn SkjæretandGitHub c46758d28f cli : add /glob command (#21084) 
* add /glob command

* output error when max files reached

* support globbing outside curdir
 2026-03-28 02:33:04 +01:00
Sigbjørn SkjæretandGitHub 403c9c9cef ci : bump gguf publish python version (#20982) 2026-03-25 11:04:59 +02:00
Sigbjørn SkjæretandGitHub 8fc85db9d2 ci : limit requirements versions (#20980) 
* set requests version

* limit versions outside requirements
 2026-03-25 10:55:37 +02:00
Sigbjørn SkjæretandGitHub 23c9182ce8 jinja : refactor token advancement (#20864) 
* refactor token advancement

* exercise sub-expressions
 2026-03-22 17:45:10 +01:00
Sigbjørn SkjæretandGitHub 29b28a9824 ci : switch from pyright to ty (#20826) 
* type fixes

* switch to ty

* tweak rules

* tweak more rules

* more tweaks

* final tweak

* use common import-not-found rule
 2026-03-21 08:54:34 +01:00
Sigbjørn SkjæretandGitHub 811397745e vocab : assert array size of scores and toktypes (#20737) 2026-03-19 08:34:04 +01:00
Sigbjørn SkjæretandGitHub d13d60af1d gguf-py : cleaner way to get the first key (#20727) 2026-03-18 23:21:42 +01:00
Sigbjørn SkjæretandGitHub ab0bb93748 ci : bump ccache [no ci] (#20679) 
* bump ccache

* forgotten

* disable for s390x

* disable also for ppc64le
 2026-03-17 14:54:31 +01:00
Sigbjørn SkjæretandGitHub 55e87026f7 tests : write to binary buffer to avoid newline translation in jinja -py [no ci] (#20365) 2026-03-16 20:40:22 +01:00
Sigbjørn SkjæretandGitHub 0ed992973b ci : update labeler (#20629) 2026-03-16 20:24:20 +01:00
Sigbjørn SkjæretandGitHub de8f01c2d7 model : wire up Nemotron-H tensors for NVFP4 support (#20561) 
* wire up Nemotron-H tensors for NVFP4 support

* add ssm tensors

* alignment
 2026-03-16 09:19:16 +01:00
Sigbjørn SkjæretandGitHub ebbf544ed1 sycl : fix for untransposed GDA recurrent state (#20583) 2026-03-15 19:10:15 +01:00
Sigbjørn SkjæretandGitHub b91d7dfe5b ci : only save openvino caches on github-hosted master (#20593) 
* only save openvino ccache on master

* disable toolkit cache if self-hosted

* only cache on github-hosted runners

* remove toolkit cache [no ci]
 2026-03-15 18:58:13 +01:00
Sigbjørn SkjæretandGitHub cf45437d35 codeowners : use teams (#20526) 
* use teams

* update

* update

* update

* update

* update
 2026-03-15 14:26:10 +01:00
Sigbjørn SkjæretandGitHub 89d0aec042 convert : support contiguous method on lora tensors (#20489) 2026-03-15 12:15:12 +01:00
Sigbjørn SkjæretandGitHub c3e3f9e533 convert : better mtp check and fix return [no ci] (#20419) 2026-03-12 10:04:20 +01:00
Sigbjørn SkjæretandGitHub f90bd1dd84 llama : whitespace cleanup (#20422) 2026-03-11 21:18:29 +01:00
Sigbjørn SkjæretandGitHub ec947d2b16 common : fix incorrect uses of stoul (#20313) 2026-03-10 11:40:26 +01:00
Sigbjørn SkjæretandGitHub 35bee031e1 graph : remove redundant scale_w parameter (#20235) 2026-03-08 18:58:28 +01:00
Sigbjørn SkjæretandGitHub b5ed0e058c cli : add command and file auto-completion (#19985) 2026-03-05 10:47:28 +01:00
Sigbjørn SkjæretandGitHub cf232515c9 convert : register Qwen 3.5 ForCausalLM for text only (#20119) 2026-03-05 10:30:02 +01:00
Sigbjørn SkjæretandGitHub d969e933e1 tools : add missing clocale include in mtmd-cli [no ci] (#20107) 2026-03-04 14:18:04 +01:00
Sigbjørn SkjæretandGitHub e8e261699a cli : provide model with text filename (#19783) 2026-02-22 22:33:49 +01:00
Sigbjørn SkjæretandGitHub 9f0684f003 ci : fix rocm archive name [no ci] (#19808) 2026-02-22 16:14:37 +01:00
Sigbjørn SkjæretandGitHub e877ad8bd9 ci : fix rocm release path [no ci] (#19784) 2026-02-22 08:07:46 +01:00
Sigbjørn SkjæretandGitHub e48349a49d ci : bump komac version (#19682) 2026-02-17 09:30:31 +01:00
Sigbjørn SkjæretandGitHub 079feab9e3 convert : ensure all models handle new experts count (#19621) 
* ensure all models handle new experts count

* revert removal for PhiMoeModel, does not inherit from base
 2026-02-14 22:22:32 +01:00
Sigbjørn SkjæretandGitHub 0d00ef65ed convert : store ffn_gate_inp_shexp as F32 (#19606) 2026-02-14 08:17:43 +01:00
Sigbjørn SkjæretandGitHub b2ecc0cdb4 support --verbose-prompt (#19576) 2026-02-13 12:49:10 +01:00
Sigbjørn SkjæretandGitHub 9a5f57795c ci : remove server job from webui and move slow test (#19424) 
* remove server job from webui and move slow test

* use pip-install option
 2026-02-08 01:20:00 +01:00
Sigbjørn SkjæretandGitHub b828e18c75 docker : fix vulkan build (#19352) 2026-02-05 11:10:39 +01:00
Sigbjørn SkjæretandGitHub 11fb327bf3 vendor : add missing llama_add_compile_flags (#19322) 
* add missing llama_add_compile_flags

* disable all warnings for ssl, crypto and fipsmodule
 2026-02-05 02:27:38 +01:00
Sigbjørn SkjæretandGitHub a6fd8ca1fe models : remove unnecessary cont in openelm (#19289) 2026-02-03 14:20:57 +01:00
Sigbjørn SkjæretandGitHub b45ef2702c jinja : do not pass empty tools and add some none filters (#19176) 2026-01-29 14:06:54 +01:00
Sigbjørn SkjæretandGitHub 50e8962f79 ci : find latest release with asset for winget (#19161) 2026-01-28 22:05:39 +01:00
Sigbjørn SkjæretandGitHub 60368e1d73 jinja : undefined should be treated as sequence/iterable (return string/array) by filters/tests (#19147) 
* undefined is treated as iterable (string/array) by filters

`tojson` is not a supported `undefined` filter

* add tests

* add sequence and iterable tests

keep it DRY and fix some types
 2026-01-28 14:40:29 +01:00
Sigbjørn SkjæretGitHubXuan Son Nguyen
 		2b4cbd2834 jinja : implement mixed type object keys (#18955) 
* implement mixed type object keys

* add tests

* refactor

* minor fixes

* massive refactor

* add more tests

* forgotten tuples

* fix array/object is_hashable

* correct (albeit broken) jinja responses

verified with transformers

* improved hashing and equality

* refactor hash function

* more exhausive test case

* clean up

* cont

* cont (2)

* missing cstring

---------

Co-authored-by: Xuan Son Nguyen <son@huggingface.co>
 2026-01-27 19:50:42 +01:00
Sigbjørn SkjæretandGitHub c0204a0893 ci : revert slim runner for winget (#19129) 2026-01-27 11:54:25 +01:00
Sigbjørn SkjæretandGitHub 142cbe2ac6 ci : use new 1vCPU runner for lightweight jobs (#19107) 
* use new 1vCPU runner for lightweight jobs

* pyright is too heavy, look into ty some day

use new pip-install input
 2026-01-26 15:22:49 +01:00
Sigbjørn SkjæretandGitHub 0bf5636938 convert : yield Gemma3N custom_map tensors directly (#19091) 2026-01-25 18:03:34 +01:00
Sigbjørn SkjæretandGitHub 70d860824a convert : fix Gemma3N, GraniteMoe and Ernie4.5Moe (#19084) 
* fix Gemma3N and Ernie4.5Moe

* fix GraniteMoe
 2026-01-25 13:05:05 +01:00
Sigbjørn SkjæretandGitHub 959ecf7f23 jinja : fix undefined keys and attributes and int/float as bool (#18924) 
* fix undefined keys and attributes

* add falsy tests

* as_bool for integers and floats

* more falsy/truthy tests

* --typo
 2026-01-19 20:29:43 +01:00
Sigbjørn SkjæretandGitHub 4037093c66 ci : run test-jinja -py on high perf [no ci] (#18916) 2026-01-19 20:29:15 +01:00
Sigbjørn SkjæretandGitHub bbcdac0189 jinja : fix object item order (and properly implement dictsort) (#18904) 
* fix object item order

* as_ordered_object

* copy whole object
 2026-01-18 03:40:06 +01:00
Sigbjørn SkjæretandGitHub d03c45c9c5 jinja : attribute support for join, map and sort (#18883) 
* support negative array index and default value

* attribute support (int and str) for join, map and sort

* add tests

* update CODEOWNERS

* improve fixme sorting comment
 2026-01-18 02:53:01 +01:00
Sigbjørn SkjæretandGitHub 10c98cbdf6 jinja : add missing tojson filter for bool (#18900) 
* add missing tojson for bool

* add more literal tests
 2026-01-18 01:05:09 +01:00
Sigbjørn SkjæretandGitHub 420960ab92 jinja : fix lexing of float literals with sign (#18901) 
* fix lexing of float literals with sign

* add test

* consume_numeric
 2026-01-18 00:57:51 +01:00
Sigbjørn SkjæretandGitHub 57c0beaed0 ci : add label for jinja changes (#18903) 2026-01-17 21:52:02 +01:00
Sigbjørn SkjæretandGitHub 2a13180100 model-loader : support bool array sliding window pattern (#18850) 2026-01-15 10:12:46 +01:00
Sigbjørn SkjæretandGitHub 7fdc8c893d scripts : follow api redirects in pr2wt.sh (#18739) 2026-01-10 16:04:05 +01:00
Sigbjørn SkjæretandGitHub 5b8844ae53 scripts : fix repos cloned with .git extension (#18669) 2026-01-07 22:35:34 +01:00
Sigbjørn SkjæretandGitHub 7e16fef085 convert : more variants of rope_theta config entries (#18668) 2026-01-07 22:34:51 +01:00
Sigbjørn SkjæretandGitHub 9dfa8ee950 ci : run cann build unconditionally [no ci] (#18659) 2026-01-07 13:07:08 +01:00
Sigbjørn SkjæretandGitHub eadc4184ca llama : refactor rope_freq_base/scale_swa conversion and init (#18553) 
* refactor rope_freq_base/scale_swa conversion and init

* safe defaults for unknowns

* update relevant models

* grammar

* add get_rope_freq_scale to modern-bert

* const

* const

* log swa info
 2026-01-05 09:14:04 +01:00
Sigbjørn SkjæretandGitHub 169ee68ffb model : remove modern-bert iswa template (#18529) 
* remove modern-bert iswa template

* forgotten
 2026-01-02 00:06:42 +01:00
Sigbjørn SkjæretandGitHub 0db8109849 convert : lint fix (#18507) 2025-12-31 14:28:21 +01:00
Sigbjørn SkjæretandGitHub 4849661d98 docker : add CUDA 13.1 image build (#18441) 
* add updated cuda-new.Dockerfile for Ubuntu 24.04 compatibilty

* add cuda13 build
 2025-12-30 22:28:53 +01:00
Sigbjørn SkjæretandGitHub 74e05131e9 ci : remove non-windows zip artifacts (#18201) 
* remove non-windows zip artifacts

* add cuda dll links
 2025-12-19 22:29:46 +01:00
Sigbjørn SkjæretandGitHub f74747d886 ci : only save ccache on master (#18207) 2025-12-19 22:29:37 +01:00
Sigbjørn SkjæretandGitHub ec7b9329ae gguf-py : use copy-on-write mode for localtensor (#18162) 2025-12-18 13:45:38 +01:00
Sigbjørn SkjæretandGitHub 9cff4cc554 convert : sort and use file parts from model index if present (#18043) 
* keep file part order from model index

* treat index as authoritative

* sort index parts
 2025-12-18 07:54:54 +01:00
Sigbjørn SkjæretandGitHub 5166aaf868 convert : force patch_merger tensors to f16/f32 (#18124) 2025-12-17 22:15:53 +01:00
Sigbjørn SkjæretandGitHub 6853bee680 ci : clean up webui jobs (#18116) 
* clean up webui jobs

* refined step control

* forgot dependencies

* apparently always() is needed
 2025-12-17 10:45:40 +01:00
Sigbjørn SkjæretandGitHub d6742125c3 ci : separate webui from server (#18072) 
* separate webui from server

* add public to path
 2025-12-16 08:17:26 +01:00
Sigbjørn SkjæretandGitHub d6a1e18c65 convert : move rope_parameters to TextModel class (#18061) 
* make sure to search text_config for rope parameters

* move rope_parameters to TextModel class
 2025-12-15 22:03:16 +01:00
Sigbjørn SkjæretandGitHub 5c8a717128 convert : refactor rope scaling handling (#18013) 
* refactor rope scaling handling

* ws--

* missed a couple

* use find_hparam
 2025-12-14 16:04:37 +01:00
Sigbjørn SkjæretandGitHub 8e4d678528 common : skip model validation when --completion-bash is requested (#17975) 2025-12-13 08:40:50 +01:00
Sigbjørn SkjæretandGitHub 2bc94e7928 add llama-completion to completion-bash executables (#17976) 2025-12-13 08:35:50 +01:00
Sigbjørn SkjæretandGitHub b7f5f46e03 docker : include legacy llama-completion binary (#17964) 2025-12-12 19:39:23 +01:00
Sigbjørn SkjæretandGitHub dcb7d17758 cann : fix ops broken by circular padding guard (#17825) 2025-12-12 15:49:27 +01:00
Sigbjørn SkjæretandGitHub 45e350e3d3 ci: fix riscv64-native build (#17916) 2025-12-10 23:24:31 +01:00
Sigbjørn SkjæretandGitHub 4df6e859e9 cuda : add missing support check for xielu (#17895) 2025-12-10 16:16:20 +01:00
Sigbjørn SkjæretandGitHub 63391852b0 docs : update cpu and cuda ops (#17890) 
* update cuda ops

* update CPU as well
 2025-12-09 23:31:29 +01:00
Sigbjørn SkjæretandGitHub 86a3f0fad8 ggml : allow fill node alloc inplace (#17870) 2025-12-09 12:23:47 +01:00
Sigbjørn SkjæretandGitHub 42b12b5608 model : nit, DeepSeek V1 MoE is 16B and GigaChat is 20B (#12652) 
* nit, DeepSeek V1 MoE is 16B

* base type on n_ff_exp instead
 2025-12-09 12:15:06 +01:00
Sigbjørn SkjæretandGitHub c8554b66e0 graph : use fill instead of scale_bias in grouped expert selection (#17867) 
* use fill instead of scale_bias in grouped expert selection

* do not explicitly use _inplace
 2025-12-08 21:29:59 +01:00
Sigbjørn SkjæretandGitHub 0a540f9abd ci : add windows-cuda 13.1 release (#17839) 2025-12-07 14:02:04 +01:00
Sigbjørn SkjæretandGitHub 22577583a3 common : change --color to accept on/off/auto, default to auto (#17827) 2025-12-07 03:43:50 +01:00
Sigbjørn SkjæretandGitHub 03d9a77b85 ci : transform release binary root dir in tar to llama-bXXXX (#17773) 
* transform release binary root dir in tar to llama-bXXXX

* bsdtar supports -s instead of --transform
 2025-12-05 01:50:19 +01:00
Sigbjørn SkjæretandGitHub 7dba049b07 ci : disable ggml-ci-x64-amd-* (#17753) 2025-12-04 11:25:08 +01:00
Sigbjørn SkjæretandGitHub b3e3060f4e ci : move release details to the top visible by default (#17719) 2025-12-03 09:22:46 +01:00
Sigbjørn SkjæretandGitHub b61de2b2df convert : allow quantizing lora again (#17453) 2025-11-24 15:50:55 +01:00
Sigbjørn SkjæretandGitHub 96ac5a2329 cuda : support non-contiguous i32 to i32 copy (#17326) 
* support non-contiguous i32 to i32 copy

* add tests

* rename cpy_flt to cpy_scalar and reindent params
 2025-11-23 11:13:34 +01:00
Sigbjørn SkjæretandGitHub 07b0e7a5ac convert : use self.block_count everywhere instead of reading hparams (#17359) 2025-11-19 11:52:38 +01:00
Sigbjørn SkjæretandGitHub 662192e1dc convert : remove unnecessary chat template patching (#17289) 2025-11-15 20:58:59 +01:00
Sigbjørn SkjæretandGitHub 9a8860cf5d convert : use all parts in safetensors index (#17286) 2025-11-15 14:12:39 +01:00
Sigbjørn SkjæretandGitHub 9d3ef4809f convert : set expert gating func in base class (#17279) 2025-11-15 14:06:24 +01:00
Sigbjørn SkjæretandGitHub 7bef684118 models : move build_inp_out_ids outside loop (#17151) 
* move build_inp_out_ids outside loop

* realign
 2025-11-10 22:55:30 +01:00
Sigbjørn SkjæretandGitHub 9008027aa3 hparams : add n_embd_inp() to support extended embed (#16928) 
* add n_embd_full to support extended embed

* don't change output

* rename to n_embd_inp

* restore n_embd where applicable
 2025-11-07 19:27:58 +01:00
Sigbjørn SkjæretandGitHub d945834366 ci : apply model label to models (#16994) 2025-11-04 12:29:39 +01:00
Sigbjørn SkjæretandGitHub b164259bba chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
Sigbjørn SkjæretandGitHub dd52868050 ci : disable failing riscv cross build (#16952) 2025-11-02 23:11:21 +01:00
Sigbjørn SkjæretandGitHub 961660b8c3 common : allow --system-prompt-file for diffusion-cli (#16903) 2025-11-01 11:01:42 +01:00
Sigbjørn SkjæretandGitHub 74fef4129f codeowners : update after refactor (#16905) 2025-11-01 09:55:25 +02:00
Sigbjørn SkjæretandGitHub 6eb208d17e ci : enable free-disk-space on cuda docker build (#16877) 2025-10-31 00:34:27 +01:00