nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 18 Packages Projects Releases Wiki Activity
2,396 Commits 1 Branch 0 Tags
ee35600b9061b1ea0c4ea87fce6844297632b2a8
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Georgi Gerganov ee35600b90 llama : fix F16/F32 downcast + improve names (#5980) 2024-03-11 09:56:47 +02:00
Georgi GerganovandGitHub bb6d00bbf9 metal : move mm_id indices to shared mem (#5982) 2024-03-10 23:12:48 +02:00
Georgi GerganovandGitHub d9f65c97c3 readme : update hot topics 2024-03-10 20:58:26 +02:00
Georgi Gerganov b838b53ad6 sync : ggml 2024-03-10 20:10:46 +02:00
Georgi Gerganov df4dc3e7cb ggml : try fix 32-bit arm compat (whisper/1938) 
* ggml : try fix 32-bit arm compat

* ggml : fix cont
 2024-03-10 20:10:39 +02:00
Georgi Gerganov bf47a5eefc ggml : remove __constant__ specifier for CUDA tables (#5940) 2024-03-10 20:09:24 +02:00
Georgi GerganovGitHubgithub-actions[bot] <github-actions[bot]@users.noreply.github.com>
 		c78541479c nix: update flake.lock (#5969) 
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:NixOS/nixpkgs/1536926ef5621b09bba54035ae2bb6d806d72ac8' (2024-02-29)
  → 'github:NixOS/nixpkgs/9df3e30ce24fd28c7b3e2de0d986769db5d6225d' (2024-03-06)

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2024-03-10 16:43:08 +02:00
Georgi Gerganov 77d1ac7e00 server : print chat template info 2024-03-09 22:04:00 +02:00
Georgi GerganovandGitHub 098dbaab44 readme : update hot topics 2024-03-09 18:14:13 +02:00
Georgi GerganovandGitHub 8380ecfb21 ggml : fix unnecessary f32 -> f16 -> f32 casts (mmla) (#5951) 2024-03-09 17:36:20 +02:00
Georgi GerganovandGitHub 58308a0ecc server : fix metrics init (#5964) 2024-03-09 17:34:15 +02:00
Georgi GerganovandGitHub 5b09797321 ggml : remove old quantization functions (#5942) 
* ggml : remove old quantization functions

ggml-ci

* ggml : simplify ggml_quantize_chunk

ggml-ci

* ggml : restrict correctness

ggml-ci

* ggml : remove hist data from the quantization API

ggml-ci

* tests : remove hist usage in test-backend-ops

ggml-ci

* vulkan : remove hist and fix typo
 2024-03-09 15:53:59 +02:00
Georgi GerganovandGitHub 97c09585d6 server : clarify some items in the readme (#5957) 
* server : clarify some items in the readme

* server : fix typo
 2024-03-09 15:47:47 +02:00
Georgi Gerganov 2c4f566c88 tests : gitignore ggml-common.h 2024-03-09 14:17:11 +02:00
Georgi GerganovandGitHub 8a3012a4ad ggml : add ggml-common.h to deduplicate shared code (#5940) 
* ggml : add ggml-common.h to shared code

ggml-ci

* scripts : update sync scripts

* sycl : reuse quantum tables

ggml-ci

* ggml : minor

* ggml : minor

* sycl : try to fix build
 2024-03-09 12:47:57 +02:00
Georgi GerganovandGitHub 9674aaf35c server : simplify logic for empty prompts (#5953) 2024-03-09 12:34:18 +02:00
Georgi GerganovandGitHub af37fd8b30 server : fix EOS token detection with disabled cache (#5938) 2024-03-08 12:40:02 +02:00
Georgi GerganovGitHubslaren
 		6cdabe6526 llama-bench : add embeddings option (#5924) 
* llama-bench : add embeddings option

* llama-bench : do not hard code embd default value

---------

Co-authored-by: slaren <slarengh@gmail.com>
 2024-03-07 16:32:38 +02:00
Georgi GerganovGitHubPierrick Hymbert
 		2002bc96bf server : refactor (#5882) 
* server : refactoring (wip)

* server : remove llava/clip objects from build

* server : fix empty prompt handling + all slots idle logic

* server : normalize id vars

* server : code style

* server : simplify model chat template validation

* server : code style

* server : minor

* llama : llama_chat_apply_template support null buf

* server : do not process embedding requests when disabled

* server : reorganize structs and enums + naming fixes

* server : merge oai.hpp in utils.hpp

* server : refactor system prompt update at start

* server : disable cached prompts with self-extend

* server : do not process more than n_batch tokens per iter

* server: tests: embeddings use a real embeddings model (#5908)

* server, tests : bump batch to fit 1 embedding prompt

* server: tests: embeddings fix build type Debug is randomly failing (#5911)

* server: tests: embeddings, use different KV Cache size

* server: tests: embeddings, fixed prompt do not exceed n_batch, increase embedding timeout, reduce number of concurrent embeddings

* server: tests: embeddings, no need to wait for server idle as it can timout

* server: refactor: clean up http code (#5912)

* server : avoid n_available var

ggml-ci

* server: refactor: better http codes

* server : simplify json parsing + add comment about t_last

* server : rename server structs

* server : allow to override FQDN in tests

ggml-ci

* server : add comments

---------

Co-authored-by: Pierrick Hymbert <pierrick.hymbert@gmail.com>
 2024-03-07 11:41:53 +02:00
Georgi Gerganov 1e35d619a6 convert : remove AWQ remnants (#5768) 2024-03-06 09:13:42 +02:00
Georgi Gerganov 82cb31eb93 Revert "grammars : don't allow to output unescaped new line in string (#5885)" 
This reverts commit b1a4e994fd.
 2024-03-05 15:56:24 +02:00
Georgi GerganovandGitHub 29ae62d2ae llama : fix embeddings (#5796) 
* llama : fix embeddings

ggml-ci

* llama : do not use KV cache for non-causal models

ggml-ci

* embeddings : fix llama_batch_init arg

* llama : add pooling switch

* llama : distinguish token vs sequence embeddings

ggml-ci

* llama : assert pooling tensor

* llama : simplify causal mask condition

ggml-ci

* llama : assert input batch with pooling enabled

* readme : update API changes list
 2024-03-04 22:31:20 +02:00
Georgi Gerganov e0843afe1b flake : fix 2024-03-04 21:50:50 +02:00
Georgi Gerganov a1c6d96ed8 ggml : fix unknown status (#0) 2024-03-04 20:54:23 +02:00
Georgi Gerganov efd8533ef8 sync : ggml 
ggml-ci
 2024-03-04 20:54:23 +02:00
Georgi Gerganov a0fc62661f sync : ggml 2024-03-04 10:40:04 +02:00
Georgi GerganovandGitHub 231ae28f07 readme : add API changes section 2024-03-03 12:44:03 +02:00
Georgi GerganovGitHubgithub-actions[bot] <github-actions[bot]@users.noreply.github.com>
 		fa974646e1 flake.lock: Update (#5842) 
Flake lock file updates:

• Updated input 'flake-parts':
    'github:hercules-ci/flake-parts/b253292d9c0a5ead9bc98c4e9a26c6312e27d69f' (2024-02-01)
  → 'github:hercules-ci/flake-parts/f7b3c975cf067e56e7cda6cb098ebe3fb4d74ca2' (2024-03-01)
• Updated input 'flake-parts/nixpkgs-lib':
    'github:NixOS/nixpkgs/97b17f32362e475016f942bbdfda4a4a72a8a652?dir=lib' (2024-01-29)
  → 'github:NixOS/nixpkgs/1536926ef5621b09bba54035ae2bb6d806d72ac8?dir=lib' (2024-02-29)
• Updated input 'nixpkgs':
    'github:NixOS/nixpkgs/cbc4211f0afffe6dfd2478a62615dd5175a13f9a' (2024-02-23)
  → 'github:NixOS/nixpkgs/1536926ef5621b09bba54035ae2bb6d806d72ac8' (2024-02-29)

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2024-03-02 20:11:31 -08:00
Georgi GerganovandGitHub 494c870326 ggml : fix IQ3_S AVX implementation (#5834) 
ggml-ci
 2024-03-02 20:00:49 +02:00
Georgi Gerganov ef2cd694c4 scripts : add pod-llama.sh 2024-03-02 16:54:20 +02:00
Georgi GerganovandGitHub 38d16b1426 server : remove api_like_OAI.py proxy script (#5808) 2024-03-01 20:00:58 +02:00
Georgi Gerganov f105471ef6 server : fix newlines in help (#5785) 2024-03-01 09:59:43 +02:00
Georgi GerganovandGitHub 87c91c0766 ci : reduce 3b ppl chunks to 1 to avoid timeout (#5771) 
ggml-ci
 2024-02-28 21:44:21 +02:00
Georgi GerganovandGitHub 08c5ee87e4 llama : remove deprecated API (#5770) 
ggml-ci
 2024-02-28 18:43:38 +02:00
Georgi GerganovandGitHub 78aacf3634 awq-py : remove (#5768) 2024-02-28 17:36:53 +02:00
Georgi Gerganov 8c0e8f4e73 sync : ggml 2024-02-28 11:17:32 +02:00
Georgi GerganovandGitHub 9d533a77d0 llama : fix defrag bugs + add parameter (#5735) 
* llama : fix defrag bugs + enable by default

ggml-ci

* llama : add defrag_thold parameter

ggml-ci

* llama : cont

* llama : disable log message

ggml-ci

* llama : fix graph size check during defrag
 2024-02-27 14:35:51 +02:00
Georgi GerganovandGitHub 67fd33132f unicode : reuse iterator (#5726) 2024-02-26 14:02:12 +02:00
Georgi Gerganov 269de86ba0 llama : fix Gemma rope type (#5691) 2024-02-26 08:30:17 +02:00
Georgi GerganovandGitHub bf08e00643 llama : refactor k-shift implementation + KV defragmentation (#5691) 
* llama : refactor k-shift implementation

ggml-ci

* llama : rename llama_kv_cache_seq_shift to llama_kv_cache_seq_add

* llama : cont k-shift refactoring + normalize type names

ggml-ci

* minor : fix MPI builds

* llama : reuse n_rot from the build context

ggml-ci

* llama : revert enum name changes from this PR

ggml-ci

* llama : update llama_rope_type

* llama : add comment about rope values

* llama : fix build

* passkey : apply kv cache updates explicitly

ggml-ci

* llama : change name to llama_kv_cache_update()

* llama : add llama_kv_cache_seq_pos_max()

* passkey : fix llama_kv_cache_seq_pos_max() usage

* llama : some llama_kv_cell simplifications

* llama : add llama_kv_cache_compress (EXPERIMENTAL)

* llama : add alternative KV cache merging (EXPERIMENTAL)

* llama : add llama_kv_cache_defrag

* llama : comments

* llama : remove llama_kv_cache_compress

will add in a separate PR

ggml-ci

* llama : defragment via non-overlapping moves

* llama : ggml_graph based defrag implementation

ggml-ci

* llama : switch the loop order in build_defrag

* llama : add comments
 2024-02-25 22:12:24 +02:00
Georgi GerganovandGitHub ab336a9d5e code : normalize enum names (#5697) 
* coda : normalize enum names

ggml-ci

* code : cont

* code : cont
 2024-02-25 12:09:09 +02:00
Georgi GerganovandGitHub 96633eeca1 gemma : use more bits for the token_embd.weight tensor (#5650) 
* gemma : use Q8_0 for the token_embd.weight tensor

* llama : quantize token_embd.weight using output type
 2024-02-22 23:23:46 +02:00
Georgi GerganovGitHubAarni KoskelaJared Van Bortel
 		847eedbdb2 py : add Gemma conversion from HF models (#5647) 
* py : add gemma conversion from HF models

* Update convert-hf-to-gguf.py

Co-authored-by: Aarni Koskela <akx@iki.fi>

* Update convert-hf-to-gguf.py

Co-authored-by: Aarni Koskela <akx@iki.fi>

* Update convert-hf-to-gguf.py

Co-authored-by: Jared Van Bortel <jared@nomic.ai>

---------

Co-authored-by: Aarni Koskela <akx@iki.fi>
Co-authored-by: Jared Van Bortel <jared@nomic.ai>
 2024-02-22 23:22:48 +02:00
Georgi GerganovandGitHub 7e4f339c40 ggml : always define ggml_fp16_t as uint16_t (#5666) 
* ggml : always define ggml_fp16_t as uint16_t

ggml-ci

* ggml : cont

ggml-ci

* ggml : cont

* ggml : cont

ggml-ci

* ggml : cont

ggml-ci

* cuda : no longer ggml headers last

ggml-ci

* ggml : fix q6_K FP16 -> FP32 conversion

ggml-ci

* ggml : more FP16 -> FP32 conversion fixes

ggml-ci
 2024-02-22 23:21:39 +02:00
Georgi Gerganov 334f76fa38 sync : ggml 2024-02-22 23:21:05 +02:00
Georgi Gerganov efd56b1c21 ggml : 32-bit arm compat (whisper/1891) 
* ggml : 32-bit arm compat

* ggml : add ggml_vqtbl1q_s8 impl

* ggml : cont
 2024-02-22 23:20:50 +02:00
Georgi GerganovandGitHub 5a9e2f60ba py : minor fixes (#5668) 2024-02-22 20:13:25 +02:00
Georgi Gerganov 3a03541ced minor : fix trailing whitespace (#5638) 2024-02-22 13:54:03 +02:00
Georgi GerganovandGitHub 56d03d92be readme : update hot topics 2024-02-22 10:35:54 +02:00
Georgi Gerganov 5022cf242d sync : ggml 2024-02-21 16:52:52 +02:00
Georgi GerganovGitHubbssrdfbssrdf
 		eccd7a26dd sync : ggml (#5633) 
* ggml : fix conv_2d batch mode (ggml/737)

Co-authored-by: bssrdf <bssrdf@gmail.com>

* ggml : compute forward no longer pass src tensors (ggml/729)

* sync : ggml

ggml-ci

---------

Co-authored-by: bssrdf <merlintiger@hotmail.com>
Co-authored-by: bssrdf <bssrdf@gmail.com>
 2024-02-21 16:17:10 +02:00
Georgi GerganovandGitHub c14f72db9c readme : update hot topics 2024-02-21 15:39:54 +02:00
Georgi Gerganov 1387cf60f7 llava : remove extra cont (#5587) 2024-02-19 15:23:17 +02:00
Georgi Gerganov 337c9cbd52 sync : ggml 
ggml-ci
 2024-02-19 15:09:43 +02:00
Georgi Gerganov a3145bdc30 ggml-alloc : apply ggml/731 2024-02-19 15:09:43 +02:00
Georgi GerganovandGitHub d0e3ce51f4 ci : enable -Werror for CUDA builds (#5579) 
* cmake : pass -Werror through -Xcompiler

ggml-ci

* make, cmake : enable CUDA errors on warnings

ggml-ci
 2024-02-19 14:45:41 +02:00
Georgi Gerganov 68a6b98b3c make : fix CUDA build (#5580) 2024-02-19 13:41:51 +02:00
Georgi Gerganov f53119cec4 minor : fix trailing whitespace (#5538) 2024-02-19 10:34:10 +02:00
Georgi Gerganov 14278f55d2 ggml : restore vec dot stride arg names (#5453) 2024-02-18 22:58:57 +02:00
Georgi GerganovandGitHub b1de96824b ci : fix wikitext url + compile warnings (#5569) 
ggml-ci
 2024-02-18 22:39:30 +02:00
Georgi Gerganov 7ad554f90e metal : fix unused warnings (#0) 2024-02-18 21:39:58 +02:00
Georgi Gerganov 689a091bbe sampling : do not set min_keep to n_probs (#5564) 2024-02-18 19:38:06 +02:00
Georgi Gerganov f3f28c5395 cmake : fix GGML_USE_SYCL typo (#5555) 2024-02-18 19:17:00 +02:00
Georgi Gerganov 1dcc3fde00 common : fix ub (#5530) 2024-02-18 18:21:52 +02:00
Georgi GerganovGitHubslaren
 		8f1be0d42f ggml : add ALiBi support for ggml_soft_max_ext (#5488) 
* ggml : avoid recomputing alibi slopes (CPU)

* llama : reuse hparams.f_max_alibi_bias in all cases

ggml-ci

* ggml : support alibi bias in ggml_soft_max_ext (CPU + Metal)

ggml-ci

* ggml : handle all SRCs (do not break on first null)

ggml-ci

* tests : do not use slope for large soft_max

accumulates too much error

ggml-ci

* ggml : alternative ALiBi without extra tensor

We compute the slopes in the kernel

ggml-ci

* cuda : add ALiBi support in ggml_soft_max_ext

ggml-ci

* ggml : deprecate ggml_alibi

* ggml : support multi-sequence ALiBi (Metal)

ggml-ci

* cuda : add multi-seq ALiBi + remote F16 soft_max

ggml-ci

* ggml : update deprecation message

* ggml : fix pos ptr when no ALiBi

ggml-ci

* cuda : fix performance (pow -> powf)

* cuda : precompute ALiBi constants

* metal : pre-compute ALiBi slopes

ggml-ci

* llama : init kq_pos only if needed

ggml-ci

* test-backend-ops : add null pos test to soft_max

test-backend-ops : replace soft_max tests

ggml-ci

---------

Co-authored-by: slaren <slarengh@gmail.com>
 2024-02-17 23:04:16 +02:00
Georgi GerganovandGitHub 5bf2b94dd4 cmake : fix VULKAN and ROCm builds (#5525) 
* cmake : fix VULKAN and ROCm builds

* cmake : fix (cont)

* vulkan : fix compile warnings

ggml-ci

* cmake : fix

ggml-ci

* cmake : minor

ggml-ci
 2024-02-16 19:05:56 +02:00
Georgi GerganovGitHubslaren
 		d2819d5577 scripts : add helpers script for bench comparing commits (#5521) 
* scripts : add helpers script for bench comparing commits

* scripts : detect CUDA

* set flags after checking the command line

* fix make flags

---------

Co-authored-by: slaren <slarengh@gmail.com>
 2024-02-16 15:14:40 +02:00
Georgi Gerganov 594845aab1 ci : fix BERT model download and convert 2024-02-16 09:57:55 +02:00
Georgi Gerganov c06e45d729 clip : fix wrong loop condition 2024-02-15 18:49:08 +02:00
Georgi GerganovandGitHub 9350a1cf21 scripts : add hf.sh helper script (#5501) 
* scripts : add hf.sh helper scripts

* hf : add error logs

* hf : add support for --repo and --file
 2024-02-15 15:41:15 +02:00
Georgi GerganovandGitHub cf45252a7c tests : multi-thread the tokenizer tests (#5474) 
* tests : multi-thread the tokenizer tests

ggml-ci

* unicode : fix data race for unidentified codepoints

ggml-ci

* unicode : minor style fixes

ggml-ci
 2024-02-13 15:14:22 +02:00
Georgi GerganovandGitHub 49cc1f7d67 bert : add tests + fix quantization (#5475) 
* llama : do not quantize pos embd and token type tensors

* ci : add BERT tests

ggml-ci

* ci : do not do BERT tests on low-perf nodes

ggml-ci
 2024-02-13 13:01:29 +02:00
Georgi GerganovandGitHub 99b8b43d7b tests : disable moe test (#5473) 2024-02-13 11:20:24 +02:00
Georgi Gerganov 099afc6274 llama : fix quantization when tensors are missing (#5423) 2024-02-12 20:14:39 +02:00
Georgi GerganovandGitHub df334a1125 swift : package no longer use ggml dependency (#5465) 
* Revert "swift : update Package.swift to use ggml as dependency (#4691)"

This reverts commit ece9a45e8f.

* spm : add ggml headers
 2024-02-12 19:54:29 +02:00
Georgi GerganovGitHubslaren
 		3b169441df sync : ggml (#5452) 
* ggml-alloc : v3 (ggml/727)

* ggml-alloc v3

ggml-ci

* fix ci

ggml-ci

* whisper : check for backend buffer allocation failures

* whisper : avoid leaks when initialization fails

* cleanup

ggml-ci

* style fixes

ggml-ci

* sync : ggml

* update llama.cpp, clip.cpp, export-lora.cpp

* update finetune.cpp, train-text-from-scratch.cpp

ggml-ci

* ggml-backend : reduce alignment to 32 to match gguf and fix mmap

---------

Co-authored-by: slaren <slarengh@gmail.com>
 2024-02-12 09:16:06 +02:00
Georgi Gerganov 85910c5b30 main : ctrl+C print timing in non-interactive mode (#3873) 2024-02-11 15:35:50 +02:00
Georgi Gerganov 139b62a839 common : fix compile warning 2024-02-11 15:33:43 +02:00
Georgi Gerganov 0f2411f154 ggml : fix compile warnings (unused vars) (#4966) 2024-02-11 15:33:01 +02:00
Georgi Gerganov cd9aea63b5 scripts : update sync scripts with new backends 2024-02-10 09:53:05 +02:00
Georgi Gerganov 43b65f5eb8 sync : ggml 2024-02-10 09:30:36 +02:00
Georgi Gerganov 8504d2d0da tests : .gitignore obj files 2024-02-08 09:46:47 +02:00
Georgi GerganovandGitHub 906cff55c2 py : handle byte tokens in get_token_type (#5341) 
* py : handle byte tokens in `get_token_type`

* py : fix empty bytes arg
 2024-02-06 07:47:22 +02:00
Georgi Gerganov 30679d438d scripts : fix typos, cleanup (#5303) 2024-02-05 09:48:03 +02:00
Georgi GerganovandGitHub e437b37fd0 scripts : parse wtype in server-llm.sh (#5167) 
* scripts : parse wtype in server-llm.sh

* scripts : fix check for wfile
 2024-02-02 14:23:40 +02:00
Georgi Gerganov d3bac7d584 llama : reorder build_orion() at correct place (#5118) 2024-01-31 18:47:10 +02:00
Georgi GerganovGitHubslaren
 		5cb04dbc16 llama : remove LLAMA_MAX_DEVICES and LLAMA_SUPPORTS_GPU_OFFLOAD (#5240) 
* llama : remove LLAMA_MAX_DEVICES from llama.h

ggml-ci

* Update llama.cpp

Co-authored-by: slaren <slarengh@gmail.com>

* server : remove LLAMA_MAX_DEVICES

ggml-ci

* llama : remove LLAMA_SUPPORTS_GPU_OFFLOAD

ggml-ci

* train : remove LLAMA_SUPPORTS_GPU_OFFLOAD

* readme : add deprecation notice

* readme : change deprecation notice to "remove" and fix url

* llama : remove gpu includes from llama.h

ggml-ci

---------

Co-authored-by: slaren <slarengh@gmail.com>
 2024-01-31 17:30:17 +02:00
Georgi Gerganov efb7bdbbd0 metal : add im2col F32 dst support (#5132) 2024-01-31 15:35:41 +02:00
Georgi Gerganov e0085fdf7c Revert "server : change deps.sh xxd files to string literals (#5221)" 
This reverts commit 4003be0e5f.
 2024-01-30 21:19:26 +02:00
Georgi GerganovandGitHub e6f291d158 server : fix context shift (#5195) 
* server : fix context shift + simplify self-extend

* server : take system_tokens into account

* server : more n_past fixes

* server : rever n_past_se changes
 2024-01-30 20:17:30 +02:00
Georgi Gerganov 8f8ddfcfad sync : ggml (#0) 2024-01-30 16:21:57 +02:00
Georgi Gerganov 6fb50ebbf0 gguf : fix comparison (ggml/715) 
ggml-ci
 2024-01-30 16:20:25 +02:00
Georgi Gerganov a4b07c057a gguf : add input validation, prevent integer overflows (ggml/709) 
* gguf : add input validation, prevent integer overflows

ggml-ci

* gguf : fix switch default case

* gguf : sanitize info->n_dims and info->type

ggml-ci

* gguf : assert GGUF_TYPE_SIZE access

ggml-ci

* ggml : assert mallocs are successful

ggml-ci

* gguf : prevent integer overflow

* gguf : sanitize tensor info

ggml-ci

* gguf : stricter limit on the number of items

ggml-ci
 2024-01-30 16:20:25 +02:00
Georgi Gerganov 549a1e6cd5 ci : fix yolo URLs + fix metal capture (ggml/712) 2024-01-30 16:20:25 +02:00
Georgi GerganovandGitHub 49f44b5c55 readme : update hot topics 2024-01-30 11:14:44 +02:00
Georgi GerganovandGitHub 14fef85e2d py : fix except (#5194) 
ggml-ci
 2024-01-29 15:35:54 +02:00
Georgi Gerganov 35dec26cc2 sync : ggml 2024-01-28 19:48:05 +02:00
Georgi Gerganov d460510c72 ggml : minor type fix (int64_t -> size_t) 2024-01-28 19:47:31 +02:00
Georgi GerganovandGitHub b764b8f1d0 flake.lock: Update (#5162) 2024-01-28 14:54:54 +00:00
Georgi Gerganov 753eafed0e sync : ggml 2024-01-27 17:00:24 +02:00