nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 23 Packages Projects Releases Wiki Activity
4,223 Commits 1 Branch 0 Tags
a3a3048e7a0f9464d0d625a29257d8bce5da5090
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
RonsorandGitHub d7def1a752 Warn user if a context size greater than 2048 tokens is specified (#274) 
LLaMA doesn't support more than 2048 token context sizes, and going above that produces terrible results.
 2023-03-18 20:10:47 -04:00
RonsorandGitHub 956dfda8ad Use tokenizer.vocab_size() instead of hardcoding 32000 in convert-pth-to-ggml.py (#142) 
There are ways that special tokens or other new tokens could be added to the tokenizer; therefore it's probably best not to assume the vocabulary is only 32000 tokens.
 2023-03-15 21:37:50 +02:00
RonsorGitHubGeorgi Gerganov
 		47857e564c Don't use vdotq_s32 if it's not available (#139) 
* Don't use vdotq_s32 if it's not available

`dotprod` extensions aren't available on some ARM CPUs (e.g. Raspberry Pi 4), so check for them and only use them if they're available.

Reintroduces the code removed in 84d9015 if `__ARM_FEATURE_DOTPROD` isn't defined.

* Update ggml.c

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-03-14 21:34:37 +02:00