Pavol Rusnak and GitHub
921dcee00a
readme: add missing info ( #1324 )
2023-05-05 16:43:36 +02:00
Pavol Rusnak and GitHub
6f79699286
build: add armv{6,7,8} support to cmake ( #1251 )
...
- flags copied from Makefile
- updated comments in both CMakeLists.txt and Makefile to match reality
2023-04-30 20:48:38 +02:00
Pavol Rusnak and GitHub
859fee6dfb
quantize : use map to assign quantization type from string ( #1191 )
...
instead of `int` (while `int` option still being supported)
This allows the following usage:
`./quantize ggml-model-f16.bin ggml-model-q4_0.bin q4_0`
instead of:
`./quantize ggml-model-f16.bin ggml-model-q4_0.bin 2`
2023-04-26 18:43:27 +02:00
Pavol Rusnak and GitHub
bb98e77be7
nix: use convert.py instead of legacy wrapper convert-pth-to-ggml.py ( #981 )
2023-04-25 23:19:57 +02:00
Pavol Rusnak and GitHub
c6524f46eb
readme : update gpt4all instructions ( #980 )
2023-04-23 10:21:26 +02:00
Pavol Rusnak and GitHub
489537e6cf
examples: add missing <ctime> include for time() ( #1011 )
2023-04-16 10:13:00 +00:00
Pavol Rusnak and GitHub
c85e03d12e
Revert "main : alternative instruct mode (Vicuna support, etc.) ( #863 )" ( #982 )
...
This reverts commit f4d277ae17
2023-04-14 22:58:43 +03:00
Pavol Rusnak and GitHub
489093548c
py : bump sentencepiece to 0.1.98 to support Python 3.11 ( #976 )
2023-04-14 19:46:49 +00:00
c56b715269
Expose type name from ggml ( #970 )
...
Avoid duplication of type names in utils
Co-authored-by: Håkon H. Hitland <haakon@likedan.net >
2023-04-14 20:05:37 +02:00
Pavol Rusnak and GitHub
a32f7acc9f
py : cleanup dependencies ( #962 )
...
after #545 we do not need torch, tqdm and requests in the dependencies
2023-04-14 15:37:11 +02:00
Pavol Rusnak and GitHub
43ffdefb74
py : fix flake8 and isort nitpicks ( #960 )
2023-04-14 14:23:21 +02:00
Pavol Rusnak and GitHub
6c248707f5
ggml : introduce GGML_ALIGNED_MALLOC/GGML_ALIGNED_FREE macros ( #884 )
...
which allows us to use aligned_alloc or _aligned_malloc functions
2023-04-13 17:08:32 +03:00
Pavol Rusnak and GitHub
c729ff730a
flake.nix: add all binaries from bin ( #848 )
2023-04-13 15:49:05 +02:00
Pavol Rusnak and GitHub
82d146df9b
do not force the prompt file to end with a new line ( #908 )
2023-04-13 11:33:16 +02:00
Pavol Rusnak and GitHub
8b679987cd
Fix whitespace, add .editorconfig, add GitHub workflow ( #883 )
2023-04-11 19:45:44 +00:00
Pavol Rusnak and GitHub
d2beca95dc
Make docker instructions more explicit ( #785 )
2023-04-06 08:56:58 +02:00
Pavol Rusnak
cbef542879
py : cleanup the code
...
- use f-strings where possible
- drop first param of encode/decode functions since "utf-8" is the default
2023-03-31 10:32:01 +02:00
Pavol Rusnak
9733104be5
drop quantize.py (now that models are using a single file)
2023-03-31 01:07:32 +02:00
Pavol Rusnak and GitHub
61cbfff5c9
rename convert_ggml_to_pth.py -> convert-ggml-to-pth.py ( #600 )
...
to match filenames of other converters
2023-03-29 20:09:25 +02:00
Pavol Rusnak
6f61c18ec9
Fix typo in readme
2023-03-18 23:18:04 +01:00
Pavol Rusnak
1e5a6d088d
Add note about Python 3.11 to readme
2023-03-18 22:25:35 +01:00
Pavol Rusnak
554b541521
Add memory/disk requirements to readme
2023-03-18 22:25:35 +01:00
Pavol Rusnak and GitHub
671d5cac15
Use fprintf for diagnostic output ( #48 )
...
keep printf only for printing model output
one can now use ./main ... 2>dev/null to suppress any diagnostic output
2023-03-13 18:39:56 +02:00
d1f224712d
Add quantize script for batch quantization ( #92 )
...
* Add quantize script for batch quantization
* Indentation
* README for new quantize.sh
* Fix script name
* Fix file list on Mac OS
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
2023-03-13 18:15:20 +02:00
Pavol Rusnak and GitHub
6a9a67f0be
Add LICENSE ( #21 )
2023-03-12 08:36:03 +02:00
