Henri Vasserman and GitHub
acc111caf9
Allow old Make to build server. ( #2098 )
...
Also make server build by default.
Tested with Make 3.82
2023-07-04 15:38:04 +03:00
Henri Vasserman and GitHub
1cf14ccef1
fix server crashes ( #2076 )
2023-07-04 00:05:23 +03:00
Henri Vasserman and GitHub
20568fe60f
[Fix] Reenable server embedding endpoint ( #1937 )
...
* Add back embedding feature
* Update README
2023-06-20 01:12:39 +03:00
Henri Vasserman and GitHub
5220a991a5
Increase 3B scratch buffers. ( #1698 )
...
The 128 MB was too optimistic.
Too bad it is not dynamically computed.
2023-06-05 13:43:08 +03:00
Henri Vasserman and GitHub
d8bd0013e8
Add info about CUDA_VISIBLE_DEVICES ( #1682 )
2023-06-03 16:35:20 +03:00
ffb06a345e
OpenLLaMA 3B support ( #1588 )
...
This adds support to llama.cpp to load the model.
Currently missing are changes that are required from convert.py to convert the model correctly. It needs some changes to start reading the JSON configuration for HF models instead of deriving the values by guessing.
Co-authored-by: FNsi <125447286+FNsi@users.noreply.github.com >
2023-05-30 21:24:22 +03:00
Henri Vasserman and GitHub
97c9b77c4f
Add documentation about CLBlast ( #1604 )
...
Installing, compiling and using.
2023-05-27 18:47:55 +03:00
Henri Vasserman and GitHub
0ecb1bbbeb
[CI] Fix openblas ( #1613 )
...
* Fix OpenBLAS build
* Fix `LLAMA_BLAS_VENDOR` CMake variable that should be a string and not a boolean.
2023-05-27 17:24:06 +03:00
Henri Vasserman and GitHub
83c54e6da5
[CI] CLBlast: Fix directory name ( #1606 )
2023-05-27 14:18:25 +02:00
Henri Vasserman and GitHub
ac7876ac20
Update CLBlast to 1.6.0 ( #1580 )
...
* Update CLBlast to 1.6.0
2023-05-24 10:30:09 +03:00
Henri Vasserman and GitHub
9ecb30f959
OpenCL: Fixes for older devices. ( #1435 )
...
* Remove `constant`
* Rewrite platform and device selection
* Fix Q8_0
2023-05-20 17:57:39 +03:00
Henri Vasserman and GitHub
699b1ad7fe
opencl : fix kernels for the new formats ( #1422 )
...
* Fix OpenCL kernels for the new formats
* Fix Q5_0 alignment issues.
2023-05-13 09:01:15 +03:00
Henri Vasserman and GitHub
e1295513a4
CI: add Windows CLBlast and OpenBLAS builds ( #1277 )
...
* Add OpenCL and CLBlast support
* Add OpenBLAS support
* Remove testing from matrix
* change build name to 'clblast'
2023-05-07 13:20:09 +02:00
Henri Vasserman and GitHub
b1ee8f59b4
cuBLAS: non-contiguous tensor support ( #1215 )
...
* Cuda: non-contiguous tensor support
* remove extra stuff
* rename
* fix error
* more fixes, now OpenBLAS and CLBlast build too
* now then?
2023-04-29 01:31:56 +02:00
