6bbc598a63
ROCm Port ( #1087 )
...
* use hipblas based on cublas
* Update Makefile for the Cuda kernels
* Expand arch list and make it overrideable
* Fix multi GPU on multiple amd architectures with rocblas_initialize() (#5 )
* add hipBLAS to README
* new build arg LLAMA_CUDA_MMQ_Y
* fix half2 decomposition
* Add intrinsics polyfills for AMD
* AMD assembly optimized __dp4a
* Allow overriding CC_TURING
* use "ROCm" instead of "CUDA"
* ignore all build dirs
* Add Dockerfiles
* fix llama-bench
* fix -nommq help for non CUDA/HIP
---------
Co-authored-by: YellowRoseCx <80486540+YellowRoseCx@users.noreply.github.com >
Co-authored-by: ardfork <134447697+ardfork@users.noreply.github.com >
Co-authored-by: funnbot <22226942+funnbot@users.noreply.github.com >
Co-authored-by: Engininja2 <139037756+Engininja2@users.noreply.github.com >
Co-authored-by: Kerfuffle <44031344+KerfuffleV2@users.noreply.github.com >
Co-authored-by: jammm <2500920+jammm@users.noreply.github.com >
Co-authored-by: jdecourval <7315817+jdecourval@users.noreply.github.com >
2023-08-25 12:09:42 +03:00
Henri Vasserman and GitHub
6ddeefad9b
[Zig] Fixing Zig build and improvements ( #2554 )
...
* Fix zig after console.o was split
* Better include and flag management
* Change LTO to option
2023-08-17 23:11:18 +03:00
Henri Vasserman and GitHub
7297128db8
[Zig] Rewrite build for Zig 0.11 ( #2514 )
...
* zig build fixes
* Disable LTO on Windows.
2023-08-07 08:35:53 +03:00
Henri Vasserman and GitHub
c798308e3a
[Server] Escape HTML in webchat ( #2368 )
...
* escape HTML in webchat
* add amp
2023-07-25 10:27:34 +03:00
Henri Vasserman and GitHub
acc111caf9
Allow old Make to build server. ( #2098 )
...
Also make server build by default.
Tested with Make 3.82
2023-07-04 15:38:04 +03:00
Henri Vasserman and GitHub
1cf14ccef1
fix server crashes ( #2076 )
2023-07-04 00:05:23 +03:00
Henri Vasserman and GitHub
20568fe60f
[Fix] Reenable server embedding endpoint ( #1937 )
...
* Add back embedding feature
* Update README
2023-06-20 01:12:39 +03:00
Henri Vasserman and GitHub
5220a991a5
Increase 3B scratch buffers. ( #1698 )
...
The 128 MB was too optimistic.
Too bad it is not dynamically computed.
2023-06-05 13:43:08 +03:00
Henri Vasserman and GitHub
d8bd0013e8
Add info about CUDA_VISIBLE_DEVICES ( #1682 )
2023-06-03 16:35:20 +03:00
ffb06a345e
OpenLLaMA 3B support ( #1588 )
...
This adds support to llama.cpp to load the model.
Currently missing are changes that are required from convert.py to convert the model correctly. It needs some changes to start reading the JSON configuration for HF models instead of deriving the values by guessing.
Co-authored-by: FNsi <125447286+FNsi@users.noreply.github.com >
2023-05-30 21:24:22 +03:00
Henri Vasserman and GitHub
97c9b77c4f
Add documentation about CLBlast ( #1604 )
...
Installing, compiling and using.
2023-05-27 18:47:55 +03:00
Henri Vasserman and GitHub
0ecb1bbbeb
[CI] Fix openblas ( #1613 )
...
* Fix OpenBLAS build
* Fix `LLAMA_BLAS_VENDOR` CMake variable that should be a string and not a boolean.
2023-05-27 17:24:06 +03:00
Henri Vasserman and GitHub
83c54e6da5
[CI] CLBlast: Fix directory name ( #1606 )
2023-05-27 14:18:25 +02:00
Henri Vasserman and GitHub
ac7876ac20
Update CLBlast to 1.6.0 ( #1580 )
...
* Update CLBlast to 1.6.0
2023-05-24 10:30:09 +03:00
Henri Vasserman and GitHub
9ecb30f959
OpenCL: Fixes for older devices. ( #1435 )
...
* Remove `constant`
* Rewrite platform and device selection
* Fix Q8_0
2023-05-20 17:57:39 +03:00
Henri Vasserman and GitHub
699b1ad7fe
opencl : fix kernels for the new formats ( #1422 )
...
* Fix OpenCL kernels for the new formats
* Fix Q5_0 alignment issues.
2023-05-13 09:01:15 +03:00
Henri Vasserman and GitHub
e1295513a4
CI: add Windows CLBlast and OpenBLAS builds ( #1277 )
...
* Add OpenCL and CLBlast support
* Add OpenBLAS support
* Remove testing from matrix
* change build name to 'clblast'
2023-05-07 13:20:09 +02:00
Henri Vasserman and GitHub
b1ee8f59b4
cuBLAS: non-contiguous tensor support ( #1215 )
...
* Cuda: non-contiguous tensor support
* remove extra stuff
* rename
* fix error
* more fixes, now OpenBLAS and CLBlast build too
* now then?
2023-04-29 01:31:56 +02:00
