Howard Su and GitHub
cbebf61ca7
Fix assert when free invalid cuda pointer ( #2005 )
...
Fix assert via initializing extra structure always.
CUDA error 1 at C:\GPT\llama.cpp\ggml-cuda.cu:2536: invalid argument
2023-06-26 23:15:47 +08:00
1e3abfcef0
cmake : fix build shared ggml when CUDA is enabled ( #1929 )
...
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
2023-06-19 18:10:37 +03:00
Howard Su and GitHub
57cd69460f
cmake : add CUDA_ARCHITECTURES to new target ggml_static ( #1917 )
2023-06-18 07:29:47 +03:00
Howard Su and GitHub
3d59ec5935
ggml : fix warnings under MSVC ( #1908 )
2023-06-17 18:46:15 +03:00
Howard Su and GitHub
64cc19b4fe
Fix the validation of main device ( #1872 )
2023-06-15 19:29:59 +02:00
58970a4c39
Leverage mmap for offloading tensors to GPU ( #1597 )
...
* Rebase to latest
* Show progress
* Add assert to make sure we only allocate temp buffer for non-CPU backend tensor
Co-authored-by: Johannes Gäßler <johannesg@5d6.de >
---------
Co-authored-by: Johannes Gäßler <johannesg@5d6.de >
2023-06-12 14:44:16 +02:00
Howard Su and GitHub
bb051d9723
opencl : no need to allocate cl_mem on heap ( #1612 )
2023-05-28 20:13:36 +03:00
Howard Su and GitHub
ca74884f66
opencl : use strstr to check if fp16 supported ( #1611 )
...
* Use strstr to check if fp16 supported
* Ensure ext_buffer is null terminated
2023-05-28 20:09:56 +03:00
Howard Su and GitHub
7e312f165c
cmake : fix build under Windows when enable BUILD_SHARED_LIBS ( #1100 )
...
* Fix build under Windows when enable BUILD_SHARED_LIBS
* Make AVX512 test on Windows to build the shared libs
2023-04-22 11:18:20 +03:00
Howard Su and GitHub
c5d70f5c9e
ggml : optimize rope function to avoid call powf in the tight loop ( #807 )
2023-04-14 09:24:52 +03:00
