nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 20 Packages Projects Releases Wiki Activity
1,335 Commits 1 Branch 0 Tags
0c731ca4039ccff86ffab90eaae4ca98037c4496
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
shibe2 e2583cbc29 CLBlast: Fix handling of on-device tensor data 
Fix uploading tensor data to device, including 3D, 4D, and non-contiguous tensors.
Use correct offsets into data that is already in VRAM.
Correct handling of OpenCL events when multiple commands are queued.
 2023-10-05 18:25:23 +04:00
shibe2andGitHub 665018c749 CLBlast: Add broadcast support for matrix multiplication (#3402) 
Broadcast src0 into src1 across dimensions 2 and 3 when needed.
This is required for models that use GQA.
 2023-10-02 21:26:15 +02:00
shibe2andGitHub 36b904e200 ggml-opencl.cpp: Make private functions static (#3300) 2023-09-21 14:10:26 -04:00