lhez and GitHub
7cba58bbea
opencl: add sqr, sqrt, mean and ssm_conv ( #17476 )
...
* opencl: add sqr
* opencl: add sqrt
* opencl: add mean
* opencl: add ssm_conv
* opencl: add missing cl_khr_fp16
* opencl: do sqrt in f32 then convert to f16 for better precision
2025-11-26 13:29:58 -08:00
lhez and GitHub
8e9ddba610
opencl: refine condition for kqv mm ( #17392 )
2025-11-21 14:34:48 -08:00
lhez and GitHub
52e5d421f1
opencl: fix rms_norm_mul ( #17250 )
...
* opencl: use subgrroup reduce for reduction in rms_norm_mul
* opencl: add comment about workgroup size
2025-11-15 17:40:14 -08:00
lhez and GitHub
ece0f5c177
opencl: add fastdiv and use it in set_rows, ported from cuda ( #17090 )
...
* opencl: add fastdiv for mm q8_0
* opencl: use uint4 for fastdiv vals
* opencl: use fastdiv for set_rows
* opencl: do not use fastdiv for q8_0 mm
2025-11-10 15:00:13 -08:00
lhez and GitHub
5e90233bdb
opencl: update doc ( #17011 )
...
* opencl: update docs
* opencl: update docs
* opencl: fix link
* opencl: update doc
2025-11-04 16:02:36 -08:00
lhez and GitHub
c5023daf60
opencl: support imrope ( #16914 )
...
* opencl: support imrope
* opencl: fix whitespace
2025-11-03 11:47:57 -08:00
lhez and GitHub
9984cbb61d
opencl: fix boundary handling for mul_mm ( #16875 )
2025-10-30 16:00:20 -07:00
lhez and GitHub
6ea37f5739
opencl: fix warnings and clean up profiling ( #16688 )
...
* opencl: remove unused headers, fix warnings
* opencl: clean up profiling, only keep kernel time
2025-10-20 22:26:17 -07:00
lhez and GitHub
0cb7a0683b
opencl: add q8_0 mm support ( #16469 )
...
* opencl: add mm_q8_0_f32
* opencl: fix data loading for incomplete tile
* opencl: use q8_0 mm for larger matrix
* opencl: add some tests to cover the path
2025-10-15 10:51:04 -07:00
lhez and GitHub
d93f8439b0
opencl: fix FA for f32 ( #16584 )
2025-10-15 10:48:28 -07:00
lhez and GitHub
5016b72862
opencl: fix build targeting CL 2 ( #16554 )
2025-10-13 11:50:37 -07:00
lhez and GitHub
7c156df414
opencl: support pad_ext ( #15888 )
2025-09-30 10:45:45 -07:00
lhez and GitHub
d1c84a662d
opencl: support ne3 in get_rows ( #15866 )
2025-09-30 09:55:13 -07:00
lhez and GitHub
de41f2b7bf
codeowners: add codeowners for opencl backend ( #16344 )
2025-09-30 08:30:16 +03:00
lhez and GitHub
51f5a45fbe
opencl: fix concat crash on win arm64 with Adreno ( #15944 )
2025-09-21 16:42:10 -07:00
lhez and GitHub
c4510dc937
opencl: initial q8_0 mv support ( #15732 )
2025-09-21 14:48:44 -07:00
lhez and GitHub
f7207b0415
opencl: fix support ops condition for rms_norm ( #15560 )
2025-08-25 14:18:09 -07:00
lhez and GitHub
fb22dd07a6
opencl: mark argsort unsupported if cols exceed workgroup limit ( #15375 )
2025-08-19 11:25:51 -07:00
e2c1bfff53
opencl: add initial mxfp4 support via mv ( #15270 )
...
* opencl: add reference `mul_mv_mxfp4_f32`
* opencl: add reference `mul_mv_id` for mxfp4
* Q4_0 tranpose fix for Adreno
---------
Co-authored-by: shawngu-quic <shawngu@qti.qualcomm.com >
2025-08-15 09:52:14 -07:00
lhez and GitHub
aaa3d07ae7
opencl: support sink in soft_max (attn sinks) ( #15152 )
2025-08-07 21:47:03 -07:00
lhez and GitHub
e725a1a982
opencl: add swiglu_oai and add_id ( #15121 )
...
* opencl: add `swiglu-oai`
* opencl: add `add_id`
* opencl: add missing `add_id.cl`
2025-08-06 12:12:17 -07:00
lhez and GitHub
5c0eb5ef54
opencl: fix adreno compiler detection logic ( #15029 )
2025-08-02 19:51:18 +02:00
lhez and GitHub
6e6725459a
opencl: add mul_mat_f32_f32_l4_lm and mul_mat_f16_f32_l4_lm ( #14809 )
2025-07-30 14:56:55 -07:00
lhez and GitHub
8ad7b3e65b
opencl : add ops docs ( #14910 )
2025-07-28 18:50:17 +02:00
lhez and GitHub
ce111d39d6
opencl: add fused rms_norm_mul ( #14841 )
...
* opencl: add fused `rms_norm` + `mul`
* opencl: improve workgroup size for `rms_norm_mul`
2025-07-25 17:12:13 +02:00
lhez and GitHub
8e6f8bc875
opencl: remove unreachable return ( #14806 )
2025-07-22 08:53:30 +02:00
