Files
llama_cpp/ggml/src/ggml-cuda
5814b4dce1 cuda: optimize SOLVE_TRI using registers and FMAF (#17703)
* ggml-cuda: optimize solve_tri_f32_fast and fix stride handling

- Switch from using shared memory for the RHS/solution matrix to a register-based approach (x_low, x_high), reducing shared memory pressure and bank conflicts.
- Implement explicit `fmaf` instructions for the reduction loop.
- Update kernel arguments to pass strides in bytes rather than elements to align with standard ggml tensor arithmetic (casting to `char *` before addition).
- Remove unused `MAX_K_FAST` definition.

* Small cleanup

* Remove comments in solve_tri.cu

* Update ggml/src/ggml-cuda/solve_tri.cu

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

* Update ggml/src/ggml-cuda/solve_tri.cu

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

* Update ggml/src/ggml-cuda/solve_tri.cu

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

* Use const for variables in solve_tri.cu

* Replace fmaf with more readable code

* remove last fmaf

---------

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
2025-12-08 10:41:08 +01:00
..
2025-08-20 10:17:37 +08:00
2025-08-05 22:10:36 +03:00
2024-11-21 18:18:50 +01:00
2025-06-20 09:50:24 +08:00
2025-06-20 09:50:24 +08:00
2025-08-28 20:33:03 +02:00
2025-08-21 11:06:05 +08:00
2025-06-22 12:39:54 +08:00
2025-12-05 13:47:52 +01:00
2025-10-26 19:28:04 +08:00
2025-07-29 14:45:18 +08:00
2025-07-29 14:45:18 +08:00
2025-11-13 08:50:01 +08:00
2025-11-13 08:50:01 +08:00
2025-07-29 14:22:03 +02:00
2025-07-29 14:22:03 +02:00
2025-08-05 22:10:36 +03:00
2025-03-31 18:05:13 +02:00
2025-03-31 18:05:13 +02:00
2025-06-22 12:39:54 +08:00
2025-11-30 21:57:31 +01:00