Update Vulkan RoPE implementation (#7818)

Browse Source

* Update Vulkan RoPE implementation

* Return nullptr on alloc_buffer when allocation fails, instead of throwing an exception

Minor fixes

* Fix segfault when running out of VRAM

Co-authored-by: slaren <slarengh@gmail.com>

---------

Co-authored-by: slaren <slarengh@gmail.com>

...

This commit is contained in:

0cc4m

2024-06-11 21:20:29 +02:00

committed by GitHub

co-authored by slaren

parent 14f83526cd

commit ef52d1d16a

4 changed files with 1311 additions and 1227 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

ggml-vulkan-shaders.hpp

+1239 -1138

File diff suppressed because it is too large Load Diff