Jeff Bolz 21c17b5bef vulkan: Use larger workgroups for mul_mat_vec when M is small (#15355) ...

* vulkan: Use larger workgroups for mul_mat_vec when M is small

Also use subgroup instructions for (part of) the reduction when supported.
Without this, the more expensive reductions would eat into the benefits of
the larger workgroups.

* update heuristic for amd/intel

Co-authored-by: 0cc4m <picard12@live.de>

---------

Co-authored-by: 0cc4m <picard12@live.de>

2025-08-17 18:08:57 +02:00

..

cmake

ggml: Skip backend library linking code when GGML_BACKEND_DL=ON (#15094)

2025-08-07 13:45:41 +02:00

include

ggml: initial IBM zDNN backend (#14975)

2025-08-15 21:11:22 +08:00

src

vulkan: Use larger workgroups for mul_mat_vec when M is small (#15355)

2025-08-17 18:08:57 +02:00

.gitignore

vulkan : cmake integration (#8119)

2024-07-13 18:12:39 +02:00

CMakeLists.txt

ggml: initial IBM zDNN backend (#14975)

2025-08-15 21:11:22 +08:00