CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-20 12:07:33 +00:00
Code Issues Packages Projects Releases Wiki Activity
6,639 Commits 504 Branches 4,830 Tags
de41f2b7bffab7582944b213ce12b605f8cf6e0f
Commit Graph

3 Commits

Author SHA1 Message Date
Ruben Ortlam
9073a73d82 vulkan: vec dot matrix multiplication fix (#16151) 
* vulkan: fix matrix multiplication index calculation for odd m/n and odd k in combination with batching

* add odd m/n + odd k test with batching
 2025-09-22 07:22:43 +02:00
Ruben Ortlam
803dac2e48 vulkan: use vec dot for matrix matrix multiplications (#16056) 
* vulkan: Change the mul_mm shared memory and register caching system to use vec2 instead of scalars, to enable using dot2 instructions

* use fma instead of dot to fix Nvidia and Apple performance issues
 2025-09-20 10:42:56 +02:00
Ruben Ortlam
261e6a20ff Vulkan: Clean up mul_mm shader (#15987) 
* vulkan: move mul_mm dequantization steps into a separate file and functions

* improve mul_mm vector load code

* fix debug mode issues and warnings
 2025-09-14 16:56:28 +02:00