CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-01 09:01:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
6fcd1331efbfbb89c8c96eba2321bb7b4d0c40e4
llama.cpp/ggml-cuda/template-instances/mmq-instance-q2_k.cu
Johannes Gäßler 7d1a378b8f CUDA: refactor mmq, dmmv, mmvq (#7716) 
* CUDA: refactor mmq, dmmv, mmvq

* fix out-of-bounds write

* struct for qk, qr, qi

* fix cmake build

* mmq_type_traits
2024-06-05 16:53:00 +02:00

138 B
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink