CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-17 11:37:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
dd047b476c8b904e0c25e5dbc5bee6ffde2f6e17
llama.cpp/ggml-cuda/mma.cuh
Johannes Gäßler 9a590c8226 CUDA: optimize MMQ int8 tensor core performance (#8062) 
* CUDA: optimize MMQ int8 tensor core performance

* only a single get_mma_tile_x_k function

* simplify code, make functions constexpr
2024-06-24 12:41:23 +02:00

7.3 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink