CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-03 09:22:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
7733f0c76081b2a69b5f8b192db2db7c43629d58
llama.cpp/ggml-quants.c
Justine Tunney 7733f0c760 ggml : support AVX512VNNI (#6280) 
This change causes some quants (e.g. Q4_0, Q8_0) to go faster on some
architectures (e.g. AMD Zen 4).
2024-03-25 07:39:56 +02:00

488 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink