CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-02 09:12:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
compilade/bitnet-ternary
llama.cpp/gguf-py/tests/test_quants.py
Francis Couture-Harpin 3a0bf17d57 gguf-py : Numpy (de)quantization for TQ1_0 and TQ2_0 
* ggml-quants : use roundf instead of nearest_int for TQ1_0 and TQ2_0

This does not change anything for ternary models,
since their values should never end up being in halfway cases anyway.
2024-08-12 00:06:48 -04:00

9.8 KiB
Executable File
Raw Permalink Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink