CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-28 08:31:25 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
62cfc54f77e519057110265b52b0d614fa363e2a
llama.cpp/examples/quantize-stats
History
unbounded 62cfc54f77 Add quantize-stats command for testing quantization (#728) 
Command that calculates some statistics over the errors introduced by
quantization, like mean square error, max error and some percentile errors for layer
weights. Should be useful for testing quantization improvements.

Exposes some internal state from ggml and llama for testing
2023-04-08 00:09:18 +02:00
..
CMakeLists.txt
Add quantize-stats command for testing quantization (#728)
2023-04-08 00:09:18 +02:00
quantize-stats.cpp
Add quantize-stats command for testing quantization (#728)
2023-04-08 00:09:18 +02:00