CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-27 08:21:30 +00:00
Code Issues Packages Projects Releases Wiki Activity

Allow "quantizing" to f16 and f32 (#1787)

Browse Source 
* Allow "quantizing" to f16 and f32

Fix an issue where quantizing didn't respect LLAMA_NO_K_QUANTS

Add brief help to the list of quantization types in the quantize tool

Ignore case for quantization type arguments in the quantize tool
This commit is contained in:
Kerfuffle
2023-06-13 04:23:23 -06:00
committed by GitHub
parent 74a6d922f1
commit 74d4cfa343
4 changed files with 154 additions and 48 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
Makefile
View File

@@ -127,6 +127,7 @@ endif
ifndef LLAMA_NO_K_QUANTS
CFLAGS += -DGGML_USE_K_QUANTS
CXXFLAGS += -DGGML_USE_K_QUANTS
OBJS += k_quants.o
endif