Kerfuffle e06cbcee73 gguf : add Python script to convert GGMLv3 LLaMA models to GGUF (#2682) ...

* First pass at converting GGMLv3 LLaMA models to GGUF

* Cleanups, better output during conversion

* Fix vocab space conversion logic

* More vocab conversion fixes

* Add description to converted GGUF files

* Improve help text, expand warning

* Allow specifying name and description for output GGUF

* Allow overriding vocab and hyperparams from original model metadata

* Use correct params override var name

* Fix wrong type size for Q8_K

Better handling of original style metadata

* Set default value for gguf add_tensor raw_shape KW arg

2023-08-21 17:45:52 +03:00

15 KiB

Raw Blame History

View Raw