CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-31 08:51:55 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
13f2cfad4170c096c51a02c24a6a158cb47f1480
llama.cpp/convert_hf_to_gguf.py
amirai21 477a66b035 convert : correctly handle LLaMA tokenizer for Jamba (#16470) 
* fix: convert_hf_to_gguf - change Jamba non-sentencepiece mode (tokenizer.json) vocab construction

* fix: convert_hf_to_gguf - jamba non-sentencepiece tokenizer to use _set_vocab_llama_hf func

* fix: convert_hf_to_gguf - removed get_vocab_base_pre from jamba
2025-10-11 10:33:41 +02:00

436 KiB
Executable File
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink