Files
llama.cpp/convert.py
wonjun Jang f56d6077d0 Add byte token type when tokenizer.model is not exists (#4641)
* Add byte token type to hf format

* remove unused variable
2023-12-27 17:37:25 +09:00

50 KiB
Executable File