CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-06 09:46:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
d9f65c97c3dc3aa6fa27470b8c6e69b437ec1a27
llama.cpp/gguf-py/gguf/vocab.py
Michaël de Vries 73122473ff fix(gguf-py): special tokens are no longer skipped when add_<token>_token is set to false (#5487) 
* fix(gguf-py): special tokens are no longer skipped when add_<token>_token is set to false

* fix(gguf-py): added missing cls and mask token ids to the gguf metadata
2024-02-15 14:14:37 +01:00

7.0 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink