Files
llama.cpp/convert.py
Georgi Gerganov 906cff55c2 py : handle byte tokens in get_token_type (#5341)
* py : handle byte tokens in `get_token_type`

* py : fix empty bytes arg
2024-02-06 07:47:22 +02:00

58 KiB
Executable File