llama.cpp/convert.py at ggml-impl - llama.cpp - Gitea - Peisong Xiao

CS348Project/llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-30 08:42:00 +00:00

Files

Georgi Gerganov 8a2f2fea29 convert : ignore tokens if their IDs are within [0, vocab_size) (#3831 )

2023-10-28 06:25:15 -06:00

49 KiB

Executable File

Raw Permalink Blame History

View Raw