CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-30 08:42:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
b7c6ece5b5093844d21677adfd384e1b9286df92
llama.cpp/common/common.cpp
Ruikai Peng dd6e6d0b6a vocab : prevent tokenizer overflow (#14301) 
* vocab : prevent stack overflow in tokenize

* vocab : return error instead of aborting on oversized token count

* vocab : INT32_MIN from llama_tokenize on overflow
2025-06-20 07:13:06 -07:00

50 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink