CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-01 09:01:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
229ffff872f8ad0d21c997d18ee7a23692ae60a0
llama.cpp/convert-hf-to-gguf.py
Ren Xuancheng 229ffff872 llama : add BPE pre-tokenization for Qwen2 (#7114) 
* Add BPE pre-tokenization for Qwen2.

* minor : fixes

---------

Co-authored-by: Ren Xuancheng <17811943+jklj077@users.noreply.github.com>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2024-05-08 15:06:43 +03:00

131 KiB
Executable File
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink