CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-31 08:51:55 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,140 Commits 494 Branches 4,666 Tags
afc4ca288989afea3903c962e1006695d50db8b2
Commit Graph

3 Commits

Author SHA1 Message Date
goerch
afc4ca2889 convert : update convert-new.py with tokenizer fixes (#2614) 
* Merge tokenizer fixes into the gguf branch.

* Add test vocabularies

* Adapt convert-new.py (and fix a clang-cl compiler error on windows)
 2023-08-14 20:20:04 +03:00
Georgi Gerganov
d2bb3ac10b convert.py : remove GGML vocab + other obsolete stuff 2023-07-27 16:36:35 +03:00
Georgi Gerganov
68f53485e4 convert.py : start a new simplified implementation by removing old stuff 2023-07-27 15:56:53 +03:00