CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-29 08:41:22 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,544 Commits 495 Branches 4,641 Tags
1740d6dd4e00dedda87d6820b0e0d8e70dade340
Commit Graph

2 Commits

Author SHA1 Message Date
Jared Van Bortel
32c8486e1f wpm : portable unicode tolower (#6305) 
Also use C locale for ispunct/isspace, and split unicode-data.cpp from unicode.cpp.
 2024-03-26 17:46:21 -04:00
Georgi Gerganov
83796e62bc llama : refactor unicode stuff (#5992) 
* llama : refactor unicode stuff

ggml-ci

* unicode : names

* make : fix c++ compiler

* unicode : names

* unicode : straighten tables

* zig : fix build

* unicode : put nfd normalization behind API

ggml-ci

* swift : fix build

* unicode : add BOM

* unicode : add <cstdint>

ggml-ci

* unicode : pass as cpts as const ref
 2024-03-11 17:47:47 +02:00