llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-30 08:42:00 +00:00

Files

Justine Tunney 436787f170 llama : fix time complexity of string replacement (#9163 )

This change fixes a bug where replacing text in a very long string could
cause llama.cpp to hang indefinitely. This is because the algorithm used
was quadratic, due to memmove() when s.replace() is called in a loop. It
seems most search results and LLM responses actually provide the O(n**2)
algorithm, which is a great tragedy. Using a builder string fixes things

2024-08-26 09:09:53 +03:00

CMakeLists.txt

llama : move vocab, grammar and sampling into separate files (#8508 )

2024-07-23 13:10:17 +03:00

llama-grammar.cpp

ggml : reduce hash table reset cost (#8698 )

2024-07-27 04:41:55 +02:00

llama-grammar.h

llama : fix build + fix fabs compile warnings (#8683 )

2024-07-25 19:57:31 +03:00

llama-impl.h

llama : fix time complexity of string replacement (#9163 )