CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-03 09:22:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
f7625019c51ca437a5840576d92362cfa710e4a2
llama.cpp/examples/server/server.cpp
compilade f7625019c5 server : fix crash when system prompt is bigger than batch size (#5714) 
The system prompt is now decoded in batches.

* server : fix off-by-one n_past when start of prompt matches whole cache

The tokens right after the matching part would otherwise skip a pos value.
2024-02-25 20:43:50 +02:00

136 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink