CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-01 09:01:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
bc07349a7f87ba6eb31ed4b0ea9d9a7352185213
llama.cpp/tools/server/server.cpp
Georgi Gerganov bc07349a7f server : dynamic token limit for prompt cache (#16560) 
* server : dynamic token limit for prompt cache

* cont : print estimated token limit
2025-10-14 08:48:50 +03:00

229 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink