CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-07 09:57:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
34bdbbd7c2b70b848718e95bc48010f6aecd2816
llama.cpp/tools/batched-bench/batched-bench.cpp
Georgi Gerganov 6b64f74b55 batched-bench : fix unified KV cache handling + pp timing (#15562) 
* batched-bench : fix unified KV cache handling + pp timing

* cont : run dummy token only with split KV cache
2025-08-25 13:56:43 +03:00

7.8 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink