llama.cpp/tools/llama-bench/llama-bench.cpp at 7956bb4d7f430f23f3c4726f7e6404b89f6e20a4

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-09 10:17:06 +00:00

Files

Georgi Gerganov 7956bb4d7f bench : cache the llama_context state at computed depth (#16944 )

* bench : cache llama_context state at depth

* cont : handle failures to restore the old state

* cont : print information when the state is being reused

2025-11-07 21:23:11 +02:00

86 KiB

Raw Blame History

View Raw

86 KiB Raw Blame History

86 KiB

Raw Blame History