llama.cpp/examples/server/server.cpp at 515f7d0d4fce41c752fc253acf30707c3be2531e - llama.cpp - Gitea - Peisong Xiao

CS348Project/llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-01 09:01:57 +00:00

Files

Pierrick Hymbert 76e868821a server: metrics: add llamacpp:prompt_seconds_total and llamacpp:tokens_predicted_seconds_total, reset bucket only on /metrics. Fix values cast to int. Add Process-Start-Time-Unix header. (#5937 )

Closes #5850

2024-03-08 12:25:04 +01:00

134 KiB

Raw Blame History

View Raw