llama.cpp/examples/parallel at fa0e67782086a19d47f327d51a4be14a45e4b891 - llama.cpp - Gitea - Peisong Xiao

CS348Project/llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-31 08:51:55 +00:00

Files

History

Georgi Gerganov fa0e677820 llama : extend batch API to select which logits to output

2023-09-19 00:24:13 +03:00

..

CMakeLists.txt

parallel : example for serving multiple users in parallel

2023-09-18 20:37:28 +03:00

parallel.cpp

llama : extend batch API to select which logits to output

2023-09-19 00:24:13 +03:00