llama.cpp/examples/parallel at daf4c6d360b8883ea294d7a858991d0411e898c3 - llama.cpp - Gitea - Peisong Xiao

CS348Project/llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-02 09:12:03 +00:00

Files

History

Georgi Gerganov fa0e677820 llama : extend batch API to select which logits to output

2023-09-19 00:24:13 +03:00

..

CMakeLists.txt

parallel : example for serving multiple users in parallel

2023-09-18 20:37:28 +03:00

parallel.cpp

llama : extend batch API to select which logits to output

2023-09-19 00:24:13 +03:00