CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-31 08:51:55 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
d008733e6b292bf110e738dfef0b5440baede986
llama.cpp/examples/parallel
History
Georgi Gerganov 4ad0676927 parallel : fix crash when -n -1
2023-09-28 15:48:38 +03:00
..
CMakeLists.txt
parallel : example for serving multiple users in parallel
2023-09-18 20:37:28 +03:00
parallel.cpp
parallel : fix crash when -n -1
2023-09-28 15:48:38 +03:00
README.md
simple : add README.md
2023-09-21 20:10:14 +02:00

README.md

llama.cpp/example/parallel

Simplified simluation for serving incoming requests in parallel

Reference in New Issue View Git Blame Copy Permalink