CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-30 08:42:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
97c1549808d2742d37584a3c9df28154bdf34417
llama.cpp/examples/server/server.cpp
Xuan Son Nguyen 821f0a271e server : defer tasks when "slot unavailable" (#5018) 
* server: defer task when no slot is available

* remove unnecessary log

---------

Co-authored-by: Xuan Son Nguyen <xuanson.nguyen@snowpack.eu>
2024-01-18 22:33:05 +02:00

123 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink