CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-03 09:22:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
7a3895641c80f52c56d1cab3088f9dbabcec2fe9
llama.cpp/examples/server/server.cpp
Tobias Lütke 7a3895641c allow server to multithread 
because web browsers send a lot of garbage requests we want the server
to multithread when serving 404s for favicon's etc. To avoid blowing up
llama we just take a mutex when it's invoked.
2023-07-04 09:14:49 -04:00

42 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink