CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-14 11:07:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
374fe09cdd4a9d7ebaec6fde87ac2b9b75f019c4
llama.cpp/tools/server/server.cpp
Xuan-Son Nguyen 00c94083b3 server: (refactor) implement generator-based API for task results (#17174) 
* server: (refactor) implement generator-based API for task results

* improve

* moving some code

* fix "Response ended prematurely"

* add sink.done before return false

* rm redundant check

* rm unused var

* rename generator --> reader
2025-11-12 18:50:52 +01:00

232 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink