llama.cpp/tools/server/server.cpp at ffb6f3d921bbc64d559164e23671a710a4dd9de5

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-15 11:17:31 +00:00

Files

Xuan-Son Nguyen 00c94083b3 server: (refactor) implement generator-based API for task results (#17174 )

* server: (refactor) implement generator-based API for task results

* improve

* moving some code

* fix "Response ended prematurely"

* add sink.done before return false

* rm redundant check

* rm unused var

* rename generator --> reader

2025-11-12 18:50:52 +01:00

232 KiB

Raw Blame History

View Raw

232 KiB Raw Blame History

232 KiB

Raw Blame History