Xuan Son Nguyen 6e7d133a5f server : refactor multitask handling (#9274) ...

* server : remove multitask from server_task

* refactor completions handler

* fix embeddings

* use res_ok everywhere

* small change for handle_slots_action

* use unordered_set everywhere

* (try) fix test

* no more "mutable" lambda

* Apply suggestions from code review

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

* use deque

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2024-09-02 17:11:51 +02:00

132 KiB

Raw Blame History

View Raw