Tobias Lütke 31cfbb1013 Expose generation timings from server & update completions.js (#2116) ...

* use javascript generators as much cleaner API

Also add ways to access completion as promise and EventSource

* export llama_timings as struct and expose them in server

* update readme, update baked includes

* llama : uniform variable names + struct init

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2023-07-05 16:51:13 -04:00

27 KiB

Raw Blame History

View Raw