CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-19 11:57:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
2ddd9681d662df23b8bb3e2399c1be3097e066f6
llama.cpp/examples/server/api_like_OAI.py
jwj7140 f257fd2550 Add an API example using server.cpp similar to OAI. (#2009) 
* add api_like_OAI.py
* add evaluated token count to server
* add /v1/ endpoints binding
2023-07-04 21:06:12 +03:00

9.5 KiB
Executable File
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink