CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-27 08:21:30 +00:00
Code Issues Packages Projects Releases Wiki Activity

server : enable /slots by default and make it secure (#15630)

Browse Source 
* server : enable /slots by default and make it secure

ggml-ci

* server : fix tests to pass `--no-slots` when necessary

* server : extend /props with info about enabled endpoints
This commit is contained in:
Georgi Gerganov
2025-08-31 20:11:58 +03:00
committed by GitHub
parent 4efd5a8316
commit 0d161f021a
5 changed files with 200 additions and 47 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
tools/server/tests/utils.py
View File

@@ -148,6 +148,8 @@ class ServerProcess:
server_args.append("--metrics")
if self.server_slots:
server_args.append("--slots")
else:
server_args.append("--no-slots")
if self.pooling:
server_args.extend(["--pooling", self.pooling])
if self.model_alias: