Johannes Gäßler
|
e81b8e4b7f
|
llama: use FA + max. GPU layers by default (#15434)
* llama: use max. GPU layers by default, auto -fa
* ggml-backend: abort instead of segfault
|
2025-08-30 16:32:10 +02:00 |
|
Johannes Gäßler
|
4850b52aed
|
server-bench: external OAI servers, sqlite (#15179)
* server-bench: external OAI servers, sqlite
* Update scripts/server-bench.py
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
* Update scripts/server-bench.py
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
* Update scripts/server-bench.py
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
* raise_for_status
---------
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
|
2025-08-08 23:04:36 +02:00 |
|
Johannes Gäßler
|
bbd0f91779
|
server-bench: make seed choice configurable (#14929)
* server-bench: make seed choice configurable
* Update scripts/server-bench.py
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
* Update scripts/server-bench.py
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
* fix error formatting
* Update scripts/server-bench.py
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
---------
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
|
2025-07-29 10:40:50 +02:00 |
|
Johannes Gäßler
|
5cae766541
|
scripts: synthetic prompt mode for server-bench.py (#14695)
|
2025-07-16 09:33:28 +02:00 |
|
Johannes Gäßler
|
494c5899cb
|
scripts: benchmark for HTTP server throughput (#14668)
* scripts: benchmark for HTTP server throughput
* fix server connection reset
|
2025-07-14 13:14:30 +02:00 |
|