Radoslav Gerganov 41386cf365 rpc : report actual free memory (#16616) ...

* rpc : report actual free memory

Start reporting the free memory on every device instead of using
fixed values. Now llama-cli users can get a nice memory breakdown
when using RPC devices.

* drop --mem in rpc-server

2025-10-17 18:02:52 +03:00

11 KiB

Raw Blame History

View Raw