CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-03 09:22:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
66ec3a0717e767c6773f051fcf60b876d9c253e6
llama.cpp/ggml/include/ggml-rpc.h
Radoslav Gerganov 41386cf365 rpc : report actual free memory (#16616) 
* rpc : report actual free memory

Start reporting the free memory on every device instead of using
fixed values. Now llama-cli users can get a nice memory breakdown
when using RPC devices.

* drop --mem in rpc-server
2025-10-17 18:02:52 +03:00

1.0 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink