CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-27 08:21:30 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
b6791
llama.cpp/ggml
History
Radoslav Gerganov 41386cf365 rpc : report actual free memory (#16616) 
* rpc : report actual free memory

Start reporting the free memory on every device instead of using
fixed values. Now llama-cli users can get a nice memory breakdown
when using RPC devices.

* drop --mem in rpc-server
2025-10-17 18:02:52 +03:00
..
cmake
ggml: Skip backend library linking code when GGML_BACKEND_DL=ON (#15094)
2025-08-07 13:45:41 +02:00
include
rpc : report actual free memory (#16616)
2025-10-17 18:02:52 +03:00
src
rpc : report actual free memory (#16616)
2025-10-17 18:02:52 +03:00
.gitignore
vulkan : cmake integration (#8119)
2024-07-13 18:12:39 +02:00
CMakeLists.txt
ggml webgpu: profiling, CI updates, reworking of command submission (#16452)
2025-10-07 13:48:56 -07:00