Radoslav Gerganov 898acba681 rpc : add support for multiple devices (#16276) ...

* rpc : add support for multiple devices

Allow rpc-server to expose multiple devices from a single endpoint.
Change RPC protocol to include device identifier where needed.

closes: #15210

* fixes

* use ggml_backend_reg_t

* address review comments

* fix llama-bench backend report

* address review comments, change device naming

* fix cmd order

2025-10-04 12:49:16 +03:00

..

batched-bench

cmake : Do not install tools on iOS targets (#15903)

2025-09-16 09:54:44 +07:00

cvector-generator

cmake : Do not install tools on iOS targets (#15903)

2025-09-16 09:54:44 +07:00

export-lora

cmake : Do not install tools on iOS targets (#15903)

2025-09-16 09:54:44 +07:00

gguf-split

ci : use smaller model (#16168)

2025-09-22 09:11:39 +03:00

imatrix

cmake : Do not install tools on iOS targets (#15903)

2025-09-16 09:54:44 +07:00

llama-bench

rpc : add support for multiple devices (#16276)

2025-10-04 12:49:16 +03:00

main

llama-cli: prevent spurious assistant token (#16202)

2025-09-29 10:03:12 +03:00

mtmd

mtmd : fix uninitialized variable in bicubic_resize (#16275)

2025-09-26 15:00:44 +02:00

perplexity

perplexity : show more kl-divergence data (#16321)

2025-09-29 09:30:45 +03:00

quantize

ci : use smaller model (#16168)

2025-09-22 09:11:39 +03:00

rpc

rpc : add support for multiple devices (#16276)

2025-10-04 12:49:16 +03:00

run

common: introduce http.h for httplib-based client (#16373)

2025-10-01 20:22:18 +03:00

server

server : context checkpointing for hybrid and recurrent models (#16382)

2025-10-03 21:34:51 +03:00

tokenize

cmake : Do not install tools on iOS targets (#15903)

2025-09-16 09:54:44 +07:00

tts

model : Apertus model implementation (#15852)

2025-10-02 20:43:22 +03:00

CMakeLists.txt

mtmd : rename llava directory to mtmd (#13311)

2025-05-05 16:02:55 +02:00