CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-05 09:36:52 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
1f922254f0c984a8fb9fbaa0c390d7ffae49aedb
llama.cpp/examples/server/server.cpp
Georgi Gerganov 9ca2e67762 server : add speculative decoding support (#10455) 
* server : add speculative decoding support

ggml-ci

* server : add helper function slot.can_speculate()

ggml-ci
2024-11-25 16:31:38 +02:00

138 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink