llama.cpp/examples/speculative/README.md at b32efad2bc42460637c3a364c9554ea8217b3d7f - llama.cpp - Gitea - Peisong Xiao

CS348Project/llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-03 09:22:01 +00:00

Files

Georgi Gerganov 68ff663a04 repo : update links to new url (#11886 )

* repo : update links to new url

ggml-ci

* cont : more urls

ggml-ci

2025-02-15 16:40:57 +02:00

10 lines

282 B

Markdown

Raw Blame History

 # llama.cpp/examples/speculative
 Demonstration of speculative decoding and tree-based speculative decoding techniques
 More info:
 - https://github.com/ggml-org/llama.cpp/pull/2926
 - https://github.com/ggml-org/llama.cpp/pull/3624
 - https://github.com/ggml-org/llama.cpp/pull/5625