CS348Project/llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-30 08:42:00 +00:00

Files

Richard Kiss 9494d7c477 english : use typos to fix comments and logs (#4354 )

2023-12-12 11:53:36 +02:00

195 B

Raw Permalink Blame History

llama.cpp/examples/lookahead

Demonstration of lookahead decoding technique:

https://lmsys.org/blog/2023-11-21-lookahead-decoding/

More info: https://github.com/ggerganov/llama.cpp/pull/4207