llama.cpp/examples/speculative/speculative.cpp at c43c2da8afacaddfe51c09b21dbd9922cd0ea46b

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-03 09:22:01 +00:00

Files

Georgi Gerganov ee1a0ec9cb llama : add option for greedy sampling with probs (#3813 )

* llama : add option for greedy sampling with probs

* llama : add comment about llama_sample_token_greedy() missing probs

* sampling : temp == 0.0 -> no probs, temp < 0.0 -> probs

2023-10-28 14:23:11 +03:00

15 KiB

Raw Blame History

View Raw

15 KiB Raw Blame History

15 KiB

Raw Blame History