llama.cpp/examples/speculative/speculative.cpp at 71e3718abdb2771b50c9606d3a7569623a0b0afe

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-31 08:51:55 +00:00

Files

Georgi Gerganov ee1a0ec9cb llama : add option for greedy sampling with probs (#3813 )

* llama : add option for greedy sampling with probs

* llama : add comment about llama_sample_token_greedy() missing probs

* sampling : temp == 0.0 -> no probs, temp < 0.0 -> probs

2023-10-28 14:23:11 +03:00

15 KiB

Raw Blame History

View Raw

15 KiB Raw Blame History

15 KiB

Raw Blame History