Georgi Gerganov df270ef745 llama : refactor sampling v2 (#9294) ...

- Add `struct llama_sampler` and `struct llama_sampler_i`
- Add `llama_sampler_` API
- Add `llama_sampler_chain_` API for chaining multiple samplers
- Remove `LLAMA_API_INTERNAL`
- Add `llama_perf_` API and remove old `llama_print_timings` and `llama_reset_timings`

2024-09-07 15:16:19 +03:00

35 KiB

Raw Blame History

View Raw