Georgi Gerganov 52531fdff8 main : add self-extend support (#4815) ...

* examples : add passkey test

* passkey : better prints

* passkey : select pass key pos from CLI

* passkey : simplify n_past logic

* llama : "self-extend"-like context extension

* passkey : add comment

* main : add Self-Extend support

* llama : add comment about llama_kv_cache_seq_div

2024-01-08 11:18:32 +02:00

36 KiB

Raw Blame History

View Raw