Bach Le c9c74b4e3f llama : add classifier-free guidance (#2135) ...

* Initial implementation

* Remove debug print

* Restore signature of llama_init_from_gpt_params

* Free guidance context

* Make freeing of guidance_ctx conditional

* Make Classifier-Free Guidance a sampling function

* Correct typo. CFG already means context-free grammar.

* Record sampling time in llama_sample_classifier_free_guidance

* Shift all values by the max value before applying logsoftmax

* Fix styling based on review

2023-07-11 19:18:43 +03:00

5.9 KiB

Raw Blame History

View Raw