slaren 1123f7fbdf ggml-cuda : use graph allocator (#2684) ...

use a different function for no_alloc to avoid breaking backwards compat, fixes lora

remove 512 n_batch limit

fixed 2048 batch size

cleanup

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

2023-08-22 15:25:19 +02:00

1.5 KiB

Raw Blame History

View Raw