llama.cpp/examples/common.h at c6524f46eb93fdb949330293a8469fd70080bd5a

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-31 08:51:55 +00:00

Files

eiery 10f19c1121 llama : have n_batch default to 512 (#1091 )

* set default n_batch to 512 when using BLAS

* spacing

* alternate implementation of setting different n_batch for BLAS

* set n_batch to 512 for all cases

2023-04-22 11:27:05 +03:00

3.3 KiB

Raw Blame History

View Raw

3.3 KiB Raw Blame History

3.3 KiB

Raw Blame History