llama.cpp/examples/common.h at e435bfd93cbc03970450486c4ea526a0fa5aa7f6

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-01 09:01:57 +00:00

Files

eiery 10f19c1121 llama : have n_batch default to 512 (#1091 )

* set default n_batch to 512 when using BLAS

* spacing

* alternate implementation of setting different n_batch for BLAS

* set n_batch to 512 for all cases

2023-04-22 11:27:05 +03:00

3.3 KiB

Raw Blame History

View Raw

3.3 KiB Raw Blame History

3.3 KiB

Raw Blame History