CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-03 09:22:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
e4422e299c10c7e84c8e987770ef40d31905a76b
llama.cpp/examples/common.h
eiery 10f19c1121 llama : have n_batch default to 512 (#1091) 
* set default n_batch to 512 when using BLAS

* spacing

* alternate implementation of setting different n_batch for BLAS

* set n_batch to 512 for all cases
2023-04-22 11:27:05 +03:00

3.3 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink