CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-30 08:42:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
bec2183f2c8d37cf1278c11d1adb9311e9eaa242
llama.cpp/examples/run/run.cpp
Eric Curtin dc7cef9f37 llama-run : fix context size (#11094) 
Set `n_ctx` equal to `n_batch` in `Opt` class. Now context size is
a more reasonable 2048.

Signed-off-by: Eric Curtin <ecurtin@redhat.com>
2025-01-06 23:45:28 +01:00

31 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink