CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-30 08:42:00 +00:00
Code Issues Packages Projects Releases Wiki Activity

readme : server compile flag (#1874)

Browse Source 
Explicitly include the server make instructions for C++ noobsl like me ;)
This commit is contained in:
Srinivas Billa
2023-06-15 18:36:38 +01:00
committed by GitHub
parent 37e257c48e
commit 9dda13e5e1
1 changed files with 4 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
examples/server/README.md
View File

@@ -16,6 +16,10 @@ This example allow you to have a llama.cpp http server to interact from a web pa
To get started right away, run the following command, making sure to use the correct path for the model you have: To get started right away, run the following command, making sure to use the correct path for the model you have:
#### Unix-based systems (Linux, macOS, etc.): #### Unix-based systems (Linux, macOS, etc.):
Make sure to build with the server option on
```bash
LLAMA_BUILD_SERVER=1 make
```
```bash ```bash
./server -m models/7B/ggml-model.bin --ctx_size 2048 ./server -m models/7B/ggml-model.bin --ctx_size 2048