CS348Project/cs348project
5
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

modified README for backend

Browse Source
This commit is contained in:
Peisong Xiao
2025-10-20 23:27:12 -04:00
parent 9c816df616
commit 833ce512a6
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
backend/README.md
View File

@@ -5,7 +5,7 @@ Below will setup the backend including the `go` orchestration layer
and a `llama.cpp` inference server on `localhost:8081` and and a `llama.cpp` inference server on `localhost:8081` and
`localhost:8080` for local testing. `localhost:8080` for local testing.
### Building `llama.cpp` ### Building `llama.cpp`
In `$REPO/third_party/llama.cpp` run `make` to build. See documentation for `llama.cpp` for details.
### Running `llama.cpp` ### Running `llama.cpp`
#### Getting a `GGUF` format model #### Getting a `GGUF` format model