WIP: backend-dev #1

peisongxiao · 2025-10-14T06:05:13Z

peisongxiao commented

2025-10-14 06:05:13 +00:00

Minimal working version of the backend, wait until future commits for more detailed README.

For now, to run:

Build llama.cpp (we need llama-server)
Run llama-server with: ./llama-server -t <num-of-threads-to-use> -m <gguf-model-file> --port 8081 -n <num-of-tk-to-predict>
Run the go backend with go run main.go
Use the python cli with python3 cli.py or ./cli.py

Minimal working version of the backend, wait until future commits for more detailed README. For now, to run: 1. Build llama.cpp (we need llama-server) 2. Run llama-server with: `./llama-server -t <num-of-threads-to-use> -m <gguf-model-file> --port 8081 -n <num-of-tk-to-predict>` 3. Run the go backend with `go run main.go` 4. Use the python cli with `python3 cli.py` or `./cli.py`

peisongxiao added 4 commits 2025-10-14 06:05:13 +00:00

Added code for backend glue 29a451ab58

cleaned file tree structure 839f0c9107

minimal working version of backend and cli 2fdb1ece43

cleaned files c04536d5f6

peisongxiao requested review from AndyLiu 2025-10-14 06:05:14 +00:00

peisongxiao requested review from AngelinaLiang 2025-10-14 06:05:14 +00:00

peisongxiao requested review from jinfeng 2025-10-14 06:05:14 +00:00

peisongxiao requested review from RockCui 2025-10-14 06:05:14 +00:00

peisongxiao changed title from ~~backend-dev~~ to WIP: backend-dev

2025-10-14 06:06:02 +00:00

peisongxiao commented