CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-15 11:17:31 +00:00
Code Issues Packages Projects Releases Wiki Activity

ci : add 7B CUDA tests (#2319)

Browse Source 
* ci : add 7B CUDA tests

ggml-ci

* ci : add Q2_K to the tests

* ci : bump CUDA ppl chunks

ggml-ci

* ci : increase CUDA TG len + add --ignore-eos

* ci : reduce CUDA ppl cunks down to 4 to save time
This commit is contained in:
Georgi Gerganov
2023-07-22 11:48:22 +03:00
committed by GitHub
parent 7d5f18468c
commit 5d500e8ccf
2 changed files with 168 additions and 16 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
ci/README.md
View File

@@ -16,5 +16,10 @@ It is a good practice, before publishing changes to execute the full CI locally
```bash
mkdir tmp
# CPU-only build
bash ./ci/run.sh ./tmp/results ./tmp/mnt
# with CUDA support
GG_BUILD_CUDA=1 bash ./ci/run.sh ./tmp/results ./tmp/mnt
```