mirror of
https://github.com/ggml-org/llama.cpp.git
synced 2025-11-03 09:22:01 +00:00
1d36b3670b
* llama : move end-user examples to tools directory --------- Co-authored-by: Xuan Son Nguyen <son@huggingface.co>
11 lines
343 B
Markdown
11 lines
343 B
Markdown
## GGUF split Example
|
|
|
|
CLI to split / merge GGUF files.
|
|
|
|
**Command line options:**
|
|
|
|
- `--split`: split GGUF to multiple GGUF, default operation.
|
|
- `--split-max-size`: max size per split in `M` or `G`, f.ex. `500M` or `2G`.
|
|
- `--split-max-tensors`: maximum tensors in each split: default(128)
|
|
- `--merge`: merge multiple GGUF to a single GGUF.
|