enginex-ascend-910-llama.cpp/examples/gguf-split/README.md

## GGUF split Example

CLI to split / merge GGUF files.

**Command line options:**

- `--split`: split GGUF to multiple GGUF, default operation.
- `--split-max-size`: max size per split in `M` or `G`, f.ex. `500M` or `2G`.
- `--split-max-tensors`: maximum tensors in each split: default(128)
- `--merge`: merge multiple GGUF to a single GGUF.
gguf-split: split and merge gguf per batch of tensors (#6135) * gguf-split: split and merge gguf files per tensor * gguf-split: build with make toolchain * gguf-split: rename `--split-tensors-size` to `--split-max-tensors`. Set general.split_count KV to all split * split : minor style + fix compile warnings * gguf-split: remove --upload not implemented --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> 2024-03-19 12:05:44 +01:00			`## GGUF split Example`

			`CLI to split / merge GGUF files.`

			`Command line options:`

			- `--split`: split GGUF to multiple GGUF, default operation.
Fix --split-max-size (#6655) * Fix --split-max-size Byte size calculation was done on int and overflowed. * add tests.sh * add examples test scripts to ci run Will autodiscover examples//tests.sh scripts and run them. move WORK_PATH to a subdirectory * clean up before and after test * explicitly define which scripts to run * add --split-max-size to readme 2024-04-14 13:12:59 +02:00			- `--split-max-size`: max size per split in `M` or `G`, f.ex. `500M` or `2G`.
gguf-split: split and merge gguf per batch of tensors (#6135) * gguf-split: split and merge gguf files per tensor * gguf-split: build with make toolchain * gguf-split: rename `--split-tensors-size` to `--split-max-tensors`. Set general.split_count KV to all split * split : minor style + fix compile warnings * gguf-split: remove --upload not implemented --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> 2024-03-19 12:05:44 +01:00			- `--split-max-tensors`: maximum tensors in each split: default(128)
			- `--merge`: merge multiple GGUF to a single GGUF.