commit dcedf62838202390f04ee2a5afb0d95ad868bd60 Author: ModelHub XC Date: Sun Jun 14 13:46:16 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: adilkairolla/zeta-2.1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..feac63d --- /dev/null +++ b/.gitattributes @@ -0,0 +1,39 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +zeta-2.1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +zeta-2.1-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +zeta-2.1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +zeta-2.1-f16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..5c0ef3a --- /dev/null +++ b/README.md @@ -0,0 +1,112 @@ +--- +base_model: zed-industries/zeta-2.1 +base_model_relation: quantized +quantized_by: adilkairolla +license: apache-2.0 +library_name: gguf +pipeline_tag: text-generation +tags: + - gguf + - llama.cpp + - quantized + - edit-prediction + - next-edit-suggestion + - code +language: + - en +--- + +# Zeta 2.1 — GGUF + +GGUF quantizations of [`zed-industries/zeta-2.1`](https://huggingface.co/zed-industries/zeta-2.1), a code edit prediction (next-edit suggestion) model from [Zed Industries](https://zed.dev). + +These files were produced from the original BF16 safetensors using [llama.cpp `b9085`](https://github.com/ggml-org/llama.cpp/releases/tag/b9085) (`convert_hf_to_gguf.py` → `llama-quantize`). No fine-tuning or weight modification beyond format conversion and quantization. + +## Files + +| Quant | Size | Notes | +|-----------|-------:|-----------------------------------------------------------------------| +| `Q4_K_M` | 4.8 GB | Smallest, recommended default for CPU / 8 GB-class GPUs. | +| `Q5_K_M` | 5.5 GB | Quality / size sweet spot. | +| `Q8_0` | 8.2 GB | Near-lossless vs. the original BF16 weights. | +| `f16` | 16 GB | Reference. Useful as the source for further quantization. | + +## Quickstart + +### Ollama + +```bash +ollama pull hf.co/adilkairolla/zeta-2.1-GGUF:Q4_K_M +``` + +Replace the tag with `Q5_K_M`, `Q8_0`, or `f16` for a different quant. Zeta is a code-edit-prediction model (not a chat model) — call it via `/api/generate` with the FIM prompt below, **not** via `/api/chat`. + +### LM Studio + +Search for `adilkairolla/zeta-2.1-GGUF` in the model browser and pick a quant. LM Studio loads it as a base completion model. + +### llama.cpp + +```bash +# One-shot completion (correct binary for non-chat models) +./llama-completion -m zeta-2.1-Q4_K_M.gguf -p "$(cat your-prompt.txt)" -n 256 -c 4096 +``` + +### llama-cpp-python + +```python +from llama_cpp import Llama +llm = Llama(model_path="zeta-2.1-Q4_K_M.gguf", n_ctx=4096) +out = llm(prompt, max_tokens=256, stop=["<|marker_2|>"], echo=False) +print(out["choices"][0]["text"]) +``` + +## Prompt format + +Zeta uses a Suffix-Prefix-Middle (SPM) FIM format with numbered region markers. Quoting the upstream model card: + +``` +<[fim-suffix]> +code after editable region +<[fim-prefix]>related/file.py +related file content + +edit_history +--- a/some_file.py ++++ b/some_file.py +-old ++new + +path/to/target_file.py +code before editable region +<|marker_1|> +code that +needs to<|user_cursor|> +be rewritten +<|marker_2|> +<[fim-middle]> +``` + +Expected output: + +``` +<|marker_1|> +revised content for +the editable region +<|marker_2|> +``` + +See the upstream [`sample.prompt`](https://huggingface.co/zed-industries/zeta-2.1/blob/main/sample.prompt) and [`sample.output`](https://huggingface.co/zed-industries/zeta-2.1/blob/main/sample.output) for a real example. + +## Source & lineage + +- **Quantized from:** [`zed-industries/zeta-2.1`](https://huggingface.co/zed-industries/zeta-2.1) (BF16 safetensors) +- **Fine-tuned from:** [`ByteDance-Seed/Seed-Coder-8B-Base`](https://huggingface.co/ByteDance-Seed/Seed-Coder-8B-Base) +- **Architecture:** Llama (32 layers, hidden 4096, 32 heads, 8 KV heads, vocab 155136, RoPE θ 500000, ctx 32768) +- **Conversion tool:** llama.cpp `b9085` + +## License + +Released under the [Apache License 2.0](https://www.apache.org/licenses/LICENSE-2.0), inherited from the upstream model. The only modification relative to upstream is the conversion to GGUF and quantization to the formats listed above. + +All credit for the model itself goes to Zed Industries and ByteDance-Seed. This repo is an unaffiliated quantization mirror. diff --git a/zeta-2.1-Q4_K_M.gguf b/zeta-2.1-Q4_K_M.gguf new file mode 100644 index 0000000..2219260 --- /dev/null +++ b/zeta-2.1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5462b0f5d0c1697951dba7d4a0a62bfe3f5b8d61a36d589814796f8ad04110b5 +size 5071409664 diff --git a/zeta-2.1-Q5_K_M.gguf b/zeta-2.1-Q5_K_M.gguf new file mode 100644 index 0000000..9616218 --- /dev/null +++ b/zeta-2.1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a85485f708ed387b03c493b39eaf26503d210b59b35f99d8e339db2e0fe21ee5 +size 5897425408 diff --git a/zeta-2.1-Q8_0.gguf b/zeta-2.1-Q8_0.gguf new file mode 100644 index 0000000..af49699 --- /dev/null +++ b/zeta-2.1-Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f007f07ffd631d7e159cce88c94d1211ca6486a3659f754352f1dd1ff1aaeb93 +size 8773161472 diff --git a/zeta-2.1-f16.gguf b/zeta-2.1-f16.gguf new file mode 100644 index 0000000..c400298 --- /dev/null +++ b/zeta-2.1-f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3138196d2ec911006a8e46d25a0734ca74cabfd68b1af0cb9409c5a9337283f8 +size 16507720192