bartowski/zed-industries_zeta-2-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: bartowski/zed-industries_zeta-2-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-05 18:59:13 +08:00
commit 1a2202c35e
28 changed files with 328 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

73
.gitattributes vendored Normal file
View File

@@ -0,0 +1,73 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bin.* filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zstandard filter=lfs diff=lfs merge=lfs -text
*.tfevents* filter=lfs diff=lfs merge=lfs -text
*.db* filter=lfs diff=lfs merge=lfs -text
*.ark* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ggml filter=lfs diff=lfs merge=lfs -text
*.llamafile* filter=lfs diff=lfs merge=lfs -text
*.pt2 filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-bf16.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-Q3_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-Q2_K_L.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-Q5_K_L.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-Q4_K_L.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-Q6_K_L.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
zed-industries_zeta-2-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text

179
README.md Normal file
View File

@@ -0,0 +1,179 @@
---
quantized_by: bartowski
pipeline_tag: text-generation
base_model: zed-industries/zeta-2
base_model_relation: quantized
tags:
- text-generation-inference
- transformers
- edit-prediction
- next-edit-suggestion
license: apache-2.0
language:
- en
---
## Llamacpp imatrix Quantizations of zeta-2 by zed-industries
Using <a href="https://github.com/ggml-org/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggml-org/llama.cpp/releases/tag/b8457">b8457</a> for quantization.
Original model: https://huggingface.co/zed-industries/zeta-2
All quants made using imatrix option with dataset from [here](https://gist.github.com/bartowski1182/82ae9b520227f57d79ba04add13d0d0d)
Run them in your choice of tools:
- [llama.cpp](https://github.com/ggml-org/llama.cpp)
- [LM Studio](https://lmstudio.ai/)
- [koboldcpp](https://github.com/LostRuins/koboldcpp)
- [Jan AI](https://www.jan.ai/)
- [Text Generation Web UI](https://github.com/oobabooga/text-generation-webui)
- [LoLLMs](https://github.com/ParisNeo/lollms)
Note: if it's a newly supported model, you may need to wait for an update from the developers.
## Prompt format
No prompt format found, check original model page
## Download a file (not the whole branch) from below:
| Filename | Quant type | File Size | Split | Description |
| -------- | ---------- | --------- | ----- | ----------- |
| [zeta-2-bf16.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-bf16.gguf) | bf16 | 16.51GB | false | Full BF16 weights. |
| [zeta-2-Q8_0.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-Q8_0.gguf) | Q8_0 | 8.77GB | false | Extremely high quality, generally unneeded but max available quant. |
| [zeta-2-Q6_K_L.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-Q6_K_L.gguf) | Q6_K_L | 7.33GB | false | Uses Q8_0 for embed and output weights. Very high quality, near perfect, *recommended*. |
| [zeta-2-Q6_K.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-Q6_K.gguf) | Q6_K | 7.02GB | false | Very high quality, near perfect, *recommended*. |
| [zeta-2-Q5_K_L.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-Q5_K_L.gguf) | Q5_K_L | 6.41GB | false | Uses Q8_0 for embed and output weights. High quality, *recommended*. |
| [zeta-2-Q5_K_M.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-Q5_K_M.gguf) | Q5_K_M | 6.02GB | false | High quality, *recommended*. |
| [zeta-2-Q5_K_S.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-Q5_K_S.gguf) | Q5_K_S | 5.80GB | false | High quality, *recommended*. |
| [zeta-2-Q4_K_L.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-Q4_K_L.gguf) | Q4_K_L | 5.70GB | false | Uses Q8_0 for embed and output weights. Good quality, *recommended*. |
| [zeta-2-Q4_1.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-Q4_1.gguf) | Q4_1 | 5.34GB | false | Legacy format, similar performance to Q4_K_S but with improved tokens/watt on Apple silicon. |
| [zeta-2-Q4_K_M.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-Q4_K_M.gguf) | Q4_K_M | 5.22GB | false | Good quality, default size for most use cases, *recommended*. |
| [zeta-2-Q3_K_XL.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-Q3_K_XL.gguf) | Q3_K_XL | 5.05GB | false | Uses Q8_0 for embed and output weights. Lower quality but usable, good for low RAM availability. |
| [zeta-2-Q4_K_S.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-Q4_K_S.gguf) | Q4_K_S | 4.92GB | false | Slightly lower quality with more space savings, *recommended*. |
| [zeta-2-IQ4_NL.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-IQ4_NL.gguf) | IQ4_NL | 4.92GB | false | Similar to IQ4_XS, but slightly larger. Offers online repacking for ARM CPU inference. |
| [zeta-2-Q4_0.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-Q4_0.gguf) | Q4_0 | 4.90GB | false | Legacy format, offers online repacking for ARM and AVX CPU inference. |
| [zeta-2-IQ4_XS.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-IQ4_XS.gguf) | IQ4_XS | 4.69GB | false | Decent quality, smaller than Q4_K_S with similar performance, *recommended*. |
| [zeta-2-Q3_K_L.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-Q3_K_L.gguf) | Q3_K_L | 4.50GB | false | Lower quality but usable, good for low RAM availability. |
| [zeta-2-Q3_K_M.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-Q3_K_M.gguf) | Q3_K_M | 4.27GB | false | Low quality. |
| [zeta-2-Q2_K_L.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-Q2_K_L.gguf) | Q2_K_L | 4.06GB | false | Uses Q8_0 for embed and output weights. Very low quality but surprisingly usable. |
| [zeta-2-IQ3_M.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-IQ3_M.gguf) | IQ3_M | 4.04GB | false | Medium-low quality, new method with decent performance comparable to Q3_K_M. |
| [zeta-2-Q3_K_S.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-Q3_K_S.gguf) | Q3_K_S | 3.91GB | false | Low quality, not recommended. |
| [zeta-2-IQ3_XS.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-IQ3_XS.gguf) | IQ3_XS | 3.79GB | false | Lower quality, new method with decent performance, slightly better than Q3_K_S. |
| [zeta-2-IQ3_XXS.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-IQ3_XXS.gguf) | IQ3_XXS | 3.56GB | false | Lower quality, new method with decent performance, comparable to Q3 quants. |
| [zeta-2-Q2_K.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-Q2_K.gguf) | Q2_K | 3.44GB | false | Very low quality but surprisingly usable. |
| [zeta-2-IQ2_M.gguf](https://huggingface.co/bartowski/zed-industries_zeta-2-GGUF/blob/main/zed-industries_zeta-2-IQ2_M.gguf) | IQ2_M | 3.38GB | false | Relatively low quality, uses SOTA techniques to be surprisingly usable. |
## Embed/output weights
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.
## Downloading using huggingface-cli
<details>
<summary>Click to view download instructions</summary>
First, make sure you have hugginface-cli installed:
```
pip install -U "huggingface_hub[cli]"
```
Then, you can target the specific file you want:
```
huggingface-cli download bartowski/zed-industries_zeta-2-GGUF --include "zed-industries_zeta-2-Q4_K_M.gguf" --local-dir ./
```
If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:
```
huggingface-cli download bartowski/zed-industries_zeta-2-GGUF --include "zed-industries_zeta-2-Q8_0/*" --local-dir ./
```
You can either specify a new local-dir (zed-industries_zeta-2-Q8_0) or download them all in place (./)
</details>
## ARM/AVX information
Previously, you would download Q4_0_4_4/4_8/8_8, and these would have their weights interleaved in memory in order to improve performance on ARM and AVX machines by loading up more data in one pass.
Now, however, there is something called "online repacking" for weights. details in [this PR](https://github.com/ggml-org/llama.cpp/pull/9921). If you use Q4_0 and your hardware would benefit from repacking weights, it will do it automatically on the fly.
As of llama.cpp build [b4282](https://github.com/ggml-org/llama.cpp/releases/tag/b4282) you will not be able to run the Q4_0_X_X files and will instead need to use Q4_0.
Additionally, if you want to get slightly better quality for , you can use IQ4_NL thanks to [this PR](https://github.com/ggml-org/llama.cpp/pull/10541) which will also repack the weights for ARM, though only the 4_4 for now. The loading time may be slower but it will result in an overall speed incrase.
<details>
<summary>Click to view Q4_0_X_X information (deprecated</summary>
I'm keeping this section to show the potential theoretical uplift in performance from using the Q4_0 with online repacking.
<details>
<summary>Click to view benchmarks on an AVX2 system (EPYC7702)</summary>
| model | size | params | backend | threads | test | t/s | % (vs Q4_0) |
| ------------------------------ | ---------: | ---------: | ---------- | ------: | ------------: | -------------------: |-------------: |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp512 | 204.03 ± 1.03 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp1024 | 282.92 ± 0.19 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp2048 | 259.49 ± 0.44 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg128 | 39.12 ± 0.27 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg256 | 39.31 ± 0.69 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg512 | 40.52 ± 0.03 | 100% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp512 | 301.02 ± 1.74 | 147% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp1024 | 287.23 ± 0.20 | 101% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp2048 | 262.77 ± 1.81 | 101% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg128 | 18.80 ± 0.99 | 48% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg256 | 24.46 ± 3.04 | 83% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg512 | 36.32 ± 3.59 | 90% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp512 | 271.71 ± 3.53 | 133% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp1024 | 279.86 ± 45.63 | 100% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp2048 | 320.77 ± 5.00 | 124% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg128 | 43.51 ± 0.05 | 111% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg256 | 43.35 ± 0.09 | 110% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg512 | 42.60 ± 0.31 | 105% |
Q4_0_8_8 offers a nice bump to prompt processing and a small bump to text generation
</details>
</details>
## Which file should I choose?
<details>
<summary>Click here for details</summary>
A great write up with charts showing various performances is provided by Artefact2 [here](https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9)
The first thing to figure out is how big a model you can run. To do this, you'll need to figure out how much RAM and/or VRAM you have.
If you want your model running as FAST as possible, you'll want to fit the whole thing on your GPU's VRAM. Aim for a quant with a file size 1-2GB smaller than your GPU's total VRAM.
If you want the absolute maximum quality, add both your system RAM and your GPU's VRAM together, then similarly grab a quant with a file size 1-2GB Smaller than that total.
Next, you'll need to decide if you want to use an 'I-quant' or a 'K-quant'.
If you don't want to think too much, grab one of the K-quants. These are in format 'QX_K_X', like Q5_K_M.
If you want to get more into the weeds, you can check out this extremely useful feature chart:
[llama.cpp feature matrix](https://github.com/ggml-org/llama.cpp/wiki/Feature-matrix)
But basically, if you're aiming for below Q4, and you're running cuBLAS (Nvidia) or rocBLAS (AMD), you should look towards the I-quants. These are in format IQX_X, like IQ3_M. These are newer and offer better performance for their size.
These I-quants can also be used on CPU, but will be slower than their K-quant equivalent, so speed vs performance is a tradeoff you'll have to decide.
</details>
## Credits
Thank you kalomaze and Dampf for assistance in creating the imatrix calibration dataset.
Thank you ZeroWw for the inspiration to experiment with embed/output.
Thank you to LM Studio for sponsoring my work.
Want to support my work? Visit my ko-fi page here: https://ko-fi.com/bartowski

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}

3
zed-industries_zeta-2-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:77cb903bbb0303db13dcb766e8584213e9f4c00d4947924603dd23c6634e255a
size 3377992448

3
zed-industries_zeta-2-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:33f7c9600488b85aeeeafb10ef2132944124ebb84be0022ad13e6764e42540f7
size 4042511104

3
zed-industries_zeta-2-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f9c70fbb026e134205e6e1950e40a7db3fa38ee68595b9547e1c724343349e34
size 3791115008

3
zed-industries_zeta-2-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e7fb32998cf04b55148517c6fa77dbeb2a5dbb98d7f8b1b381f43384af3db53d
size 3555726080

3
zed-industries_zeta-2-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:048b8057fc619a8d2e53edb2ebe77b0483d10cda6810a6e1ef36629f983aae55
size 4915696384

3
zed-industries_zeta-2-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:053fcab6f18d28ed06e4b203c4b1038f05d529a5c8465226dda5686357715d1d
size 4690318080

3
zed-industries_zeta-2-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:41df99232e886e914b0c6d8df14d895825f5e9968b118f56f4abc606a880dd58
size 3436122880

3
zed-industries_zeta-2-Q2_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4b852ca184057ce66d058eb7aa27b77f38c32be3f76e27ba8f25a1f4e7107a6
size 4056666880

3
zed-industries_zeta-2-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f038631209a705887550cedc24dbda5e8d73de4679ac86d1bd86269ff3f69835
size 4495758080

3
zed-industries_zeta-2-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a1daacc3f4b6f9a1a0da971b31fe05130d24991a3c67028a5843af6e25f5b053
size 4267168512

3
zed-industries_zeta-2-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:56260f84b6ead1c3cf9001ca10f91d7a9fd98fdc69eee15231266d264dc776ad
size 3905409792

3
zed-industries_zeta-2-Q3_K_XL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ec85e73604445962b128b183fe17e3ca50da0e542dabe214c4774fb03fad78e2
size 5051765504

3
zed-industries_zeta-2-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9c4b49b500ca91b341d4f6b7777fdfd4234c3dd0426a296cf015b9198180341b
size 4895773440

3
zed-industries_zeta-2-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4db98867f49588d82e8d4ba7e95e78f902cb7dc59b40efaf6cfdd773d3df564d
size 5340238592

3
zed-industries_zeta-2-Q4_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:994991f5c6af903d50bbbf8a8de1b80aceb6788b8772b816173b30a1ff8ea725
size 5696115456

3
zed-industries_zeta-2-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bd3b690ab20a7169b0417d86edfc1e8ae9bb09ff58e5d20a3658ad1a308edbac
size 5224502016

3
zed-industries_zeta-2-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f27bb8f06a7cd29270e6b43c2b2feca67f06c141b5333dd7c4aba9e930e7ea28
size 4918842112

3
zed-industries_zeta-2-Q5_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:075a3999ab05eb395a31b0c0093d66d1d759ec8fd91645b55f120ff23dfd57d5
size 6414390016

3
zed-industries_zeta-2-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d741d36ee5cd3ba56f99684ad015fc03dd44e7ad7556bb9bfcf8acadba0259d2
size 6022206208

3
zed-industries_zeta-2-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c784e5747fff83aa6db369ae398d7ca7ebc674f253e90554347f08b378b811cc
size 5799383808

3
zed-industries_zeta-2-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ce25efd17d444c7734f252b0fc31b4a30287024c7d7019e50c2df2f52cb89dc
size 7018861312

3
zed-industries_zeta-2-Q6_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9fcaffd6b530527d8abbbb9ad65a6eb840d489016042a9d696c598241f874f7d
size 7326651136

3
zed-industries_zeta-2-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:de7dc4397828c8ab9da2c2ec2be5c92e2d5858bba7c946e3a1d762e06aa8480e
size 8773161728

3
zed-industries_zeta-2-bf16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3d9c98dc52f461e35141e229e79e6b9758230c02141640fa70bebc0f7a4abda9
size 16507720192

3
zed-industries_zeta-2-imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4fdf25830a930fc0fe40f8f2b796a4358471403b5fed35e19a8128b9244ed4b5
size 5015232