mradermacher/DeepZirel-V2-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/DeepZirel-V2-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-10 13:20:10 +08:00
commit a186057f57
27 changed files with 225 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
DeepZirel-V2.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
DeepZirel-V2.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d9ee2970dda0add35a1e1a0b63c9b454b8d086cbe8524dceedf7b1928ad59190
size 5246303648

3
DeepZirel-V2.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bb021221849b269d91be6deaef8b790460a4f7ee7689bde3b3541d79465e556c
size 5004534176

3
DeepZirel-V2.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:20e7c82b52daae8ce2a6a425350bbdc692ea66b45a55ada5b62028673b58266c
size 6335320480

3
DeepZirel-V2.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:59b33c6d60130aac3ce85523284e73030dd11aa2811bc607babb8cbc1af76b1a
size 6012961184

3
DeepZirel-V2.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef100e208a26c6502fbe161713a47070179c8e5d63e089fd9b893b988c7055b3
size 5975151008

3
DeepZirel-V2.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f5900f17d7fef46eeaee7b8dd699a4199a3e51478afdb02d554788c05c381adb
size 5649252768

3
DeepZirel-V2.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a07e9450d791d4dc647dbc77069b4b00521730e61b7ae2d7d3dbdb82dd1b8950
size 7556942240

3
DeepZirel-V2.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5cfa9ead5acff80178e8715154d23dc78ed945217b1aa39c479e2c2ba82fe565
size 7491430816

3
DeepZirel-V2.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0406bb449c22de63c88b8d9104292aaf55a581652ab803cc40b9d71bf42a74c1
size 7126624672

3
DeepZirel-V2.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:41d161a8a00996d1f9cf5169f607d982adb58c154b83b004b0fb8bca7b590c92
size 6969151904

3
DeepZirel-V2.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0933987912c790a057681f8f25bc3b82eed0d16e938c8e0a5a8913c3e8fb32bc
size 8905117088

3
DeepZirel-V2.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17ef84a73216bb0a0779d859327e05f1998df7bbc90c7b4bb61c138bec10ae04
size 8572485024

3
DeepZirel-V2.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:606178878654e507da5a348c3d8dad4a3e900927f9cc9d992f1364eab0702c02
size 6437107104

3
DeepZirel-V2.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1e91de2c488ddb0694e40a490ec6479a7a011bada0fb7c9642c7f7a977f2cb47
size 6462018976

3
DeepZirel-V2.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6f01defff0f3dfcfe19343b4f3746596f67f472e2eca7f07b39213d4de38ee0b
size 8463165856

3
DeepZirel-V2.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f49b8cd800ee5fc4a00be1bc32b5f59b21c555a946ca5f811841e5075901b8d3
size 8130374048

3
DeepZirel-V2.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ffc455fcd56730123424329ac5518054cbfe85acfb9cb0cb3e687e7d30d1e47c
size 7491430816

3
DeepZirel-V2.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0eef889a6ad494813adacb72aaf1b7061ceea7f55873f98ba1cd6053e39f55b1
size 8930307488

3
DeepZirel-V2.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f234d3e6dc0c90f5e20c97be1c3038345284ecb0d99e31bfc7511930e033c69
size 9873444256

3
DeepZirel-V2.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:19e3d6e8d92bb36452db8070f4e0a39c1bce4b0338f7a73088890ba0bb869aef
size 10367962528

3
DeepZirel-V2.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a998d43652c8891db7256941819d108cce8836ecf726038d57c23fab77cb987
size 9537154464

3
DeepZirel-V2.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:24fb44d9f9fa1973b04e5e3a3536b75fde847144aac2882854a8ba3e21fe33a1
size 11853090208

3
DeepZirel-V2.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:665a19b61aaf4514df3c82fa6a9b8202cfb3943930ccb29b693e8dd90ba7792d
size 11144834464

3
DeepZirel-V2.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e09ac45a083188cfa61ab1f35668bd5f2ac7c22a917ed80cc2577aacbab1fb82
size 14073835936

3
DeepZirel-V2.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4ec31ea11b2eb1cda70309c8ed3c12eaea04926157c2a4fc511e3e868cf0738
size 39466432

90
README.md Normal file
View File

@@ -0,0 +1,90 @@
---
base_model: Daemontatox/DeepZirel-V2
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- deepseek_v2
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Daemontatox/DeepZirel-V2
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#DeepZirel-V2-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/DeepZirel-V2-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-IQ1_S.gguf) | i1-IQ1_S | 5.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-IQ1_M.gguf) | i1-IQ1_M | 5.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-IQ2_XS.gguf) | i1-IQ2_XS | 6.1 | |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-IQ2_S.gguf) | i1-IQ2_S | 6.1 | |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-IQ2_M.gguf) | i1-IQ2_M | 6.4 | |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-Q2_K.gguf) | i1-Q2_K | 6.5 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-Q2_K_S.gguf) | i1-Q2_K_S | 6.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 7.1 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-IQ3_XS.gguf) | i1-IQ3_XS | 7.2 | |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-IQ3_S.gguf) | i1-IQ3_S | 7.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-Q3_K_S.gguf) | i1-Q3_K_S | 7.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-IQ3_M.gguf) | i1-IQ3_M | 7.7 | |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-Q3_K_M.gguf) | i1-Q3_K_M | 8.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-Q3_K_L.gguf) | i1-Q3_K_L | 8.6 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-IQ4_XS.gguf) | i1-IQ4_XS | 8.7 | |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-IQ4_NL.gguf) | i1-IQ4_NL | 9.0 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-Q4_0.gguf) | i1-Q4_0 | 9.0 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-Q4_K_S.gguf) | i1-Q4_K_S | 9.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-Q4_1.gguf) | i1-Q4_1 | 10.0 | |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-Q4_K_M.gguf) | i1-Q4_K_M | 10.5 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-Q5_K_S.gguf) | i1-Q5_K_S | 11.2 | |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-Q5_K_M.gguf) | i1-Q5_K_M | 12.0 | |
| [GGUF](https://huggingface.co/mradermacher/DeepZirel-V2-i1-GGUF/resolve/main/DeepZirel-V2.i1-Q6_K.gguf) | i1-Q6_K | 14.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->