mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-20 03:55:16 +08:00
commit 752d7ba384
27 changed files with 222 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Delta-Pavonis-Qwen-14B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Delta-Pavonis-Qwen-14B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3e0d39e46b5653f94d5d9e1435dcbe13df4e15f3c34cd7365c8a7296374767c7
size 3870225440

3
Delta-Pavonis-Qwen-14B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2e99df637179bbee8b0fca4eb3e39ff7c1be5958962eda0c8619868504098297
size 3605910560

3
Delta-Pavonis-Qwen-14B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:024df5415fd52fb810f7fe01506bf0efa3e2d88572fee46639af60ad964bd6c9
size 5353855392

3
Delta-Pavonis-Qwen-14B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3e2f9e31442a33cf1b749e12b2e0b289d73e4081352e6aac3ed143fba00f057a
size 5001435552

3
Delta-Pavonis-Qwen-14B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0c55b160b47fc20f63760b214cc2289feafe6bf5335ad0b1f2fbf28c4f5bbed6
size 4702491680

3
Delta-Pavonis-Qwen-14B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:50dc00e5ff04ce7085bf02d29ac3658ab3d7cab19229360fff68d73bfacddd8a
size 4310750240

3
Delta-Pavonis-Qwen-14B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c3a9175a39b241c31376123c322ec1265575d1b8bd2af8a84e5113de9eba67e2
size 6913975776

3
Delta-Pavonis-Qwen-14B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c0f8db7d0b10d399a34c8fe454550600f4925f5ddc71c5818c086e6888825c57
size 6690457056

3
Delta-Pavonis-Qwen-14B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a1feafb822177420bb387b460f3b94fe96a9e07e505d1af381382599db650259
size 6380799456

3
Delta-Pavonis-Qwen-14B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e7c650ee33fc5aa6c439ec36e6eff7b94e3617ea4d0b8a799d893ce8148a6866
size 5944416672

3
Delta-Pavonis-Qwen-14B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:550f38434883adfb8e57d7fb9eab35ed41704aab1dc3f552ceb59b6759ae543e
size 8546349568

3
Delta-Pavonis-Qwen-14B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7b0fb26e96eb4c0caeb56016a193e18dfca96864f826d03124c780ed3a148311
size 8117070688

3
Delta-Pavonis-Qwen-14B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3520ceaa4a848be038ab2ade4c330d70d8d90002e2a5a18cccc0a5f13fce36d0
size 5768142944

3
Delta-Pavonis-Qwen-14B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:924f3039d65fdb32208fe7b94ba1c2d7576af4d4e1f88b264753776c568b5ca0
size 5394833504

3
Delta-Pavonis-Qwen-14B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5c3f9093aaff1cdc01d88dd47daf4adc62b91d7955dea779c3ff00b441dd9f60
size 7922206176

3
Delta-Pavonis-Qwen-14B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bc2c4a53c79d2a8293b7efc54acca673c8ca98acd7d9c0b2a743de218aa8b0bb
size 7336642016

3
Delta-Pavonis-Qwen-14B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f01d16871bf3a6c25a7f800694194d2fa7550103f8e05b3c568efdde06680cf1
size 6657033696

3
Delta-Pavonis-Qwen-14B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b32a29ba7c8406c90250d9b66ddee09cb8b40094df19c15ba311789005ef90e2
size 8541434368

3
Delta-Pavonis-Qwen-14B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:57b2a4a811b3d81a2558f0873eca5e690932e962b1a10afd2e08e7a55d7d6564
size 9389178688

3
Delta-Pavonis-Qwen-14B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3ff26012eb03c0f976db9154d9bb48c1b9e8662460a06b24b41a05f6df25a7a1
size 8985276928

3
Delta-Pavonis-Qwen-14B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a42ee797bbaa28f66e7fab4600e892b2df1cb5bbe42c89fe1655f0badf4a0862
size 8570597888

3
Delta-Pavonis-Qwen-14B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c8fd8d80b913495ed8fde0429ab9ff96de4ac4f31eac9f848e0128d562dd6ef8
size 10505784448

3
Delta-Pavonis-Qwen-14B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:28a018cb61addd8bbebed324c84957c626b15415ee52a641a8fe892ad5f9ddef
size 10263465088

3
Delta-Pavonis-Qwen-14B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b04d3ff128e1f3d73510dc1519bd3e825c2e52c2a6fcff7064cf82b79bbc8f27
size 12121323712

87
README.md Normal file
View File

@@ -0,0 +1,87 @@
---
base_model: prithivMLmods/Delta-Pavonis-Qwen-14B
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation-inference
- trl
- sft
- Qwen
- Distill
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/prithivMLmods/Delta-Pavonis-Qwen-14B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Delta-Pavonis-Qwen-14B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-IQ1_S.gguf) | i1-IQ1_S | 3.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-IQ1_M.gguf) | i1-IQ1_M | 4.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.8 | |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-IQ2_S.gguf) | i1-IQ2_S | 5.1 | |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-IQ2_M.gguf) | i1-IQ2_M | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-Q2_K.gguf) | i1-Q2_K | 5.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 6.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.5 | |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-IQ3_S.gguf) | i1-IQ3_S | 6.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-IQ3_M.gguf) | i1-IQ3_M | 7.0 | |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 8.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-Q4_0.gguf) | i1-Q4_0 | 8.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 8.6 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 9.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-Q4_1.gguf) | i1-Q4_1 | 9.5 | |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 10.4 | |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.6 | |
| [GGUF](https://huggingface.co/mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF/resolve/main/Delta-Pavonis-Qwen-14B.i1-Q6_K.gguf) | i1-Q6_K | 12.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dc863980f91ff71693ecdbde1e4825f575b00db8d0f797dd5d7938ae1b907f73
size 8563597