mradermacher/Qwen3-14B-Griffon-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Qwen3-14B-Griffon-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-26 23:01:22 +08:00
commit 909fd14cfe
27 changed files with 227 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-14B-Griffon.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Qwen3-14B-Griffon.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ddec1936120a2a4afea3655f5877aadc32bec45408eab7edbc3d4135d9f8f9b3
size 3849653344

3
Qwen3-14B-Griffon.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b5eac78052679111fd33020740e150a6193e464ea73c4c67f545189c5d410cb7
size 3579931744

3
Qwen3-14B-Griffon.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:68e901adc8d788d8f3c5f8c50aaab2907157e9f7380751ad519ffd44ea06b467
size 5322938464

3
Qwen3-14B-Griffon.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4b1c085dd8ed6168d78b3e27c6646d310a0d77170aab5473d44b0ae5409ff3f8
size 4963309664

3
Qwen3-14B-Griffon.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f583351c1ca9f679c41d443c209fe2bcc237659b56ed8bbb26620017214165de
size 4691586144

3
Qwen3-14B-Griffon.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e5dd76452fc2c41cb57ab24c1d7ede9d1aa8328a8c8896f6326a9aae2c82d19e
size 4299189344

3
Qwen3-14B-Griffon.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7362ceb475508706377cbc54e1ff804c4611863776e8920ce0b452efc4e76c01
size 6883406944

3
Qwen3-14B-Griffon.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:31e6b03829b8607ddfed0e4b2a8516ed71087412da0b8de0e48176c5cf3bae6c
size 6684955744

3
Qwen3-14B-Griffon.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:559e904b7dff771c46c4edfc6aac5ff7f53bc8a3ae8b2799b12d67facb6596eb
size 6375298144

3
Qwen3-14B-Griffon.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b685b090e751119e8406f3518d23669798999bfa55796082f06c8ed56d4bad98
size 5942663264

3
Qwen3-14B-Griffon.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f31de67d6cc9c4de6234d1999083d7248d7655988607030bbc99cbf92ea85bcb
size 8541360224

3
Qwen3-14B-Griffon.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0fdf7751b1edc23d99fd402c50cfa98ac20daee5e6bbd26cc03e9dc9f61aea51
size 8110727264

3
Qwen3-14B-Griffon.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9ecc92f5d2f93b47326ed536ab72eeac6ce557be8229bbec93d04fec6c99c56e
size 5753981024

3
Qwen3-14B-Griffon.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9a2e3d3152ea178efe96647aeb5e442b0abfa37b1f8fed63fabdb89add6424e7
size 5389846624

3
Qwen3-14B-Griffon.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4b421de876deff55187f75cb49cf69d70b97c50be59682ec680dec668cbf9152
size 7900648544

3
Qwen3-14B-Griffon.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6141dce3c42236b3b55f49cede1bfb43cb4bf40e7521518cfbfa81b450b12a72
size 7321310304

3
Qwen3-14B-Griffon.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:112f4e68e833041b678f5c6baf9be0547d67c4e3a0ae9f88056b4b3361f38221
size 6657102944

3
Qwen3-14B-Griffon.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6c7701895ac28da0618b5f0beedda6dc71dcd3d02727201ffb60a2a674782306
size 8542998624

3
Qwen3-14B-Griffon.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1633f0406baa0f80e8b30789eb7e5140be23add256e78c0894d54ec6c1bb6774
size 9389518944

3
Qwen3-14B-Griffon.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be4aed9a5061e7d43ea3e88f90a625bcfb6597c4224298e88d23b35285709cb4
size 9001750624

3
Qwen3-14B-Griffon.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d7ba06c3f2fd59cdfe37e54af279e5219251dfcacb1d0bb292d9683cf2f42054
size 8573472864

3
Qwen3-14B-Griffon.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e1728871e5736a55e40a7634295c9389fea952a18060d171bc0a1c4041c21fa5
size 10514567264

3
Qwen3-14B-Griffon.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:87c1c646247b35d6e209b22ed845371225d0cbbc4ad23cf52c61bd7fa040c420
size 10263892064

3
Qwen3-14B-Griffon.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:952f59c804d8a2ac826164fd28d375d40bac9c0c76e5029876c6344d713ef4f6
size 12121934944

92
README.md Normal file
View File

@@ -0,0 +1,92 @@
---
base_model: Daemontatox/Qwen3-14B-Griffon
datasets:
- open-thoughts/OpenThoughts2-1M
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- qwen3
- trl
- reasoning
- math
- code-generation
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Daemontatox/Qwen3-14B-Griffon
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-14B-Griffon-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Qwen3-14B-Griffon-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-IQ1_S.gguf) | i1-IQ1_S | 3.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-IQ1_M.gguf) | i1-IQ1_M | 3.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.8 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-IQ2_S.gguf) | i1-IQ2_S | 5.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-IQ2_M.gguf) | i1-IQ2_M | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-Q2_K.gguf) | i1-Q2_K | 5.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 6.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-IQ3_S.gguf) | i1-IQ3_S | 6.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-IQ3_M.gguf) | i1-IQ3_M | 7.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-Q3_K_L.gguf) | i1-Q3_K_L | 8.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-IQ4_XS.gguf) | i1-IQ4_XS | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-IQ4_NL.gguf) | i1-IQ4_NL | 8.6 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-Q4_0.gguf) | i1-Q4_0 | 8.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-Q4_K_M.gguf) | i1-Q4_K_M | 9.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-Q4_1.gguf) | i1-Q4_1 | 9.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-Q5_K_S.gguf) | i1-Q5_K_S | 10.4 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.6 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Griffon-i1-GGUF/resolve/main/Qwen3-14B-Griffon.i1-Q6_K.gguf) | i1-Q6_K | 12.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:94200492a0f0e4d408442a4f91bb3a0b7f11257c0ab133763dcc0e2224f0c4ff
size 7709765