mradermacher/Mistral-qwq-12b-merge-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Mistral-qwq-12b-merge-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-23 16:24:17 +08:00
commit fc5261fdbc
27 changed files with 218 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-qwq-12b-merge.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Mistral-qwq-12b-merge.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:24fd2df763ea1ce8ab36c0bec38780f8ed75dcc24c67344ccb303b88e66b217f
size 3221625728

3
Mistral-qwq-12b-merge.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5b2156431b8ee2398eacb66d922b313c93859795b3d356df9013dd485b7618d5
size 2999212928

3
Mistral-qwq-12b-merge.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:74b9b2cb2de9f42ae97937f3f21183584b6ada87e9c8cb696381922b1de30c6f
size 4435024768

3
Mistral-qwq-12b-merge.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aba9fdd615e2d4e9700825bc2497e79ac9b70fbb3dc4f5137097fd109485dfa0
size 4138474368

3
Mistral-qwq-12b-merge.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ba1d2fc58526ed5e98bed911d21fa19cb644969f5fd0c5908aeb34fbf7288d7
size 3915078528

3
Mistral-qwq-12b-merge.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2006b2edc13adcb7da95b72a50dd00e8e10164cd7ffe085d91a1fe1bc491ae72
size 3592313728

3
Mistral-qwq-12b-merge.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cb3c4de99c41e907ed596719f03c6c7e648041234725233760d24965871160ef
size 5722233728

3
Mistral-qwq-12b-merge.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c2b948b308771748bd8681f8d87477ac7e9af1de90bb95bf9d1d149f14711d35
size 5562080128

3
Mistral-qwq-12b-merge.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f1261b1e38b8cd9b5358eacbfd52f71cf109d1caca2ec76e339589fc1c981bc0
size 5306489728

3
Mistral-qwq-12b-merge.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cdf82472b52daeb14b05f25e22fe3fc464abd16542142141c589971835b033ad
size 4945386368

3
Mistral-qwq-12b-merge.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:08a8edb95b16790cc848937afdcb445ec623a1579c013a2ed5d42e8c711648f9
size 7097916288

3
Mistral-qwq-12b-merge.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cb5710430405981a332d33b599e74475b159c513606c56c5c5b27ded1d23a726
size 6742711168

3
Mistral-qwq-12b-merge.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:18342b3afe64738e545b04c836afc6ed2bf094cd389e1c5d5b8022ccf1e73794
size 4791049088

3
Mistral-qwq-12b-merge.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:517904342069219625ef7bc215f072dcea6f1f10ab3d96489112d5ea1f649db6
size 4493679488

3
Mistral-qwq-12b-merge.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c5c4b19a0be762c2cd94e399c7ea670454ea1eba53b43b02c0586d65185877d2
size 6561504128

3
Mistral-qwq-12b-merge.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9eee080ad6bfab05011ceec914908afc147471215ab336b13b2b161b52382365
size 6083091328

3
Mistral-qwq-12b-merge.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7c242ab39b8a0229fca66b30d5827623bcc173ffba16009b77b524b86be1fcea
size 5534227328

3
Mistral-qwq-12b-merge.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c6e58e712959e312386f614d7ef9181f16cf67a3ea47c7410687db0b926eadd1
size 7094639488

3
Mistral-qwq-12b-merge.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ddb9bc7c7bf67f313f3549fae54278a4082adf7f8f0409e235814135fc052338
size 7795219328

3
Mistral-qwq-12b-merge.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0db5709b2292ea33f407f500062c2dd6fe530a2a5fa1376a603d1efa5f1d9031
size 7477205888

3
Mistral-qwq-12b-merge.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3de4778ea14313f90c705e716c9e00c8f11bb2721243094063a3ba57df3979cc
size 7120198528

3
Mistral-qwq-12b-merge.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bd0975a42ce9936c8ba43022e18d7a4927df1d9cfcc6bcbdd18fcb05234af308
size 8727632768

3
Mistral-qwq-12b-merge.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:74eae074b93545b3b8b2d6503f1f55939a2d2106d3766cb680fdefe4b3c1cfb9
size 8518736768

3
Mistral-qwq-12b-merge.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5598219018bb5c98b9ac0fa01dcd415daab52ec9260482e99ca0e768ca8194ac
size 10056211328

83
README.md Normal file
View File

@@ -0,0 +1,83 @@
---
base_model: Disya/Mistral-qwq-12b-merge
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- mergekit
- merge
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Disya/Mistral-qwq-12b-merge
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Mistral-qwq-12b-merge-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-IQ1_S.gguf) | i1-IQ1_S | 3.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-IQ2_S.gguf) | i1-IQ2_S | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-IQ2_M.gguf) | i1-IQ2_M | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-IQ3_S.gguf) | i1-IQ3_S | 5.7 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.8 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-Q4_0.gguf) | i1-Q4_0 | 7.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-Q4_1.gguf) | i1-Q4_1 | 7.9 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.6 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.8 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-qwq-12b-merge-i1-GGUF/resolve/main/Mistral-qwq-12b-merge.i1-Q6_K.gguf) | i1-Q6_K | 10.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5cb8b5304e443b6d58b46ccd967253c0d07631c51ce90f380b90fca0d4b7e77e
size 7054405