mradermacher/MistralThinker-v1.1-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/MistralThinker-v1.1-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-13 15:26:23 +08:00
commit 2a2ff4eed9
25 changed files with 209 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

58
.gitattributes vendored Normal file
View File

@@ -0,0 +1,58 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
MistralThinker-v1.1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
MistralThinker-v1.1.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:46e87903366ccb7580b009ea51301d76d0134ce417a7f8fb457527f2db091e9c
size 5750496096

3
MistralThinker-v1.1.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a3f4d2c21576cd9773cdabbcee186571078ac15891dd97f7495411129868e72c
size 5273721696

3
MistralThinker-v1.1.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7afc0d82f048fac39c1817782084eff32b34989612d6f8bd8977e7cae5ea65db
size 8114051936

3
MistralThinker-v1.1.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:16b94afac0a5f96fd72e5de20fb3d72aeeea7e032cbe6ae72b021da19fedd977
size 7478352736

3
MistralThinker-v1.1.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f239fa9b74d3fa39de303a61ba001f487b331b009b9cec37e951afd95443035
size 7207033696

3
MistralThinker-v1.1.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:186c8c7cbe9d9f9e6b77d0ead847ae8934513009690d2fe6af3764117635ce90
size 6545120096

3
MistralThinker-v1.1.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e1f48327cd60dd2382903cd5d3256e22918bc07c746db29a0701af1fa08c5ffd
size 10650950496

3
MistralThinker-v1.1.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fa70d836ebf405d90eb7745b0b21a18fe3464972e9bf3bbf84a50d618eb616c0
size 10428128096

3
MistralThinker-v1.1.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a24d9fe48b398f330aa9133cd3cb9a94c23660d2881ce16e1ecb4e69f55549f4
size 9907116896

3
MistralThinker-v1.1.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0db7c55f43831d0e2830fc870ab8becda67f668e11b89846f55259aada40fad9
size 9280592736

3
MistralThinker-v1.1.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8d4aa9520215c69f2d95a9280fa129c4958fe4b153d167ae9790b92d57f2ae7e
size 12758915936

3
MistralThinker-v1.1.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff9fd674d2b91f834a5da616ae40263b65d599abe00381134e9d4f3a8a6bad83
size 8890325856

3
MistralThinker-v1.1.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e1ffb565eee44b6a3cb76f1114132b84f2196e284c4d71d597fb59ae231d988c
size 8320162656

3
MistralThinker-v1.1.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:392b9204f73417288bf48a8b8eb9a95e9ab3d2134f25032ca44df0039cd27482
size 12400761696

3
MistralThinker-v1.1.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8fd7f020784b38c4a16cde86c8afb76cd1b750108c64c46e636f0239b051821a
size 11474082656

3
MistralThinker-v1.1.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc80123b8b02be02d013d6a270818bdd5398f5c37eda82219a8af1ccb8328fcf
size 10400275296

3
MistralThinker-v1.1.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:de3f4d42f8108ae6d52e226fac1899854f8d65c1e953eeb37ef8f241e0bb4bc7
size 13494229856

3
MistralThinker-v1.1.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6d232f7b2ee7ba03e109425e3e870e579ea4388383233d59fecf0d6cbb641545
size 14873107296

3
MistralThinker-v1.1.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8727fbb77f98ec24196c0cdbd0d5c7e20067248ef8ef5495d953d5a2f5451833
size 14333909856

3
MistralThinker-v1.1.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:92efdc6e48f612b87f255a84c905671deb369ae15a3b827b8ecdbd67cb134120
size 13549280096

3
MistralThinker-v1.1.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2252de1a0c9d52c217470e6d3591523866d14f10e6bc44e7ab7653757fc3c54c
size 16763984736

3
MistralThinker-v1.1.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:edadd2066301170b4d3d68873adbb3138909af14a2bd51fd5684ab03ba562a45
size 16304413536

3
MistralThinker-v1.1.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6473608f2dc46270763aa27be3bdb6eebaf65bb57d3447b6c8aedb06365be32c
size 19345939296

82
README.md Normal file
View File

@@ -0,0 +1,82 @@
---
base_model: Undi95/MistralThinker-v1.1
language:
- en
- fr
library_name: transformers
quantized_by: mradermacher
tags:
- roleplay
- deepseek
- rp
- r1
- mistral
- distill
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Undi95/MistralThinker-v1.1
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/MistralThinker-v1.1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-IQ1_S.gguf) | i1-IQ1_S | 5.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-IQ1_M.gguf) | i1-IQ1_M | 5.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 7.3 | |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-IQ2_S.gguf) | i1-IQ2_S | 7.6 | |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-IQ2_M.gguf) | i1-IQ2_M | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-Q2_K_S.gguf) | i1-Q2_K_S | 8.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-Q2_K.gguf) | i1-Q2_K | 9.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 9.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 10.0 | |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 10.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-IQ3_S.gguf) | i1-IQ3_S | 10.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-IQ3_M.gguf) | i1-IQ3_M | 10.8 | |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 11.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 12.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.9 | |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-Q4_0.gguf) | i1-Q4_0 | 13.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 13.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 14.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-Q4_1.gguf) | i1-Q4_1 | 15.0 | |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.4 | |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 16.9 | |
| [GGUF](https://huggingface.co/mradermacher/MistralThinker-v1.1-i1-GGUF/resolve/main/MistralThinker-v1.1.i1-Q6_K.gguf) | i1-Q6_K | 19.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->