mradermacher/Mini-mistral-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Mini-mistral-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-17 03:36:09 +08:00
commit b8c6d339aa
27 changed files with 223 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Mini-mistral.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mini-mistral.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Mini-mistral.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bd68a9ff508828c44eb9a88217e9f7ae09c53461a813e2fdb97bc1de1c3af114
size 289702048

3
Mini-mistral.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b74de483eb26a31327b1cecc1220e6dd67dcf0b85e4f43d31e3302e144e5ad0c
size 269967520

3
Mini-mistral.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:85ae9bcb418f727f74acbbbeefcc5e42363b74bf014a8226c02a1342f1ee7f86
size 400076960

3
Mini-mistral.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:edeb7effb50b7dd1e4b0ea0c6e38fae11069bcdb30b56abf9d92e9c586a8a77c
size 373764256

3
Mini-mistral.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2ac2e1737b106d152d2d9b01532f11192cf144804c97fce0f02a05e39b561da6
size 351789216

3
Mini-mistral.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:37936fea424caf009667dfb07c1e47afe1cf48e4ffbd436779f2e141a87a5142
size 322592928

3
Mini-mistral.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b2c8546646699c29815900748f4df07eddfaccf0d6594f530248e558a50556f
size 516194464

3
Mini-mistral.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f76db52e49264f4bf1d62fa16660ae7cede71ef51e799dc68b928a8dc6e7291
size 500875424

3
Mini-mistral.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8ce984f1f205071b404727fa20dd85dbb38038f8a9fba373025588fa2c96c8ee
size 477626528

3
Mini-mistral.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c8faa645d63c34063b4322c51155c4bf679abfd68b97d4ba8777d2499e007c84
size 445132960

3
Mini-mistral.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4a37f437f352a24311853ffbbf19422841eb3586fdfbe03c0b477d657bb77358
size 638169248

3
Mini-mistral.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:86483d3b9e1704ff46aa02d7d4d815e90b0296453a0a8175b4eba40ae24571ef
size 606204064

3
Mini-mistral.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5eb9cd613c2673fc682afcb35de26579c16bddf11fb4de110c8e4adaf3d887f3
size 432132256

3
Mini-mistral.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:540794d388ce3c7b43dc70e2abf0f5362cf8caf491a7b0f2058a32f1d4524791
size 402395296

3
Mini-mistral.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3c4abdc2e831f6eca47c18e9926aced53a25ea5ee6b1cce7df92049c7fbe26b9
size 591528096

3
Mini-mistral.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6d03b3932c9808afa09aa974ca55275cad7053db015a932a2c9f130776874266
size 548405408

3
Mini-mistral.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:279b1bfa061a4e17aafb440066c7b3c86ad9c223781e1ab4716bd0ce1c6e77cb
size 499343520

3
Mini-mistral.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f87ccfc1cb60709203f382c2d30e46cd960cbf8bcd0e602225ec58ceee152e6c
size 638169248

3
Mini-mistral.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:96c7e0ec5c66a126a57a7259c23b677c34deaa8a41f11920b01101d344fbdef4
size 701378720

3
Mini-mistral.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d4fa811090d192339ecc616392e610b789bec0bd4a2816f6a36c0e80d17e6f6f
size 667816096

3
Mini-mistral.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6aa3e277b4dd6b11a6310d11d9dc29b9226e580176d869b1d76fcfe8cb21c3d8
size 639873184

3
Mini-mistral.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:02894bb2aae578349c8ae40d4294911eab6c91b9d0719f16a57bcab6824c5944
size 782045344

3
Mini-mistral.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:45b353a56ccd435896c80d44e20378ea12903f8d571bf76a746c4cc74bae7e2a
size 766029984

3
Mini-mistral.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:437be8a9d939cdbced542cf704b7dadab6f590de12da41511c02480bce4be192
size 903413920

3
Mini-mistral.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e1031af72a07095a6d634b6c84c808f3b30bc72b8028b604475cec42e16f6235
size 1600704

88
README.md Normal file
View File

@@ -0,0 +1,88 @@
---
base_model: RAANA-IA/Mini-mistral-1.0
language:
- en
library_name: transformers
license: other
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- LLM
- MINI-MISTRAL
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/RAANA-IA/Mini-mistral-1.0
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Mini-mistral-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Mini-mistral-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ1_S.gguf) | i1-IQ1_S | 0.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ1_M.gguf) | i1-IQ1_M | 0.4 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ2_S.gguf) | i1-IQ2_S | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ2_M.gguf) | i1-IQ2_M | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q2_K.gguf) | i1-Q2_K | 0.5 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.5 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ3_S.gguf) | i1-IQ3_S | 0.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ3_M.gguf) | i1-IQ3_M | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.7 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q4_0.gguf) | i1-Q4_0 | 0.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q4_1.gguf) | i1-Q4_1 | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Mini-mistral-i1-GGUF/resolve/main/Mini-mistral.i1-Q6_K.gguf) | i1-Q6_K | 1.0 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->