mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-30 19:19:16 +08:00
commit f94ec308b2
26 changed files with 221 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Magistral-Small-2509-Text-Only.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Magistral-Small-2509-Text-Only.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b9be70f9a0c6daf31e8d5cefd1487bdc8561943d10ba5e5b497285db94ab2119
size 5750499712

3
Magistral-Small-2509-Text-Only.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1670096c6e8d043bdeb8eca2fa077f1d565985cea88469b87c38b7f2f4564da2
size 5273725312

3
Magistral-Small-2509-Text-Only.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e518e3e08bd3eaa89bd9be43e4fe9807cd37daa3138d59ec0c36fde8f4f777c3
size 8114055552

3
Magistral-Small-2509-Text-Only.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f71eb28e05af919ff609f04b0e2ac5f5ee10ebe8b13e7a216bdcfbd2aa8247a2
size 7478356352

3
Magistral-Small-2509-Text-Only.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:14ddb03a50245c9134a4944eefc7ad22f94ff63e7061ce79bb0a1cbae2f56d23
size 7207037312

3
Magistral-Small-2509-Text-Only.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d490b632413476ccc6f35779f76c22dd72f2a89288f64bd0924433d78dc47964
size 6545123712

3
Magistral-Small-2509-Text-Only.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa98872041c5f0cad9f25be6c8b003c72a74dbfab1cb1f1fc919e9a85b05e1fb
size 10650954112

3
Magistral-Small-2509-Text-Only.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a72a5438be29d448442b57af03f6a88556fc938d54789e1ca1b356f47b88cbc3
size 10428131712

3
Magistral-Small-2509-Text-Only.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fd9a8a2a22cc3e15a00810a79e7fccf106fc31b276eafbaaeed00e22deebefbb
size 9907120512

3
Magistral-Small-2509-Text-Only.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6fcb6929d4b8fb583806c35cae32e03bb3a7496d2d684edf97fab22e9fc87fbe
size 9280596352

3
Magistral-Small-2509-Text-Only.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:451141407521cd47045590dfb8c54db4470e8e6b13b7a8426e42662b2c47827f
size 12758919552

3
Magistral-Small-2509-Text-Only.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:332cc76362e98be6c9eb9a36cf6320ab5d2e628633a8e1b0ba188c1198d950e6
size 8890329472

3
Magistral-Small-2509-Text-Only.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3dbca638839779896f1b0d40d4a10514da55af81c19d5c6b8dd6ba3413d72d0f
size 8320166272

3
Magistral-Small-2509-Text-Only.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:71d5ad02c55eda9eef3f2c37fbced2cad7ef15d2b8fe9425645159391c6bff79
size 12400765312

3
Magistral-Small-2509-Text-Only.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8650d3f2675c9b2a71ff8e451a6aa5bee87d105b3d4741133492e389d67cdba8
size 11474086272

3
Magistral-Small-2509-Text-Only.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee9d316a6cf1560de0b87745f8ba0ce7c894138da500ee56a1840a6ff2e1c7a0
size 10400278912

3
Magistral-Small-2509-Text-Only.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:84004e467bedafe555ec68b16fb92d64dd58760258a753c25e4ab5b60c70c3f6
size 13494233472

3
Magistral-Small-2509-Text-Only.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0762e0a7b83444d58cd35766a330c9ec2db3a13c2825cbcc451cd0cedba77657
size 14873110912

3
Magistral-Small-2509-Text-Only.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f5e9adfd5bc838778900e1c08c495c060ef68d8cfc1364e0344b3d35eedd45d3
size 14333913472

3
Magistral-Small-2509-Text-Only.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9c8b7d400d96ec7b4b41157b9ed3fc0b37be3eb41f575b896d31865adb24dbe9
size 13549283712

3
Magistral-Small-2509-Text-Only.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:023ffbc511f8adcaf3f4e0fb68c2f463ca70f5e618f154c30852b641d80ee31e
size 16763988352

3
Magistral-Small-2509-Text-Only.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fd94207c69270c88e08b92c8a5f6b32b2dd081227144a1534e3e0971d3ab1b36
size 16304417152

3
Magistral-Small-2509-Text-Only.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc26d9bec552724e41cac40cb4fafbad1ae84e24375b6cc8e00260e9dd5ae18d
size 19345942912

3
Magistral-Small-2509-Text-Only.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:00403a5c729c45434faa5fbf51e03faa47fb291fd98c366deebe1783aa7c9574
size 10037312

90
README.md Normal file
View File

@@ -0,0 +1,90 @@
---
base_model: Darkhn/Magistral-2509-24B-Text-Only
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- magistral
- mistral
- reasoning
- chat
- text-only
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Darkhn/Magistral-2509-24B-Text-Only
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Magistral-Small-2509-Text-Only-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-IQ1_S.gguf) | i1-IQ1_S | 5.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-IQ1_M.gguf) | i1-IQ1_M | 5.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-IQ2_XS.gguf) | i1-IQ2_XS | 7.3 | |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-IQ2_S.gguf) | i1-IQ2_S | 7.6 | |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-IQ2_M.gguf) | i1-IQ2_M | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-Q2_K_S.gguf) | i1-Q2_K_S | 8.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-Q2_K.gguf) | i1-Q2_K | 9.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 9.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-IQ3_XS.gguf) | i1-IQ3_XS | 10.0 | |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-Q3_K_S.gguf) | i1-Q3_K_S | 10.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-IQ3_S.gguf) | i1-IQ3_S | 10.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-IQ3_M.gguf) | i1-IQ3_M | 10.8 | |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-Q3_K_M.gguf) | i1-Q3_K_M | 11.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-Q3_K_L.gguf) | i1-Q3_K_L | 12.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.9 | |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-Q4_0.gguf) | i1-Q4_0 | 13.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-Q4_K_S.gguf) | i1-Q4_K_S | 13.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-Q4_K_M.gguf) | i1-Q4_K_M | 14.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-Q4_1.gguf) | i1-Q4_1 | 15.0 | |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.4 | |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-Q5_K_M.gguf) | i1-Q5_K_M | 16.9 | |
| [GGUF](https://huggingface.co/mradermacher/Magistral-Small-2509-Text-Only-i1-GGUF/resolve/main/Magistral-Small-2509-Text-Only.i1-Q6_K.gguf) | i1-Q6_K | 19.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->