mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-18 08:17:19 +08:00
commit 2139e5345b
27 changed files with 225 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e3ea117be59238d7d65ee156b766cd67fef308566e6843e78cbe9f45d7552e55
size 908877728

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:952667e00519c95d8fc7fa32f12344c1289df7b111f44545aeca9afe7320cd0f
size 844980128

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:403fde6ea0479d99536796f01aaf3e67b0052eb0e0e5c86a72cac37529902f03
size 1241472928

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:870b5edc51b2097e1b04f2f0e34b3e15580c74abfe714d3b10cc13036abf6126
size 1156276128

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ac1600664fe94dc0b6961440fab86f23a867706f8df94782ee3462f30e2cfbf0
size 1108762528

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c7947a5e16cc7d0c21f0bf3699336403b1ba57df35337b838dcd18adac6c7f9d
size 1015373728

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:78b704da6c5ebc28f0a99dda149272e0ca72bb23698d1c365f6e598497dcbfbe
size 1622523808

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:05a091c5c5b36076c9e4fa8206e55262e2728eeb20364520d29a7faf408aaa30
size 1573781408

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6d031f57afc1f6321420d95c22c9353701b287d289d7bc6d3c03b3b9bbcd8dba
size 1500053408

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:acde84371f814aba4b9420f32e11ae0dea5b4ce64991606b8ae19499105c4597
size 1387290528

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9771636bcbaaa89b9e335cb3fa62fd98ea65725ee7a8351d159db9d53995cb72
size 1991163808

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:53b8abe756312e2e1363de8bc3c849d8311ef40d6f82fc780fc622e32d49ccfb
size 1894498208

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:02c4ef9d72a9151c5453c585eca1b3562b5492a22f5fb804c1a244419d59e6c3
size 1371439008

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:93ee7bd5c3ec34e1a142a17ca8d6ddb97034183b0fd921b249c63ac85f0f35fa
size 1284194208

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:00445889ce388688056067971f1f0069714401e76f6cf6fae0b833fc4b98ab0c
size 1864187808

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4b58796297d33973e1be05d91a80994c62a711b21ee8386ed85ece142a354a11
size 1725579168

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be662b46acd68e2145b05beeb3ad25fde46ac9050fc556dfaecfa757840db3bf
size 1566818208

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:31eab96f022901ed3773137535a3d3333d10273b9040af983a614ae77cfcf032
size 1991163808

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1936e40da39535bdd5950733f710559d9a76536e0b8db53b5b1044130b61e518
size 2181218208

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:354fba1295995ef7a02962732fd70e99c628383f0454883bcc0ff488b05d5a13
size 2099503008

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3bc59ad80af3256acb4278b8963478e81de85d0988288bf0143ea18fd7a0b594
size 1998372768

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c6148d4eac9f4e5b925eae3b6561e407ed5aac83b55c98c150f16fd7fe3c4532
size 2437013408

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e9406758aa01a4ce79558196d73310253a53d1bac35d141af977e5084af0d6df
size 2377826208

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1362878e9b1245c46c06c009bff3fe5cce45ac259dd120cf2dec54d16bc49afd
size 2795618208

3
Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3ef67e1d207d5545bbf2ae56abe43eb9058f71f58eb953c9f93bf407f350b8a6
size 3811392

90
README.md Normal file
View File

@@ -0,0 +1,90 @@
---
base_model: ermiaazarkhalili/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- granite
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/ermiaazarkhalili/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ2_S.gguf) | i1-IQ2_S | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ2_M.gguf) | i1-IQ2_M | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q2_K.gguf) | i1-Q2_K | 1.5 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.5 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.7 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ3_S.gguf) | i1-IQ3_S | 1.7 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ3_M.gguf) | i1-IQ3_M | 1.7 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.8 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.1 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q4_0.gguf) | i1-Q4_0 | 2.1 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.1 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q4_1.gguf) | i1-Q4_1 | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF/resolve/main/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth.i1-Q6_K.gguf) | i1-Q6_K | 2.9 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->