mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-11 14:32:15 +08:00
commit 01b18ebeec
26 changed files with 221 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:233d0b0137b5b931a40815c98fcf4ce0bc7bcb0913665bccaef9afa3875930f4
size 6899165856

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a216dabcb2c4f581d42708dcc34889d99cbdd664aad7a80867f9736a6e606ba4
size 6288894624

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba0788164d5b53db696913fa0a2fd1d59a11e337dd241c03e882c56b617cfc36
size 9879022240

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:668b84aa3af7b2f8d896f4a2841b2654463691009b1c661a29d4fe0099afb042
size 9065327264

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7aa920f2a470aeefb448a9dad10091b47b51a80f157ce672bbb4320167d2b0c5
size 8763533984

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8c9c282c7a3ab9f7e7fabec09c8767f1b9c3b78bb8a023dc30020f45736ff19e
size 7916284576

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f00b73b921a451441466be3ed51e22f929adf6e51482e298396ee0b3451ea99f
size 13066758816

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4ee59a20f4a38c5bf585292ee9851b000532d5dd0f3efbcbe2f37342f2d70a07
size 12781546144

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9169e10b9b1e844e769d96b829d7019bef40c806403489870dd43591bb6cb115
size 12114651808

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:05ff41a14ca19aa15df219d62b6812dce9621245e77614d3a2a4b8c62e284b61
size 11372194464

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d82355ab305c7aeed5ea068dbe30d922ba9dff5e7286b3d739d830ab36defa81
size 15719459488

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2c1bdbf01b129a240b953fd4eabf2380d59567f1c6c09b14990425e4f2238b87
size 10858654368

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:89efc42a660cba74d644f64cfa561211c0a1b752378950672d8e22b20b79123d
size 10128845472

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bf9fbe2654a6765b881a8de76168d29f6e42cef10355a0011aa1de6842e89c06
size 15306517152

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5301805c9b92f7dbf5f9a28988bd7676623f420070a628de83237ccdba0a853f
size 14133160608

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b3fe4c0e7935b0888529cb034ce051a944b369f64070dc6bc5574dc2459674c3
size 12745894560

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2dd9d7318329cba0d4cafc76e5be37875af61517697e95865b263fa776c04c80
size 16646662816

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b6fb8ec199433f36a733319687a475c31536df3cefcd1a6e199f393294e0f75e
size 18383628960

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9c224d6960a0484bb6bd6e0f5da5ae32266a1a5a1649a4c9dfdc2314f353be9c
size 17721453216

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5ec737f67857195260a433cea3b66479a4cf8c3c5f98511fdbb60d2797cd441e
size 16715868832

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:12e423a802ab3df6bee1aa9426822817e68597f5a9acbf444fd3fb9c4125178b
size 20775955104

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8b179535b351cf6d3ecd703a66498d52d61634f6ecd17f7fac6ded3453eb7cc1
size 20187703968

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:54497ee383289a5105cbbc2c05b9c8bec15ba8493b17011602f635e53881ff6f
size 24021363360

3
Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7dd8410c79ee01231e8a4599dbbb82a2da1ce6b57fe997201a447658bec849e2
size 14748928

90
README.md Normal file
View File

@@ -0,0 +1,90 @@
---
base_model: DavidAU/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- finetune
- unsloth
- granite-4.1
- reasoning
- thinking
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/DavidAU/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ1_S.gguf) | i1-IQ1_S | 6.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ1_M.gguf) | i1-IQ1_M | 7.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 8.0 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ2_XS.gguf) | i1-IQ2_XS | 8.9 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ2_S.gguf) | i1-IQ2_S | 9.2 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ2_M.gguf) | i1-IQ2_M | 10.0 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q2_K_S.gguf) | i1-Q2_K_S | 10.2 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q2_K.gguf) | i1-Q2_K | 11.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 11.5 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ3_XS.gguf) | i1-IQ3_XS | 12.2 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q3_K_S.gguf) | i1-Q3_K_S | 12.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ3_S.gguf) | i1-IQ3_S | 12.9 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ3_M.gguf) | i1-IQ3_M | 13.2 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q3_K_M.gguf) | i1-Q3_K_M | 14.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q3_K_L.gguf) | i1-Q3_K_L | 15.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-IQ4_XS.gguf) | i1-IQ4_XS | 15.8 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q4_0.gguf) | i1-Q4_0 | 16.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q4_K_S.gguf) | i1-Q4_K_S | 16.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q4_K_M.gguf) | i1-Q4_K_M | 17.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q4_1.gguf) | i1-Q4_1 | 18.5 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q5_K_S.gguf) | i1-Q5_K_S | 20.3 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q5_K_M.gguf) | i1-Q5_K_M | 20.9 | |
| [GGUF](https://huggingface.co/mradermacher/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-i1-GGUF/resolve/main/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier.i1-Q6_K.gguf) | i1-Q6_K | 24.1 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->