初始化项目,由ModelHub XC社区提供模型

Model: mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-28 18:32:15 +08:00
commit c4fb810c48
27 changed files with 225 additions and 0 deletions

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

90
README.md Normal file
View File

@@ -0,0 +1,90 @@
---
base_model: treadon/granite-4.1-8b-Abliterated-AND-Disinhibited
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- abliteration
- disinhibition
- granite
- mechanistic-interpretability
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/treadon/granite-4.1-8b-Abliterated-AND-Disinhibited
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ1_M.gguf) | i1-IQ1_M | 2.2 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ2_M.gguf) | i1-IQ2_M | 3.1 | |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.2 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q2_K.gguf) | i1-Q2_K | 3.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.9 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ3_S.gguf) | i1-IQ3_S | 3.9 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ3_M.gguf) | i1-IQ3_M | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.3 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.6 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.7 | |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q4_0.gguf) | i1-Q4_0 | 4.9 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.9 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q4_K_S.gguf) | i1-Q4_K_S | 5.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q4_1.gguf) | i1-Q4_1 | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.9 | |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.1 | |
| [GGUF](https://huggingface.co/mradermacher/granite-4.1-8b-Abliterated-AND-Disinhibited-i1-GGUF/resolve/main/granite-4.1-8b-Abliterated-AND-Disinhibited.i1-Q6_K.gguf) | i1-Q6_K | 7.0 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:857451f22df19b3a88ac1ad05d1c72920b632416278b195985723ceb03207150
size 2143303520

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f6e69f8075e2143d9cb3e49c20e5bd7d487a120a93f52b3432e9cfa383c97867
size 1982330720

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dd9d84f6cc646413c0448b738193d2d62871714fad1f41dba79ca97fbc36a6c8
size 2982819680

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8876266e25c334ac174c6b4156a2fa8f0200b10c5e2aaf378d5bae354c334f54
size 2768189280

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1ac5757a46d89be84c507ba0865272b4ec129a3df9f72c6f2abebd5cd17c96ed
size 2647193440

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:558bcef7f8c88adc788b6b86a625053f884f0bdd077861a9e1a7b03cef4b442a
size 2411591520

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d87917e563466d5983b711d69afe3859b155bea6361425a50c425bf840d1c03a
size 3912562528

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ed260460667d4764cd646303e2eb6fef3ace6fce14be462807ff190b74d940d4
size 3788617568

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e547c70a7a7542ce99c7fe611cb4e3b3728882a1ec978bd18aeacd3a25a282f4
size 3601839968

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0efab7b41314e46379080a5d4563235fa3b6bc9676f8971b2b49ed4f314ea44b
size 3347363680

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ed6d73558e7edd921504d2dd82e509b454ae752c33307a4d3669ee279f2613b8
size 4845713248

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a3ecdcad4907f56281e21ba60c2dfd256a083ddc9d24e68c2908fa6978e19e6e
size 4601919328

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ff9ca31e769b0a149ba7909ec3c1717bc0a483c578c3d919c6c77a8898402dc
size 3277436768

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2975529fc08a095db6dbde32057656739091abc0384d4faa1f8f61fa5825dc60
size 3057727328

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:48b0ff04c92ff70ec905900aa5fb04f33180226b3982915e8cec14ad49dce876
size 4523276128

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5804d2044d704c22de676776ff7eac5302d41219a87f98685066b55ade75ce8c
size 4170430304

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f6e78d566eea7fb6cf70fcde8b76d9b9521bbe944f3d962cd9780b20b3853193
size 3766335328

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1e04eab9f49dc9c6e7c64c640aee7a7118a9f2e90685c0b9006230ee6081c3ac
size 4841125728

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:96f8274961c2e96b556bd06ef04b60a890421a57ccf5596f4e817a4426485103
size 5322815328

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:059c5699f87a8e9f7c3d86b0c4bee48e86d24275e904cf0b8e4649bd6b7075e2
size 5116704608

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:37f984f98eb6b73b525462c4a7469f0d76fa4ba28a15e49dbdd7eb35b8d9df7a
size 4859606880

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a553f00fa70b93943caa8f2074b363817c5ee5680e84c34460e3f11748dfbbd7
size 5971294048

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e578a7fb421fd74c2d8163e8a0feac4f0ca0ece892b30e32787ecfbcb5566ba7
size 5820888928

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9a744fda92261df6d4880df753c3ba39ba20f801e42b469b880735ed442ab8b1
size 6879295328

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:568a70e69c26568ab6d3e4186fcccf3d5081724abeb996b83fb8975b16b18d71
size 6023232