mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-19 04:50:50 +08:00
commit 47584b0b34
27 changed files with 252 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4b2f2ae97744d0034359c95b386cb6a049d6aa3a7c2e24783ca32bee7b1dea0b
size 2278912000

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e8c881907f2b429505bc132b82a12271b071b0a1ad0219d3cd05367614fee67a
size 2117595136

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a8b56eb34487f16ef002e92ab60525e9347bed296842a8f1e4f8b6a78a1c3ab8
size 3200788480

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b1742fce8c9a76e161f2e455154cf0f364d106d25ccba20a5d3a8a3f72880e16
size 2985699328

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4b500809c4428e49aad91edb08e068196266c976144f99d393d3752e35d6d436
size 2786750464

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:33b0fec03f62504d2fe61c649ddd31e8b0cb0724007cb15b162cef92cafa9b0f
size 2547773440

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:008dafbc6e31a8a163e8a7b64295087bb5f4762d9a775632855832e2597ff26c
size 4174716928

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ca3220f084347e9342092ed9924af77a7c4a2a54158ef4a2cc0b62a2a69b3a79
size 4005928960

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1069d68de3c494f900ee9844a74d2b98dfdb44e45c3b1211af98d8c6d610a4b5
size 3816595456

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5b8f2d5ecc6952271d25108ce01f5425ad7241ce399f0529a43757d6048f8ec1
size 3543525376

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5443c2f23d5fe71e295bd0f42cd5cc39dec84561456282c3be239150a8b75f6e
size 5141174272

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f9d45c6b691aad204d2a5949de747624a11d12f05bb087c2c0aabda764bf215e
size 4874057728

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4bad8c5a05dcebba2a1994b571e3c8999f674097b66a260b00c951ac9394298f
size 3448342528

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:15f16b0f35d653285dacaa9d8ae3ae8096eeda934d9c4fe7646ad45eed4a3252
size 3196782592

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:08dc01087695dad5b976e307c164f82d906fbf193dfa26f688437dcb4ea8d5e8
size 4794228736

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef0f9c5bc95d1f5e69a44dd3c08f0b7678ed6aa24d4070168791e2d415b5e3ed
size 4428537856

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:beb748089da05069baac40a002a3d669aa565caf86355fc24a5eb0246d2a0d3d
size 4005928960

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d6585288d269b3d13a28caaee462cf92e8ed5bc8ef3504d20a65bd51b5ddaf8
size 5156902912

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2c1cafb6d0ee01d82377aaa284e58a3358e199f155c66ec472d5fe0460a6295b
size 5675407360

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:36a017e910f4d20ceae70be8660ed0048ac56472ee36fbcf471f949a6a56f878
size 5440436224

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0e5ea801195f6bf8939d7e6d667183503c706516add7666d363f370bdcb5a9b4
size 5174204416

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:163908c895cad48b645dba6775ded2e8468b5a2c27e6b96791747db611287a2a
size 6363805696

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b71f9495be693a996bedf1fdd0ceb703f25f5ef8fbe1e96e19a6a484d26592d5
size 6209640448

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fd43f7d6742b3123b168601257dcb8c597ec653d5cee840fd2a8eaf3b5cb02b9
size 7344885760

3
Llama-3.2-9B-Uncensored-Brainstorm-Alpha.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be265cbcfe90dd8fccc73bded259c63567c8e84a79cbc3936234696b03ac6c18
size 8713344

117
README.md Normal file
View File

@@ -0,0 +1,117 @@
---
base_model: DavidAU/Llama-3.2-9B-Uncensored-Brainstorm-Alpha
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- llama-3
- llama3
- llama
- bfloat16
- uncensored
- all use cases
- creative use cases
- creative
- creative writing
- fiction writing
- plot generation
- sub-plot generation
- fiction writing
- story generation
- scene continue
- storytelling
- fiction story
- science fiction
- romance
- all genres
- story
- writing
- vivid prose
- vivid writing
- fiction
- roleplaying
- bfloat16
- swearing
- rp
- GGUFs
- merge
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/DavidAU/Llama-3.2-9B-Uncensored-Brainstorm-Alpha
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ1_S.gguf) | i1-IQ1_S | 2.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ1_M.gguf) | i1-IQ1_M | 2.4 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.6 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ2_S.gguf) | i1-IQ2_S | 3.1 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.3 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ2_M.gguf) | i1-IQ2_M | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q2_K.gguf) | i1-Q2_K | 3.5 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.6 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ3_S.gguf) | i1-IQ3_S | 4.1 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q3_K_S.gguf) | i1-Q3_K_S | 4.1 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ3_M.gguf) | i1-IQ3_M | 4.3 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.5 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ4_XS.gguf) | i1-IQ4_XS | 5.0 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-IQ4_NL.gguf) | i1-IQ4_NL | 5.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q4_0.gguf) | i1-Q4_0 | 5.3 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q4_K_S.gguf) | i1-Q4_K_S | 5.3 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.5 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q4_1.gguf) | i1-Q4_1 | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q5_K_S.gguf) | i1-Q5_K_S | 6.3 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.5 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF/resolve/main/Llama-3.2-9B-Uncensored-Brainstorm-Alpha.i1-Q6_K.gguf) | i1-Q6_K | 7.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->