mradermacher/gemma-3-12b-it-heretic-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gemma-3-12b-it-heretic-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-17 07:26:16 +08:00
commit 2b857b300c
27 changed files with 232 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-heretic.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

97
README.md Normal file
View File

@@ -0,0 +1,97 @@
---
base_model: p-e-w/gemma-3-12b-it-heretic
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- en
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- heretic
- uncensored
- decensored
- abliterated
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/p-e-w/gemma-3-12b-it-heretic
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#gemma-3-12b-it-heretic-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-IQ1_S.gguf) | i1-IQ1_S | 3.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-IQ2_S.gguf) | i1-IQ2_S | 4.1 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-IQ2_M.gguf) | i1-IQ2_M | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 4.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-IQ3_S.gguf) | i1-IQ3_S | 5.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.6 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.0 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-Q4_0.gguf) | i1-Q4_0 | 7.0 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-Q4_1.gguf) | i1-Q4_1 | 7.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.3 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.5 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-heretic.i1-Q6_K.gguf) | i1-Q6_K | 9.8 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
gemma-3-12b-it-heretic.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bd484147ca2c09b109b8d6b68be40e795fde4b85d7079000b4cf52b42a1d6314
size 3164728608

3
gemma-3-12b-it-heretic.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:283f74b55c58afc2257d3e31a59c217e22d23410d0c965673b4d5aca20507bc8
size 2947415328

3
gemma-3-12b-it-heretic.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b43579f24d73825d120c5202c2ef010dbd5e4b670e0b2576a5b7c9787f5d726f
size 4310461728

3
gemma-3-12b-it-heretic.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b4697480d32c369e14acb676902060e180e0fcd4c090961615f583039c92118
size 4020710688

3
gemma-3-12b-it-heretic.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:951467dc19c8957a16317c6e43d2b30a103aef93b57d100f628be3a7f636b939
size 3840261408

3
gemma-3-12b-it-heretic.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f0db96525d4e1c99420bfa20ecdd1526e792fe60a3c6ff19cd9206214314dd62
size 3526917408

3
gemma-3-12b-it-heretic.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:123a8fc280cc6fa297c369b9b789581148b2a778ef5f90e4620f12d363a1c751
size 5655723168

3
gemma-3-12b-it-heretic.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c57d14eed0172d1378326ce51840a37aef4f61c650acd2e2f0691eef25a992da
size 5458316448

3
gemma-3-12b-it-heretic.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c18e2a90b4306bcc15fe7196d9cebb4046d9546d5fb287b01e2b8f81cde0ce8d
size 5206166688

3
gemma-3-12b-it-heretic.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:02dbef729e6f320a242373a3c3c227cd9a694073a515a35a5c55b519b6e1d338
size 4784901408

3
gemma-3-12b-it-heretic.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2b39cd49d8ea7b6191f78c7748e21910d36c920a80098b6dc2e993eb3e00edbd
size 6887165088

3
gemma-3-12b-it-heretic.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:868083ded1cc543627376a527c9ac3a59c0dfcba1aaca9b34e31975755083bbe
size 6550965408

3
gemma-3-12b-it-heretic.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7934a6b9ec76af33b63382eb8322052585b7d13a18d0b2ef585aa061573d852d
size 4768222368

3
gemma-3-12b-it-heretic.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:36dc069850fc9c2025c7c2a106baf2c43262f523d6f4955d6a64f5105daf4a79
size 4448611488

3
gemma-3-12b-it-heretic.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6129794608c2e477596914f1dcff6f624e4c3a65fef79d51e4f0b9e1fdd87b86
size 6480186528

3
gemma-3-12b-it-heretic.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b16c714d618b27bd284b82c971809c5c496380a8066e955a2815e5149eb563a5
size 6008818848

3
gemma-3-12b-it-heretic.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ccdb68abba60bc769a8a9b29b24d9e4257156431791cbc50ae499be46a9a0da9
size 5458316448

3
gemma-3-12b-it-heretic.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b16bc429405fe2208a84bf6efcb077d04d8b792777d1ca3554585abce357064
size 6909283488

3
gemma-3-12b-it-heretic.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2ee99cfb0bd19d57ce5f171020bf614d093c5574d20813b75e6738d60d74871e
size 7559564448

3
gemma-3-12b-it-heretic.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d8cba6c1978237bfbc70cbe985eae716df9ad1083946f25ba74d680131be2ffe
size 7300779168

3
gemma-3-12b-it-heretic.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:100a24e30632f6e4d247865c985291449f372b80740e267fff3141d18a3a8fa2
size 6935334048

3
gemma-3-12b-it-heretic.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba4061cbddaee57b14f9cf016860c3eada80f0c6a919d52dbd98f98ab03204e9
size 8445037728

3
gemma-3-12b-it-heretic.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:02a4db13e7ff4d9f272d3f89dce58a39cf2a3aa1fb7282138039a4da0cd1187b
size 8231963808

3
gemma-3-12b-it-heretic.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21c86a7589303baf2d6f5d6c9b9fede4dba00cda1a40c4be1d0496f8152b9bd4
size 9660812448

3
gemma-3-12b-it-heretic.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:985625b7956f883e35fd2e64b44d6e42f2cbde74307a8e194f3d7b664cb709da
size 7473632