mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-15 02:38:16 +08:00
commit c53942be0f
27 changed files with 232 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-creative.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

97
README.md Normal file
View File

@@ -0,0 +1,97 @@
---
base_model: DrRiceIO7/gemma-3-4b-it-heretic-creative
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- en
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- heretic
- uncensored
- decensored
- abliterated
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: 1 -->
weighted/imatrix quants of https://huggingface.co/DrRiceIO7/gemma-3-4b-it-heretic-creative
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#gemma-3-4b-it-heretic-creative-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-IQ1_S.gguf) | i1-IQ1_S | 1.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-IQ1_M.gguf) | i1-IQ1_M | 1.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-IQ2_S.gguf) | i1-IQ2_S | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-IQ2_M.gguf) | i1-IQ2_M | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-Q2_K.gguf) | i1-Q2_K | 1.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-IQ3_XS.gguf) | i1-IQ3_XS | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-IQ3_S.gguf) | i1-IQ3_S | 2.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-IQ3_M.gguf) | i1-IQ3_M | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.3 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-Q4_0.gguf) | i1-Q4_0 | 2.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-Q4_1.gguf) | i1-Q4_1 | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-creative-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-creative.i1-Q6_K.gguf) | i1-Q6_K | 3.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
gemma-3-4b-it-heretic-creative.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d52f3868333675ceb0145f53b9f660d3d0dd84274fd5030494cbd79d39d9736d
size 1199571808

3
gemma-3-4b-it-heretic-creative.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2d9a1c39f449eb5c8a5da12bc3265b7c124dc9ca1b89d76a16f73ed32501aaa1
size 1133093728

3
gemma-3-4b-it-heretic-creative.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b58bb77b0f12bee4a683ce737e3175dc82062444e0fcd9681e89950482b0a26e
size 1537983328

3
gemma-3-4b-it-heretic-creative.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a152a8f1000cbdce04c0cac24c1a7ef7f8caec8ef3311ff52dc687f263d9557e
size 1449345888

3
gemma-3-4b-it-heretic-creative.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:df0bb27671533efe10ffd5e65c41bb5025907042f2ff3e7e7f52bead76237146
size 1404576608

3
gemma-3-4b-it-heretic-creative.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3e437284caa4d300120f732648fdb26ac23b64b8a38d3f7de94f1c21668bcd8d
size 1310368608

3
gemma-3-4b-it-heretic-creative.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fbe34204f02db491f399bd3f0aa26bbd8ac7e204fde7a8017bf941056f3d13d4
size 1986803808

3
gemma-3-4b-it-heretic-creative.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:68bb499baab4defd89623291817e8192d163eda86db63024c1b37db5b8903b00
size 1937365088

3
gemma-3-4b-it-heretic-creative.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f69747180ef2ec416859a0ed565aa53ce78623e6f1058a7e7d8a8133e47c6a0
size 1863391328

3
gemma-3-4b-it-heretic-creative.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2aa43c762cfe7951882bfa5951cfdb13420baab9d1f18caa23d4a7c71677348f
size 1689453408

3
gemma-3-4b-it-heretic-creative.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3a303826fa0381f314017b643fa6ab17fe01f27f323abe34d4936fba077000a5
size 2363512928

3
gemma-3-4b-it-heretic-creative.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:18116c721f67d99ea464da38173ce7cfa0d28a0ca36a16743aff6e40ba49ebad
size 2263242848

3
gemma-3-4b-it-heretic-creative.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c8b3fddac4f8406ee6165c35810077ee904c53848741a551cb052285a67ccafe
size 1729165408

3
gemma-3-4b-it-heretic-creative.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:860939f4a65883f3ba1eafe1cd3995b35a72f1f4330839389e00d91ddeac2c29
size 1636063328

3
gemma-3-4b-it-heretic-creative.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3f0c69ff486a7319b684c276e3eeb1f7b5a43c997f9c7603307017ae0503819a
size 2236086368

3
gemma-3-4b-it-heretic-creative.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7da4831846bf711f6c588a2246952f379e94ca1bab941a67242f8420e6d32174
size 2098460768

3
gemma-3-4b-it-heretic-creative.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:792d7c69198b910b2b84d2491d0c43e6d0456c215eccfda14d350cd9f2470340
size 1937365088

3
gemma-3-4b-it-heretic-creative.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:faf98754672ecdc574ac953b841f4fe70434586167303b2e2e483684ef656519
size 2370066528

3
gemma-3-4b-it-heretic-creative.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5fa34655af77734e3f17a4ad3630024f2e6ffcd968e0cc088d3fb5401a83ed3b
size 2564053088

3
gemma-3-4b-it-heretic-creative.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:02fe4e6e3ded8f2812a22296251db1fb4d5b26a49b43edc28c60678e6bde61ec
size 2489895008

3
gemma-3-4b-it-heretic-creative.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb999dc2133686938b7ee7f20d9eb417fe40b7b4d8e687baf5b7eb05557f1523
size 2377930848

3
gemma-3-4b-it-heretic-creative.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9cfa7ff51bb3fa6529fce586ec8997d88158f0a3058629e207698169fb7feefc
size 2829699168

3
gemma-3-4b-it-heretic-creative.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6afd385a371d5b52a7871a091f0d3fbfe8a37c9f83c0516abc41a3c141eaeb35
size 2764593248

3
gemma-3-4b-it-heretic-creative.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9462bcc7176d69fe14f4b54fd5a1a4b9dbb8892b3516acc198e1339cbf382c37
size 3190741088

3
gemma-3-4b-it-heretic-creative.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:239640cab79b2bddda9be9fdb511cfbc5121363a443b79f2423acb91347ed97a
size 3448608