mradermacher/gemma-3-4b-it-heretic-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gemma-3-4b-it-heretic-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-15 02:50:16 +08:00
commit 78ea348a2d
16 changed files with 175 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

49
.gitattributes vendored Normal file
View File

@@ -0,0 +1,49 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic.mmproj-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic.mmproj-f16.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic.f16.gguf filter=lfs diff=lfs merge=lfs -text

84
README.md Normal file
View File

@@ -0,0 +1,84 @@
---
base_model: coder3101/gemma-3-4b-it-heretic
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- en
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- heretic
- uncensored
- decensored
- abliterated
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: -->
<!-- ### quants: x-f16 Q4_K_S Q2_K Q8_0 Q6_K Q3_K_M Q3_K_S Q3_K_L Q4_K_M Q5_K_S Q5_K_M IQ4_XS -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
static quants of https://huggingface.co/coder3101/gemma-3-4b-it-heretic
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#gemma-3-4b-it-heretic-GGUF).***
weighted/imatrix quants are available at https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-i1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-GGUF/resolve/main/gemma-3-4b-it-heretic.mmproj-Q8_0.gguf) | mmproj-Q8_0 | 0.7 | multi-modal supplement |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-GGUF/resolve/main/gemma-3-4b-it-heretic.mmproj-f16.gguf) | mmproj-f16 | 1.0 | multi-modal supplement |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-GGUF/resolve/main/gemma-3-4b-it-heretic.Q2_K.gguf) | Q2_K | 1.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-GGUF/resolve/main/gemma-3-4b-it-heretic.Q3_K_S.gguf) | Q3_K_S | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-GGUF/resolve/main/gemma-3-4b-it-heretic.Q3_K_M.gguf) | Q3_K_M | 2.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-GGUF/resolve/main/gemma-3-4b-it-heretic.Q3_K_L.gguf) | Q3_K_L | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-GGUF/resolve/main/gemma-3-4b-it-heretic.IQ4_XS.gguf) | IQ4_XS | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-GGUF/resolve/main/gemma-3-4b-it-heretic.Q4_K_S.gguf) | Q4_K_S | 2.5 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-GGUF/resolve/main/gemma-3-4b-it-heretic.Q4_K_M.gguf) | Q4_K_M | 2.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-GGUF/resolve/main/gemma-3-4b-it-heretic.Q5_K_S.gguf) | Q5_K_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-GGUF/resolve/main/gemma-3-4b-it-heretic.Q5_K_M.gguf) | Q5_K_M | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-GGUF/resolve/main/gemma-3-4b-it-heretic.Q6_K.gguf) | Q6_K | 3.3 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-GGUF/resolve/main/gemma-3-4b-it-heretic.Q8_0.gguf) | Q8_0 | 4.2 | fast, best quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-GGUF/resolve/main/gemma-3-4b-it-heretic.f16.gguf) | f16 | 7.9 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->

3
gemma-3-4b-it-heretic.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6233443da60480fa889f827cd18d1a1e2e7c157850a6f82ffb22c89c3af0f65e
size 2279626400

3
gemma-3-4b-it-heretic.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:36483f72a028dccc6e99d2e7ab1d1fb34a2afea2a8f16d4fc4df3380b49a5ba9
size 1729164960

3
gemma-3-4b-it-heretic.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3dd8abc03c88f62a3b79e273b35c4d2e2385cc2da1ec7c72b9ae60d688c26f94
size 2236085920

3
gemma-3-4b-it-heretic.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:97879516d52c4db123f446513135a07cced7df8ca10b321884d3c33ceb9ea07f
size 2098460320

3
gemma-3-4b-it-heretic.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0dda5d84f8c1bd3e6edd6df9b3b4bd58a18d34409e8b662690251d08327e18ff
size 1937364640

3
gemma-3-4b-it-heretic.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c08cd51b1713293bffd1447f9c352d8e12b0a9708bb484c226610e4457dc45b0
size 2489894560

3
gemma-3-4b-it-heretic.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1ba125db6de8f4823f48db32f03aa612cc342147a0ea53adc9589703b19d2a6c
size 2377930400

3
gemma-3-4b-it-heretic.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:853c8dc84fdd38a1a4debd949741fc53e3081c5f934080377b17deffe131720e
size 2829698720

3
gemma-3-4b-it-heretic.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1f75a969c6e7cfec97360fd3433f3a5e098178e8406af1c8089e9e36df9d80d5
size 2764592800

3
gemma-3-4b-it-heretic.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:da2225745bf08b1c99f63d2a81627a008f31806adc6822a4e5b4d221d2122820
size 3190740640

3
gemma-3-4b-it-heretic.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e6341db237d5935bb1e5fd9f9e7b3a8941a46da830479ca15c1bf5ec99fe4fa4
size 4130402720

3
gemma-3-4b-it-heretic.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2d67f98eb3f0bdfbcd47aef4f6bf6a13eb09a67ce4b2ba4ae691b57d385cf3ae
size 7767804320

3
gemma-3-4b-it-heretic.mmproj-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7b22a537a0f9687e426011a0fe2b793865689ecffc1f47d9baca8e4376ed793e
size 591377824

3
gemma-3-4b-it-heretic.mmproj-f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f507cc78140f15854e22dbb2bebf9dc5d92581b92aecd416ebb3ed8bd0236b54
size 851251744