mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-15 02:41:16 +08:00
commit 5e1d582d18
27 changed files with 232 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-heretic-logic.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

97
README.md Normal file
View File

@@ -0,0 +1,97 @@
---
base_model: DrRiceIO7/gemma-3-4b-it-heretic-logic
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- en
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- heretic
- uncensored
- decensored
- abliterated
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: 1 -->
weighted/imatrix quants of https://huggingface.co/DrRiceIO7/gemma-3-4b-it-heretic-logic
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#gemma-3-4b-it-heretic-logic-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-IQ1_S.gguf) | i1-IQ1_S | 1.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-IQ1_M.gguf) | i1-IQ1_M | 1.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-IQ2_S.gguf) | i1-IQ2_S | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-IQ2_M.gguf) | i1-IQ2_M | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-Q2_K.gguf) | i1-Q2_K | 1.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-IQ3_XS.gguf) | i1-IQ3_XS | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-IQ3_S.gguf) | i1-IQ3_S | 2.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-IQ3_M.gguf) | i1-IQ3_M | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.3 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-Q4_0.gguf) | i1-Q4_0 | 2.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-Q4_1.gguf) | i1-Q4_1 | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-heretic-logic-i1-GGUF/resolve/main/gemma-3-4b-it-heretic-logic.i1-Q6_K.gguf) | i1-Q6_K | 3.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
gemma-3-4b-it-heretic-logic.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:28263a05f8b42b69543db9b2eea95a33315d9727dd6d1c7266abaec53bf5b1e2
size 1199571776

3
gemma-3-4b-it-heretic-logic.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f70a84915468e968988b1a62b40a501ecca2239df750fa34ae26363faaa3214
size 1133093696

3
gemma-3-4b-it-heretic-logic.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:212aeaac35ea00a20d56d1d57cbdd174c7aeb20a19d8fde49d5edd23508bf94c
size 1537983296

3
gemma-3-4b-it-heretic-logic.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e70ad3d3f1828a621e5514d88f2d45cf20624a8a9100e459d5cac971da867e82
size 1449345856

3
gemma-3-4b-it-heretic-logic.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:54195246efc5c835eed4e156c74ba6c7d9da738b78579709bbd67f944583f5ee
size 1404576576

3
gemma-3-4b-it-heretic-logic.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b1ebce50112714ddb3142a4872df16815682f7f96fb59e426e38519b49468b9e
size 1310368576

3
gemma-3-4b-it-heretic-logic.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e29baea9b2b80c899d795ec0ab0671f8cf6b49b5949b64f8579cb6796fc305f0
size 1986803776

3
gemma-3-4b-it-heretic-logic.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:05b6c2f5b19e6dcb28e30ca45c52c068d798e475340b4d1c3e059018fe346272
size 1937365056

3
gemma-3-4b-it-heretic-logic.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:03606e4a0ad878375e8b03ac27f78f5b1026267ec80d66c6de0bd4ef3571e17d
size 1863391296

3
gemma-3-4b-it-heretic-logic.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9fab346db9bf31cd842923e2558a6e1a2e0ead945df510247ec726776a0cb7ea
size 1689453376

3
gemma-3-4b-it-heretic-logic.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b1e64fcf0f24667862cba20c818da129f1b8a473187fba3320dbd1a13d616d74
size 2363512896

3
gemma-3-4b-it-heretic-logic.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc47511d4d290b0ae297c02c36911974f12e9b331f25fe134a38501116dfae2b
size 2263242816

3
gemma-3-4b-it-heretic-logic.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:16bcb632e5beda2fb1d68c7db386e2b2f03d1408ad7f82297c3cdbade36d0ebd
size 1729165376

3
gemma-3-4b-it-heretic-logic.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f7c36e292d805929b01496a78d17a4c1120b640e5fe0813c940e9675f557e9a4
size 1636063296

3
gemma-3-4b-it-heretic-logic.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c9aabeb16804755dcc8fbbac1b7636e86fda9a88620a87b4bf8632fe7383e2e
size 2236086336

3
gemma-3-4b-it-heretic-logic.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2938386b9268b3f26589200126a5456ac215f55c56d345988d02133339f5655d
size 2098460736

3
gemma-3-4b-it-heretic-logic.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0f4b3ac92fe9a2dd1c7de3cc4aeda7e9a882382f9dfe745305efe6cf9338d4c7
size 1937365056

3
gemma-3-4b-it-heretic-logic.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f23feb242bd63a9a48de58423dd1dc717d83168a3f433009dda9981a4eaaee83
size 2370066496

3
gemma-3-4b-it-heretic-logic.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eae325c3373910dfd9131b87ccaae0adaf3179ea6c7840974a28b677d7dc7ff4
size 2564053056

3
gemma-3-4b-it-heretic-logic.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1e21437150021fd4b3f1c1edf8a5f0feab1f13b3c6410c476f268c95f3dc7a07
size 2489894976

3
gemma-3-4b-it-heretic-logic.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ccc188120de836c897293f11acdc3543eb92fe4e6503a9664d697959ec6d931a
size 2377930816

3
gemma-3-4b-it-heretic-logic.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e91c3c7841f9631bbfffebae5eba0a2258ec723aa6a74958c1d5d2e9938db7d4
size 2829699136

3
gemma-3-4b-it-heretic-logic.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b5b725138ce811e982abf55ae8ab35209b4c336edee95d9a57c0606087ad4d10
size 2764593216

3
gemma-3-4b-it-heretic-logic.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:07e12f69bbc11a7759a6d84d71f3e680b5917ed174082bb8c16f3e8c32f9ade5
size 3190741056

3
gemma-3-4b-it-heretic-logic.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:940e196cca1e1eda1db1f21cedc6c0ac21ebf29f209ceafea5efc13668e14c6d
size 3448608