初始化项目,由ModelHub XC社区提供模型

Model: mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-15 02:20:16 +08:00
commit 4359b44ad3
27 changed files with 232 additions and 0 deletions

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-it-PaperWitch-heresy.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

97
README.md Normal file
View File

@@ -0,0 +1,97 @@
---
base_model: MuXodious/gemma-3-4b-it-PaperWitch-heresy
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, youre required to review and
agree to Googles usage license. To do this, please ensure youre logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- en
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- heretic
- uncensored
- decensored
- abliterated
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/MuXodious/gemma-3-4b-it-PaperWitch-heresy
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#gemma-3-4b-it-PaperWitch-heresy-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-IQ1_S.gguf) | i1-IQ1_S | 1.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-IQ1_M.gguf) | i1-IQ1_M | 1.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-IQ2_S.gguf) | i1-IQ2_S | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-IQ2_M.gguf) | i1-IQ2_M | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-Q2_K.gguf) | i1-Q2_K | 1.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-IQ3_XS.gguf) | i1-IQ3_XS | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-IQ3_S.gguf) | i1-IQ3_S | 2.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-IQ3_M.gguf) | i1-IQ3_M | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.3 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-Q4_0.gguf) | i1-Q4_0 | 2.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-Q4_1.gguf) | i1-Q4_1 | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-it-PaperWitch-heresy-i1-GGUF/resolve/main/gemma-3-4b-it-PaperWitch-heresy.i1-Q6_K.gguf) | i1-Q6_K | 3.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6936c8e5fa98c855b52a48cae3a1f92c9b2d06f587b749223db0df36cab3b4c7
size 1199571808

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be18c1b8121d9b28224c132ea69458ee68f8fe82c7fda30c67dc039a5d4d43bd
size 1133093728

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:992d7af0c41217fb2a22529265fa336fba75154cd45bef2d248b575c48894722
size 1537983328

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0323de8280525ff7830585b3bb5b8a60154b948e4dd0ec5e457a3c4a062a1d25
size 1449345888

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b233c45d74755d98aa170e8eeb4a80b01be490c6f71eb8d550491ccf884dbe99
size 1404576608

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:104f03a761899fff5458236f5a1fbae9af6174474ccc0032b73a9bcde12e77eb
size 1310368608

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:edf4f6af8442334a508aa13ebbc3d624be7f6eb02e0a6761d468a04961814600
size 1986803808

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:104f4abf21d6e0b5539ce501b5fb8084656bce72ecd020ebdc2c77000be661e8
size 1937365088

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:667b2f7665f233a4c06ca0932e3072bf6a2c10841abf68b33a3089093fd54f55
size 1863391328

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:af08efc59378886d1df294b0f5f3c28f3c45d62f258d05e8793720dfd74c59ee
size 1689453408

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8cd10d6fbad41e89e0870ce7e586c64823391be5f69d63799ccea9efb53d173d
size 2363512928

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b8c44639e5eee14ee927e255a566a3dbbe2e0f7b251965ceb3369e3996cbcf18
size 2263242848

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:40c1bd33c36ab65d269f13938dd22ea2c5e8df5f6637672acc2565bde182164f
size 1729165408

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:64b12f46bc2515954cd48e0bb7e6ff18126f446ef643f70fb4d9022976a2c633
size 1636063328

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1e77389cd69ac7cf7bba7a840c0f275de1eeeea40847bea3f94db0d7484fd85c
size 2236086368

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d3fc224ce0aad9dc9a3b644d0583e1969de29ed276863f7f18df04eda18e53a4
size 2098460768

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:891638627c1ab16652ccc2fd1a3cb976a49f783f78f2b1405577bfa318f20ae3
size 1937365088

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d76afda6c00a659ea47e2058d639f6128ff30b3eda0915bfe8e83d2ee0306950
size 2370066528

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6fd8ea686b07ae9b90bb5080b7336178738c7a5b977915f4893d1f065023970a
size 2564053088

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:34fe6dc098068bf8ae6112344426e455ce80ad23abb79ce0c1d21d0e81b6140d
size 2489895008

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:84c93cdcc0baf275312bf105fb2bf7564e31a472bfbbf89f7d8172d40d1ce9c6
size 2377930848

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c4f72c9bf0ec1ccb8edbecb7cbd341fbec2ec102fb1123cfa3cad5cb793abc1e
size 2829699168

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:49ad35039b415e0bb349ddd940895c9e57f0f9af2e944a546ba8bd8df3115cc4
size 2764593248

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:477cd3c7cfce517283d2edce1c9aae710a5d30f8c03600035a9bf6be95b61256
size 3190741088

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:76d5ba3600a834cf65f19328685392aaee794d7c19e9c5cb03e636fb2a9dab38
size 3448608