mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-15 00:09:18 +08:00
commit 69185b103e
27 changed files with 227 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it-absolute-heresy.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

92
README.md Normal file
View File

@@ -0,0 +1,92 @@
---
base_model: MuXodious/gemma-3-1b-it-absolute-heresy
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- en
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- heretic
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/MuXodious/gemma-3-1b-it-absolute-heresy
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#gemma-3-1b-it-absolute-heresy-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-IQ1_S.gguf) | i1-IQ1_S | 0.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-IQ1_M.gguf) | i1-IQ1_M | 0.7 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-IQ3_S.gguf) | i1-IQ3_S | 0.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-IQ3_M.gguf) | i1-IQ3_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-Q4_0.gguf) | i1-Q4_0 | 0.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.8 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-Q4_1.gguf) | i1-Q4_1 | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3-1b-it-absolute-heresy.i1-Q6_K.gguf) | i1-Q6_K | 1.1 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
gemma-3-1b-it-absolute-heresy.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c48f089fae2658c0e0a4a78c3d294516b616a71b8efc5d6e1ecb7a0c8053c4d5
size 643487808

3
gemma-3-1b-it-absolute-heresy.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:194583696751361a13a1dc78a2dafdea3bc13bb65614109e189a0a95ab706171
size 639195456

3
gemma-3-1b-it-absolute-heresy.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4603aebdd11762499e19c739d7daaf9c0be8a534b26ad326bef13227b1b64b18
size 669785664

3
gemma-3-1b-it-absolute-heresy.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:443e65df7e7839ec367c29d998c27868c3a782654a2a173ffe0577f39a084051
size 664062528

3
gemma-3-1b-it-absolute-heresy.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8e1a80cfd8ff749be3473ead3637e4035f0fe412b03de088641a0db84b6f0973
size 657323328

3
gemma-3-1b-it-absolute-heresy.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5d2d26f5a3edd5fc394f96626bc9df2b6cbb8c2a824e161ca72f8391e15b4d1a
size 650641728

3
gemma-3-1b-it-absolute-heresy.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c53c34dd48a7295baf5d71459a3146a4ebc97ab5f3265e07529cb9f147b7e373
size 697062720

3
gemma-3-1b-it-absolute-heresy.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7c7a2966e0d3dd863846dd462fbd2596abfc812ee4940d23944d1b0d4d0414aa
size 689816640

3
gemma-3-1b-it-absolute-heresy.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:33baccfc60cc69b3b249a8fb0ec5a9221a0d1607fcb6840c898cef43de0c259a
size 689816640

3
gemma-3-1b-it-absolute-heresy.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7b562c20a54fbddba70d7ed94e4e84dec46f76906acc24950cfde16796eb7d1c
size 680112192

3
gemma-3-1b-it-absolute-heresy.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e06cfd378f27edec0276d4760b08ab64eb06bd30c08a50997a3fd9f76ff1756a
size 721865280

3
gemma-3-1b-it-absolute-heresy.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:27f11714d93b3d82dca07e8441ca5ff943cf37dd607994552982279790a62fed
size 714437184

3
gemma-3-1b-it-absolute-heresy.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0759ddb710c9d8ec9c89feed33e3310db314d590adb7219b71d934d9b7a16c94
size 689816640

3
gemma-3-1b-it-absolute-heresy.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cee87c20e33022727afc5e2cfb3514e0a08cb166221ff806fe6a41709d2c77c8
size 671274048

3
gemma-3-1b-it-absolute-heresy.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b87b6e62d5655cf49cb9bcf0ecb67a2dae0af2a0ad20f2b399a2dce2da2a7e53
size 751577664

3
gemma-3-1b-it-absolute-heresy.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2e6211f58f0068941df5d6ed7733f087d5a59ec6796c1e5d18e4f8d082f58e8c
size 722418240

3
gemma-3-1b-it-absolute-heresy.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f8bbbbc4ca018be673d855e65c01b8867524a2d22761691e296b86076d4983a6
size 688858176

3
gemma-3-1b-it-absolute-heresy.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a897ed16515f0fc2394ca5d83d1db4cfb37fe899140b368bf9c55f34e4087d56
size 721920576

3
gemma-3-1b-it-absolute-heresy.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f245ce2d7080ef810399fe3fa97d79f21941860966cf6ea0478cc198dd8da0a3
size 764037696

3
gemma-3-1b-it-absolute-heresy.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e181f25edcf6305439cbb4173b2754fb582733a9eab5dc5161ceeba4d073160e
size 806060352

3
gemma-3-1b-it-absolute-heresy.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8947eacc9e5c04547116cbc4154d5e4049b7d5b7d241b73c1cba9a8082fb2344
size 780995136

3
gemma-3-1b-it-absolute-heresy.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b73d1b903fb21132d66da14e14712b9b69c63fb00159b7c32feb6603a365727c
size 851347776

3
gemma-3-1b-it-absolute-heresy.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1f4da185d3e07fdb43f79d8ff3e20cce008246c5a37cce732ff3c5f23ee70cc7
size 836401728

3
gemma-3-1b-it-absolute-heresy.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:631dcb994b6f0800254b3d2aba71a4bcac00fa983e37b64f4555621fdbc8f831
size 1011740736

3
gemma-3-1b-it-absolute-heresy.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f19d79e385deafca47ea65123ea5c0aea2f85cc1066476a2934cd9a15dc9008f
size 1452416