mradermacher/gemma-3n-E2B-it-absolute-heresy-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gemma-3n-E2B-it-absolute-heresy-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-15 22:02:23 +08:00
commit b182f8872e
19 changed files with 191 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

52
.gitattributes vendored Normal file
View File

@@ -0,0 +1,52 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gemma-3n-E2B-it-absolute-heresy.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3n-E2B-it-absolute-heresy.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3n-E2B-it-absolute-heresy.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3n-E2B-it-absolute-heresy.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3n-E2B-it-absolute-heresy.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3n-E2B-it-absolute-heresy.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3n-E2B-it-absolute-heresy.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3n-E2B-it-absolute-heresy.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3n-E2B-it-absolute-heresy.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3n-E2B-it-absolute-heresy.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3n-E2B-it-absolute-heresy.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3n-E2B-it-absolute-heresy.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3n-E2B-it-absolute-heresy.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3n-E2B-it-absolute-heresy.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3n-E2B-it-absolute-heresy.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3n-E2B-it-absolute-heresy.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3n-E2B-it-absolute-heresy.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

88
README.md Normal file
View File

@@ -0,0 +1,88 @@
---
base_model: MuXodious/gemma-3n-E2B-it-absolute-heresy
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- en
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- automatic-speech-recognition
- automatic-speech-translation
- audio-text-to-text
- video-text-to-text
- heretic
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/MuXodious/gemma-3n-E2B-it-absolute-heresy
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#gemma-3n-E2B-it-absolute-heresy-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/gemma-3n-E2B-it-absolute-heresy-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-3n-E2B-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3n-E2B-it-absolute-heresy.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/gemma-3n-E2B-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3n-E2B-it-absolute-heresy.i1-Q2_K.gguf) | i1-Q2_K | 2.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3n-E2B-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3n-E2B-it-absolute-heresy.i1-IQ3_XS.gguf) | i1-IQ3_XS | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3n-E2B-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3n-E2B-it-absolute-heresy.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.3 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3n-E2B-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3n-E2B-it-absolute-heresy.i1-IQ3_S.gguf) | i1-IQ3_S | 2.3 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gemma-3n-E2B-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3n-E2B-it-absolute-heresy.i1-IQ3_M.gguf) | i1-IQ3_M | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3n-E2B-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3n-E2B-it-absolute-heresy.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3n-E2B-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3n-E2B-it-absolute-heresy.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3n-E2B-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3n-E2B-it-absolute-heresy.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3n-E2B-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3n-E2B-it-absolute-heresy.i1-Q4_0.gguf) | i1-Q4_0 | 2.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3n-E2B-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3n-E2B-it-absolute-heresy.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/gemma-3n-E2B-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3n-E2B-it-absolute-heresy.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3n-E2B-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3n-E2B-it-absolute-heresy.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-3n-E2B-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3n-E2B-it-absolute-heresy.i1-Q4_1.gguf) | i1-Q4_1 | 3.1 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3n-E2B-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3n-E2B-it-absolute-heresy.i1-Q5_K_S.gguf) | i1-Q5_K_S | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3n-E2B-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3n-E2B-it-absolute-heresy.i1-Q5_K_M.gguf) | i1-Q5_K_M | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3n-E2B-it-absolute-heresy-i1-GGUF/resolve/main/gemma-3n-E2B-it-absolute-heresy.i1-Q6_K.gguf) | i1-Q6_K | 3.8 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
gemma-3n-E2B-it-absolute-heresy.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8d9a424ca7df547f562363592805e4172ce166e154b3216bd5e63da3e47a6503
size 2237158176

3
gemma-3n-E2B-it-absolute-heresy.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7f4a766d2ef8d2ec013ef607d071599eff0b24923f2b6150d82830fc7d4ba013
size 2213761824

3
gemma-3n-E2B-it-absolute-heresy.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:01c2b070a1311532c6003213c60a5dc39c678d1e2ef5d60e12dfebef15092229
size 2170213152

3
gemma-3n-E2B-it-absolute-heresy.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9f4fe731b4d6e5ce6609a89a43e57bece318aacdfffc990a0865407231163ffb
size 2727400224

3
gemma-3n-E2B-it-absolute-heresy.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ea0e8ae06708e274a01dd10dd581a82380976adc09c3f0ede008624cb226acb8
size 2607469344

3
gemma-3n-E2B-it-absolute-heresy.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4725e2949ab3580c61b1916d9f70c9831aaa2de06a0babe1a08721c73b8da71
size 1887884064

3
gemma-3n-E2B-it-absolute-heresy.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2c8905f0d3fc1155848799fc69c0dd2cbb38135b0319700021082d7bfe6c409e
size 2379895584

3
gemma-3n-E2B-it-absolute-heresy.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:109a0eb94ef923276d8bbe7b26f82d0dde990082530ab03d936e661b26553508
size 2299679520

3
gemma-3n-E2B-it-absolute-heresy.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b0fdbf4919d156f30936fc6c0fa0adeba8f5a961018ed32830a5707de9c858aa
size 2209583904

3
gemma-3n-E2B-it-absolute-heresy.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1200e95a11601c28e239f9ae044a07e98d2b4765198471704835ecb8a654bc1a
size 2726613792

3
gemma-3n-E2B-it-absolute-heresy.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ae44ad38aa49761ab1b5594acd77ecad6ab95bcc0a7e832421d2ca8cabd7293
size 2965295904

3
gemma-3n-E2B-it-absolute-heresy.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb2688b4cea6a9e3949023e1ce0f22fd0f9981fa86ddc83c3dfea6683f1e3641
size 2787808032

3
gemma-3n-E2B-it-absolute-heresy.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3a64d430cd3f3d331ee9a7cd595979d10f529663a6881519a22650306a51c91f
size 2730283808

3
gemma-3n-E2B-it-absolute-heresy.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:44c82e59fa667a935a714e01632d15d82fbc260be35d5e2b41144185ae55b008
size 3240268576

3
gemma-3n-E2B-it-absolute-heresy.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:43a5e00f009b457260df9386354a8835919adb09716a958a44bc269587f97f4d
size 3207123744

3
gemma-3n-E2B-it-absolute-heresy.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc0a0310aa657d4200e4d51b647db9e5713f68f3b662b6cf1daf7353b367f481
size 3721007904

3
gemma-3n-E2B-it-absolute-heresy.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5a440b9ae421128aa6bbcc6745976925f4b9e406d2044bed7bddeb2080c703b0
size 3134272