mradermacher/Genuine-Gemma3-12B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Genuine-Gemma3-12B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-04 14:07:41 +08:00
commit d3f8b864ff
27 changed files with 229 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Genuine-Gemma3-12B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Genuine-Gemma3-12B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:67e66ff39ecb103cc39fee1473830c7b7f8809dd416f90d629e97706ac628af0
size 3164728896

3
Genuine-Gemma3-12B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4ddbbf212c4d46b3a932eea8bbdc2b21ed5418f94edae5bdcdd3cbbe1dbe9405
size 2947415616

3
Genuine-Gemma3-12B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:169f5243e582422ac8660e55fca19a9bf66f373b4d4f4a77993a2c8d180667b1
size 4310462016

3
Genuine-Gemma3-12B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ca2c6d4ef1f7934a6d979cfe7d660faf9cf56be8218db1afd6e3cf90ced8f224
size 4020710976

3
Genuine-Gemma3-12B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fe4fb9caeffd650125cb288d84412f014fc32e474241b68cf712c47201c2d6db
size 3840261696

3
Genuine-Gemma3-12B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:625d5cff2cde0d6d654336a5b44d65036c27f80ad87c9d0c8227ba0a3428cbbf
size 3526917696

3
Genuine-Gemma3-12B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b087df36318605782aa9dd2553707cf2ff4ca68fc8260850b6a08709f1fdf0e3
size 5655723456

3
Genuine-Gemma3-12B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aebd3e7c118feeec38b33708f5eeb308c6e1c804fb3169415989f933b77241d1
size 5458316736

3
Genuine-Gemma3-12B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1b614c54a9651973fb79ad725ab684b0876c086cc698b31624440a3b1d8024c6
size 5206166976

3
Genuine-Gemma3-12B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:66e2a077ee9ec4cf8ab90393379d458c505ca68b96f2d0531fa2d53832c355db
size 4784901696

3
Genuine-Gemma3-12B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1e567ba9aaa7ebcb0f8fef32ccc9301eb34382324829000f703e3c370d80a16a
size 6887165376

3
Genuine-Gemma3-12B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7de0f396c570f96b847a73dd073a74f444d20938d339bc24e862e2b91b5f8aea
size 6550965696

3
Genuine-Gemma3-12B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff9d3bd0f0826dbda56ed892bb4c5ad1e9633f1f78cf064e4181f37149fa00b1
size 4768222656

3
Genuine-Gemma3-12B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b86d458a2064c235a3aa481e644fcb0298ef4f6d221ac18b88b36742f491356d
size 4448611776

3
Genuine-Gemma3-12B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d41701eaa084a73b0b4fdbd8a812abab6063e59f6b69f09e41a92deebb95d885
size 6480186816

3
Genuine-Gemma3-12B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:471b929a96f2249b5d77289e254e0d80539f400e9454d13b3cff384c44c3bcdd
size 6008819136

3
Genuine-Gemma3-12B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e778c8d948627b3769c6287fcc64ceab38fba1bcd3ecaa6387f9e71f45f00332
size 5458316736

3
Genuine-Gemma3-12B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef32be423f7692600ec4f9f21bec732b0454c64e8e395d83b8fc51005658ab6f
size 6909283776

3
Genuine-Gemma3-12B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa595375792da16f208911b6664eafd4effa7c1fc41837e9296d44a932d58ecc
size 7559564736

3
Genuine-Gemma3-12B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3ab38e0d9faa3a0766434807266436ed732f37256e384e5cac0b6c87bf36d9f8
size 7300779456

3
Genuine-Gemma3-12B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5b098652d89147a19e1a8c5f16ed714096d80f1a229cc2bc9d81e849c5403d73
size 6935334336

3
Genuine-Gemma3-12B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2e93d224f35661fd093da8ff8fdd01525e634db79ceae3c8fd09d2bf38904c26
size 8445038016

3
Genuine-Gemma3-12B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:922dbb7033fe0774e25affe65881f2799e9df50add2ee8c2ef53fb49ea9c62fc
size 8231964096

3
Genuine-Gemma3-12B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a3c4e37bf722d31992ef2213adc40ca2b1c761604b4d99811b552e64328034bb
size 9660812736

3
Genuine-Gemma3-12B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8f0bc1fe0130243738aaebf91e3f606ef5f2630c368f20cbadb27e47a8a32a17
size 7473632

94
README.md Normal file
View File

@@ -0,0 +1,94 @@
---
base_model: theprint/Genuine-Gemma3-12B
datasets:
- theprint/Gentle-Pushback-v2-shareGPT
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- gemma3
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/theprint/Genuine-Gemma3-12B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Genuine-Gemma3-12B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Genuine-Gemma3-12B-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-IQ1_S.gguf) | i1-IQ1_S | 3.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-IQ2_S.gguf) | i1-IQ2_S | 4.1 | |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-IQ2_M.gguf) | i1-IQ2_M | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 4.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-IQ3_S.gguf) | i1-IQ3_S | 5.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.6 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.7 | |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.0 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-Q4_0.gguf) | i1-Q4_0 | 7.0 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-Q4_1.gguf) | i1-Q4_1 | 7.7 | |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.3 | |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.5 | |
| [GGUF](https://huggingface.co/mradermacher/Genuine-Gemma3-12B-i1-GGUF/resolve/main/Genuine-Gemma3-12B.i1-Q6_K.gguf) | i1-Q6_K | 9.8 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->