mradermacher/gemma-3-12b-it-qat-q4_0-unquantized-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gemma-3-12b-it-qat-q4_0-unquantized-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-18 07:44:17 +08:00
commit 1266a2a1fb
15 changed files with 166 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

48
.gitattributes vendored Normal file
View File

@@ -0,0 +1,48 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-q4_0-unquantized.mmproj-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-q4_0-unquantized.mmproj-f16.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-q4_0-unquantized.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-q4_0-unquantized.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-q4_0-unquantized.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-q4_0-unquantized.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-q4_0-unquantized.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-q4_0-unquantized.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-q4_0-unquantized.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-q4_0-unquantized.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-q4_0-unquantized.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-q4_0-unquantized.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-q4_0-unquantized.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text

79
README.md Normal file
View File

@@ -0,0 +1,79 @@
---
base_model: google/gemma-3-12b-it-qat-q4_0-unquantized
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- en
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- gemma3
- gemma
- google
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: -->
static quants of https://huggingface.co/google/gemma-3-12b-it-qat-q4_0-unquantized
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#gemma-3-12b-it-qat-q4_0-unquantized-GGUF).***
weighted/imatrix quants are available at https://huggingface.co/mradermacher/gemma-3-12b-it-qat-q4_0-unquantized-i1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-q4_0-unquantized-GGUF/resolve/main/gemma-3-12b-it-qat-q4_0-unquantized.mmproj-Q8_0.gguf) | mmproj-Q8_0 | 0.7 | multi-modal supplement |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-q4_0-unquantized-GGUF/resolve/main/gemma-3-12b-it-qat-q4_0-unquantized.mmproj-f16.gguf) | mmproj-f16 | 1.0 | multi-modal supplement |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-q4_0-unquantized-GGUF/resolve/main/gemma-3-12b-it-qat-q4_0-unquantized.Q2_K.gguf) | Q2_K | 4.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-q4_0-unquantized-GGUF/resolve/main/gemma-3-12b-it-qat-q4_0-unquantized.Q3_K_S.gguf) | Q3_K_S | 5.6 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-q4_0-unquantized-GGUF/resolve/main/gemma-3-12b-it-qat-q4_0-unquantized.Q3_K_M.gguf) | Q3_K_M | 6.1 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-q4_0-unquantized-GGUF/resolve/main/gemma-3-12b-it-qat-q4_0-unquantized.Q3_K_L.gguf) | Q3_K_L | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-q4_0-unquantized-GGUF/resolve/main/gemma-3-12b-it-qat-q4_0-unquantized.IQ4_XS.gguf) | IQ4_XS | 6.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-q4_0-unquantized-GGUF/resolve/main/gemma-3-12b-it-qat-q4_0-unquantized.Q4_K_S.gguf) | Q4_K_S | 7.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-q4_0-unquantized-GGUF/resolve/main/gemma-3-12b-it-qat-q4_0-unquantized.Q4_K_M.gguf) | Q4_K_M | 7.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-q4_0-unquantized-GGUF/resolve/main/gemma-3-12b-it-qat-q4_0-unquantized.Q5_K_S.gguf) | Q5_K_S | 8.3 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-q4_0-unquantized-GGUF/resolve/main/gemma-3-12b-it-qat-q4_0-unquantized.Q5_K_M.gguf) | Q5_K_M | 8.5 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-q4_0-unquantized-GGUF/resolve/main/gemma-3-12b-it-qat-q4_0-unquantized.Q6_K.gguf) | Q6_K | 9.8 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-q4_0-unquantized-GGUF/resolve/main/gemma-3-12b-it-qat-q4_0-unquantized.Q8_0.gguf) | Q8_0 | 12.6 | fast, best quality |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->

3
gemma-3-12b-it-qat-q4_0-unquantized.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6f4c723a94a26f626262a6dddf9ed43c2aa6d161e7942a96a5cc3acbccf36804
size 6606261152

3
gemma-3-12b-it-qat-q4_0-unquantized.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f5ababc027660a1e79b6c32ee92b6af04d3a8e43a48643232824abbb7fcf2fdb
size 4768222112

3
gemma-3-12b-it-qat-q4_0-unquantized.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a547fb530ef6163a8778ea496a726f5acd7b26d55961eb979c6da88f4c0a0901
size 6480186272

3
gemma-3-12b-it-qat-q4_0-unquantized.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7bf2c71b149749c5dd46dd9db2fd717a6800ca229d698e0b38be942e3337ba74
size 6008818592

3
gemma-3-12b-it-qat-q4_0-unquantized.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:417631ea4cf563ec1c2dddf030fbfd5a02767177e2baec7b9df9d205d36f2c7d
size 5458316192

3
gemma-3-12b-it-qat-q4_0-unquantized.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b983116fb522ae08e14a0068a2fac83f2e10aaa3b426f2fbc00b99583261e5d5
size 7300778912

3
gemma-3-12b-it-qat-q4_0-unquantized.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:62a9e65fc7f0890847e1452eba49c319dfe4f7d874974ab8e03a5003d1abe691
size 6935333792

3
gemma-3-12b-it-qat-q4_0-unquantized.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ae6ee5fb7c63b67c393a7cf004c4524762d07fca2cbad9573831648c1fb4f209
size 8445037472

3
gemma-3-12b-it-qat-q4_0-unquantized.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:63988a50bce7e63da2f56f82e1f78f6dbd743f95d824d66af445054c1a7ce988
size 8231963552

3
gemma-3-12b-it-qat-q4_0-unquantized.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:588ec82a264575b68d9afea453932bcf74b82bf45935966e8835e7e36f58dc3c
size 9660812192

3
gemma-3-12b-it-qat-q4_0-unquantized.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:14aaf9c77bec15ec7ec7ff0552bae52cf19f220a284426e259c8725982cb840a
size 12510213152

3
gemma-3-12b-it-qat-q4_0-unquantized.mmproj-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ac432566140f9876aa4994e7fa200243a6d4b6f0172a7e494591f21f804ccfe7
size 594326944

3
gemma-3-12b-it-qat-q4_0-unquantized.mmproj-f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9fad25814f4865abe00f675cf8f78f16572f1d79461272eede0345ebbdbc335c
size 854200864