mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-14 20:32:17 +08:00
commit 8e449411ca
27 changed files with 235 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

100
README.md Normal file
View File

@@ -0,0 +1,100 @@
---
base_model: megabytes/gemma-3-12b-qat-int4-heretic
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- en
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- gemma3
- gemma
- google
- heretic
- uncensored
- decensored
- abliterated
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/megabytes/gemma-3-12b-qat-int4-heretic
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ1_S.gguf) | i1-IQ1_S | 3.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ2_S.gguf) | i1-IQ2_S | 4.1 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ2_M.gguf) | i1-IQ2_M | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 4.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ3_S.gguf) | i1-IQ3_S | 5.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.6 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.0 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q4_0.gguf) | i1-Q4_0 | 7.0 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q4_1.gguf) | i1-Q4_1 | 7.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.3 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.5 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-qat-int4-unquantized-heretic-i1-GGUF/resolve/main/gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q6_K.gguf) | i1-Q6_K | 9.8 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ad719005d459958548ed010c919986d592a2fe6b393523e6981247dd1c4aea4b
size 3164729952

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d7ed80306c933a9d798e926054e0b7966b6b5d6c7e4a3c22bdebfe6b951020cd
size 2947416672

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f5b460cbcb851a5b1d857c070478371f12f4bf9144a7308b2a52463db1e61fff
size 4310463072

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:09615049e69d2b593ac17cd6adef1f7fae79e35ca7d25e6317f1eab0288ab19c
size 4020712032

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c36cdf7442b8a0af494c96bf8a419bcfd3a9deec4f8d3cdbe5ab55cffd8acdb1
size 3840262752

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cee8f25678ee0e86af658dadbcf1c8ca8a5cf0ba2ce85f6cb635cf3cc5d4951b
size 3526918752

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa29a32fb41789abf0677e82cfeecc41acba4b9d609235c10599bdfc855a6acb
size 5655724512

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:18801d2f0ba92853dd11c5bf0e55d8c2438fa47583636fffae635f267316fd8e
size 5458317792

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:28d71b52a64fda4200e35f01e486c6d8000d870d580dbb63ee7f115200c404c9
size 5206168032

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0d7b386a28f8292f1dbbfe1f467f2c72683caaeeac03e6f3f854f695ae27603d
size 4784902752

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bbc29eca09d7506968cfc2d7bdb73c19fd608b8305a9172d857724f26dffe24a
size 6887166432

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:18b3bbf012fb1f085c99b85c39c54c5476b81f775dca86abca8989f105aa2c53
size 6550966752

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb105cca1a658025f4addb5f23d80060ebbdda68f88cbb2777b0e8ecda3c832e
size 4768223712

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d5399a32db480dd27cc9cfdcd06d7af483a9915094472dc94863018cee67ce01
size 4448612832

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f85de1584dd8dc8a4e603b5b883a2c3863d49fb44d45877116c1033858b11859
size 6480187872

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3e4e42bf4721da4e1440b44c391c945e8940d9f9fbddbd27a70fddd54eaac7e0
size 6008820192

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:06472cc5752ef18dc58fa3a51917eb880df4b67e24fbbc78656f681a9eeed87f
size 5458317792

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:551929c40e1c1d96dd7bc6ce646cd42186474be821c57ff6b1585806931b5e11
size 6909284832

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:87e2a9fbd507992cf99dbd15cc880d3d28afa8a8c508b41c4b7da4316b064bf2
size 7559565792

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e44e80df4e02ef20757f424b6eb252c1b227e98dce0096335ee8a63e58fa11b2
size 7300780512

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:50d79e13b431b69de442a93c61c2ddb44f854cc88d5a670aaecde559241eda1b
size 6935335392

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d62529bbc34a462b8a9011a21b07d0fddc8632d539dda7ccf72fa5146adee338
size 8445039072

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6539245dbb68e6a82bcc52368eeab69ee34e6065c2ab27f36b3b58e2eae37a91
size 8231965152

3
gemma-3-12b-it-qat-int4-unquantized-heretic.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4766daccfd83bf83047a18687d48cf36c76507c173fe0491d5a7095b940f89a7
size 9660813792

3
gemma-3-12b-it-qat-int4-unquantized-heretic.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c1f95d681fc92b881b23d32b0fd2aa964beaacbc47631b360fc2c7788a589836
size 7473632