mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-14 18:46:17 +08:00
commit f05455c17f
27 changed files with 226 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-12b-it-abliterated-refined-novis.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

91
README.md Normal file
View File

@@ -0,0 +1,91 @@
---
base_model: Nabbers1999/gemma-3-12b-it-abliterated-refined-novis
language:
- en
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- gemma
- gemma-3
- text-generation
- conversational
- abliterated
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Nabbers1999/gemma-3-12b-it-abliterated-refined-novis
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#gemma-3-12b-it-abliterated-refined-novis-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-IQ1_S.gguf) | i1-IQ1_S | 3.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-IQ2_S.gguf) | i1-IQ2_S | 4.1 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-IQ2_M.gguf) | i1-IQ2_M | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 4.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-IQ3_S.gguf) | i1-IQ3_S | 5.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.6 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.0 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-Q4_0.gguf) | i1-Q4_0 | 7.0 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-Q4_1.gguf) | i1-Q4_1 | 7.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.3 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.5 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-12b-it-abliterated-refined-novis-i1-GGUF/resolve/main/gemma-3-12b-it-abliterated-refined-novis.i1-Q6_K.gguf) | i1-Q6_K | 9.8 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
gemma-3-12b-it-abliterated-refined-novis.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:41ec5c776703ef65e1b5a267887d409e945763196dee6422b2a6f6e046d31fd1
size 3164728864

3
gemma-3-12b-it-abliterated-refined-novis.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:554434082931f6e2fa5f0417f29dc71ba7ae6e468a601d7e29e15f2780eb787f
size 2947415584

3
gemma-3-12b-it-abliterated-refined-novis.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2edd2cf99e189cc7da644a2b65c4aaaeab6f2f7a9e803e0e1b5c8f85f9bf0688
size 4310461984

3
gemma-3-12b-it-abliterated-refined-novis.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4dfde372db3bd3c8581a106c5a31198056f7d696f9ce5614f1c18a22e8f6064b
size 4020710944

3
gemma-3-12b-it-abliterated-refined-novis.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c22400731563bf61751b1da2b91c75beebe1176a7f60f74ab5b03332019e3df4
size 3840261664

3
gemma-3-12b-it-abliterated-refined-novis.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d89e0f3ed6fb587ceb3d042d7b8841a006060746cf2ff2128b56cfef50eab535
size 3526917664

3
gemma-3-12b-it-abliterated-refined-novis.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ea871dd036445aafed394d488bad15691c1381ede622e75fee73ef107576e15
size 5655723424

3
gemma-3-12b-it-abliterated-refined-novis.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a5b622bd1ca7555191026ab0752bb6c3157b43eb855afc5172d8245a3ef2ad4c
size 5458316704

3
gemma-3-12b-it-abliterated-refined-novis.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f041ac5b9e47a9bb0f44bbf168e5fe75b7a0a67a661b1f2578de41dda494c80b
size 5206166944

3
gemma-3-12b-it-abliterated-refined-novis.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:42da71295be0b8c7ec69158eb6c954648256141ed4090b99df82432858aeb082
size 4784901664

3
gemma-3-12b-it-abliterated-refined-novis.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8e6b6b73fee275328fed21eb2528de5e0bd3381220461e69ec5f606a1819c4f0
size 6887165344

3
gemma-3-12b-it-abliterated-refined-novis.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:019677c64e9aaf081d347e0370697b62eba0fe4d3f0dc114af63bb61c587f906
size 6550965664

3
gemma-3-12b-it-abliterated-refined-novis.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:91f7c6f02b474f78697fd8fc705107390b8c39796795f2f7a72b697e94889b50
size 4768222624

3
gemma-3-12b-it-abliterated-refined-novis.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:15af6787de85af44678654aadeecf2b45e0f55948bcdd000ae6e9b924fd610da
size 4448611744

3
gemma-3-12b-it-abliterated-refined-novis.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc400561e1f0a79daef4873c348a72794183cc2535f19ebccbaac03f42a4b8b9
size 6480186784

3
gemma-3-12b-it-abliterated-refined-novis.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:abde8789f63de12979c505d6cd9b1a69e1b640407168c549c6fd864f543fd58f
size 6008819104

3
gemma-3-12b-it-abliterated-refined-novis.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:800b12585209e9517f33f65cb400fde4918d76a94e53b010e90696a15afea410
size 5458316704

3
gemma-3-12b-it-abliterated-refined-novis.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:821a4bdf5482279e0463a8bf9fd10ad477991ae195a075d1ab8d66d3adaa5886
size 6909283744

3
gemma-3-12b-it-abliterated-refined-novis.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:310a63c49e38e313fe4c28e240d5983cd93e2e0928d12601dee9f5bee8d25fac
size 7559564704

3
gemma-3-12b-it-abliterated-refined-novis.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a3e66933d1c6939607bf29b247197587f54982307131c934b95c8358a1eddc38
size 7300779424

3
gemma-3-12b-it-abliterated-refined-novis.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c542ef34513bf2b02ae87ed07a889be38bdd57150c895742886fcb56e60ccd3c
size 6935334304

3
gemma-3-12b-it-abliterated-refined-novis.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:674dbee4bac19b24d3dc25b2f922efc78750afb917491045061a6dcf22c28822
size 8445037984

3
gemma-3-12b-it-abliterated-refined-novis.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:79fff33a1b221890cc00559c9eb0afe77261388087c20c218409569e0c5a6657
size 8231964064

3
gemma-3-12b-it-abliterated-refined-novis.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aee680ab666715d2aa65abbc40a6ed430d57b1e969e359331ca02aa44fe4afd2
size 9660812704

3
gemma-3-12b-it-abliterated-refined-novis.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dfd89e855b5c2056ec60deba134270d7204c7ebf6ff3372d29e00beecb754819
size 7473632