mradermacher/gama-12b-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gama-12b-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-14 12:16:18 +08:00
commit 976938a728
27 changed files with 227 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
gama-12b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

92
README.md Normal file
View File

@@ -0,0 +1,92 @@
---
base_model: rodrigomt/gama-12b
language:
- en
- pt
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- merge
- gemma
- text-generation
- conversational
- allura-org/Gemma-3-Glitter-12B
- soob3123/amoral-gemma3-12B-v2-qat
- soob3123/Veiled-Calla-12B
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/rodrigomt/gama-12b
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#gama-12b-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/gama-12b-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/gama-12b-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ1_S.gguf) | i1-IQ1_S | 3.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ2_S.gguf) | i1-IQ2_S | 4.1 | |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ2_M.gguf) | i1-IQ2_M | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 4.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ3_S.gguf) | i1-IQ3_S | 5.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.6 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.7 | |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.0 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q4_0.gguf) | i1-Q4_0 | 7.0 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q4_1.gguf) | i1-Q4_1 | 7.7 | |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.3 | |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.5 | |
| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q6_K.gguf) | i1-Q6_K | 9.8 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
gama-12b.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:446a64a30c30169a579c945cd58c45ac31ba896194cb693d2c9a18f645617c91
size 3164729184

3
gama-12b.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8a1138e11392fad08b3ec3ab7548b770bcae656bbdf9072bc820a91187ed83e1
size 2947415904

3
gama-12b.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:23efc4496d9826558e3a351633b762c44f71e7b26da0fb61a8b2caa1839e9061
size 4310462304

3
gama-12b.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:35c3a339526242fdafcd3181efb712e2fd6939042f556facd923bfa751185970
size 4020711264

3
gama-12b.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c83f463cbae0f0d0bbb68e239f6516313d62f7d4c1b2cd3990008c1ee9edea57
size 3840261984

3
gama-12b.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f41e62edb3266a0406049703696f374973b2fcb6b9a8811cda4741ddce8523e9
size 3526917984

3
gama-12b.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6b5c2ede1da9908dcda25ebf67a741a1523449c7041d4a1fc8fa95a2d3657fa4
size 5655723744

3
gama-12b.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1db3203c8b724d80d1003c689432207f8cce45f7ca174d6eaac5331df4439d3a
size 5458317024

3
gama-12b.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:694350f73397a664713bfb3ecbfa6d42bd4a3f15e6f2dfd859d08dcd36e10904
size 5206167264

3
gama-12b.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:24b913ba0b33339a338316b8e955be5686de643b3743bb42a5d77fc75c31677d
size 4784901984

3
gama-12b.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:822ee15e3202d684e98d9d5e57746c617aee2a0c591950e30b87877c7eaba571
size 6887165664

3
gama-12b.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3e9e6fc55807891f394ec7099a90deed0f30a8dca5443352f9557e6f317ca5f5
size 6550965984

3
gama-12b.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5e06582a5277c153356ffb9ed04d844bc5506080e66b0c8dfc5aa9fd0071f3b8
size 4768222944

3
gama-12b.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6c579cb67bc78b066c22792446bdfe7dce110e6677142e4a29c71309a1097255
size 4448612064

3
gama-12b.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9aa538e6fed1d3eee38d920f4c07d9d6819aa571e11c172c8f86ab66bcc1ff01
size 6480187104

3
gama-12b.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c56f433640f8eb0a80b33b73389b8212c831ee2f1ec8f0532d78b435ba67be81
size 6008819424

3
gama-12b.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa7a0a779db2169a677481cbcfdd6653ed109f117c50006442dec6ade0a0ef36
size 5458317024

3
gama-12b.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1ef4f66386410aca4fd65e6490c8d381039807b71e3d9eee3d96c3123ec1788d
size 6909284064

3
gama-12b.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b1139b5bbf083e266a568a1109cb9a03f9ad0316db1011580b3d969f9b9a2386
size 7559565024

3
gama-12b.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b554a8407c3ec68baf06e2943c453b9783de2e859fb0388c24b2d9dda2ce530b
size 7300779744

3
gama-12b.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:318aca3627b07c58dfc92537c85944a6a289aff0cb05f5811875e4caae3d744e
size 6935334624

3
gama-12b.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8699f3d88e7b0ae6130d29db9d466d759c5af0855a9b9a2f6aed20603de95360
size 8445038304

3
gama-12b.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:701b07aeab9704a82e5cf214a7789d2ce36d4fe40e5e859f39f275ca8a5cce81
size 8231964384

3
gama-12b.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c58eea429567b7778b3531765b4079de14d01a13deb126d60d99cd81fb7d5140
size 9660813024

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:38bdefae52983c4a85191cb98b8f558b77f062c362a2ac7748d734de9fa924a6
size 7433101