commit 976938a728338be28664b02ee782a54dc692e3a6 Author: ModelHub XC Date: Sun Jun 14 12:16:18 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/gama-12b-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..cf7d0a2 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +imatrix.dat filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +gama-12b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..c6cf6e9 --- /dev/null +++ b/README.md @@ -0,0 +1,92 @@ +--- +base_model: rodrigomt/gama-12b +language: +- en +- pt +library_name: transformers +license: gemma +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- merge +- gemma +- text-generation +- conversational +- allura-org/Gemma-3-Glitter-12B +- soob3123/amoral-gemma3-12B-v2-qat +- soob3123/Veiled-Calla-12B +--- +## About + + + + + + +weighted/imatrix quants of https://huggingface.co/rodrigomt/gama-12b + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#gama-12b-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/gama-12b-GGUF + +**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/gama-12b-GGUF).** +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ1_S.gguf) | i1-IQ1_S | 3.0 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.6 | | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.9 | | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ2_S.gguf) | i1-IQ2_S | 4.1 | | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ2_M.gguf) | i1-IQ2_M | 4.4 | | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.5 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 4.9 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.3 | | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ3_S.gguf) | i1-IQ3_S | 5.6 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.1 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.6 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.7 | | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.0 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q4_0.gguf) | i1-Q4_0 | 7.0 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.0 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.4 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q4_1.gguf) | i1-Q4_1 | 7.7 | | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.3 | | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.5 | | +| [GGUF](https://huggingface.co/mradermacher/gama-12b-i1-GGUF/resolve/main/gama-12b.i1-Q6_K.gguf) | i1-Q6_K | 9.8 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/gama-12b.i1-IQ1_M.gguf b/gama-12b.i1-IQ1_M.gguf new file mode 100644 index 0000000..0797f90 --- /dev/null +++ b/gama-12b.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:446a64a30c30169a579c945cd58c45ac31ba896194cb693d2c9a18f645617c91 +size 3164729184 diff --git a/gama-12b.i1-IQ1_S.gguf b/gama-12b.i1-IQ1_S.gguf new file mode 100644 index 0000000..8c03e1d --- /dev/null +++ b/gama-12b.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8a1138e11392fad08b3ec3ab7548b770bcae656bbdf9072bc820a91187ed83e1 +size 2947415904 diff --git a/gama-12b.i1-IQ2_M.gguf b/gama-12b.i1-IQ2_M.gguf new file mode 100644 index 0000000..165b0c1 --- /dev/null +++ b/gama-12b.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:23efc4496d9826558e3a351633b762c44f71e7b26da0fb61a8b2caa1839e9061 +size 4310462304 diff --git a/gama-12b.i1-IQ2_S.gguf b/gama-12b.i1-IQ2_S.gguf new file mode 100644 index 0000000..177fd38 --- /dev/null +++ b/gama-12b.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:35c3a339526242fdafcd3181efb712e2fd6939042f556facd923bfa751185970 +size 4020711264 diff --git a/gama-12b.i1-IQ2_XS.gguf b/gama-12b.i1-IQ2_XS.gguf new file mode 100644 index 0000000..f155cfe --- /dev/null +++ b/gama-12b.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c83f463cbae0f0d0bbb68e239f6516313d62f7d4c1b2cd3990008c1ee9edea57 +size 3840261984 diff --git a/gama-12b.i1-IQ2_XXS.gguf b/gama-12b.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..0056d2a --- /dev/null +++ b/gama-12b.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f41e62edb3266a0406049703696f374973b2fcb6b9a8811cda4741ddce8523e9 +size 3526917984 diff --git a/gama-12b.i1-IQ3_M.gguf b/gama-12b.i1-IQ3_M.gguf new file mode 100644 index 0000000..c6de917 --- /dev/null +++ b/gama-12b.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6b5c2ede1da9908dcda25ebf67a741a1523449c7041d4a1fc8fa95a2d3657fa4 +size 5655723744 diff --git a/gama-12b.i1-IQ3_S.gguf b/gama-12b.i1-IQ3_S.gguf new file mode 100644 index 0000000..3bb2fae --- /dev/null +++ b/gama-12b.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1db3203c8b724d80d1003c689432207f8cce45f7ca174d6eaac5331df4439d3a +size 5458317024 diff --git a/gama-12b.i1-IQ3_XS.gguf b/gama-12b.i1-IQ3_XS.gguf new file mode 100644 index 0000000..75e54e6 --- /dev/null +++ b/gama-12b.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:694350f73397a664713bfb3ecbfa6d42bd4a3f15e6f2dfd859d08dcd36e10904 +size 5206167264 diff --git a/gama-12b.i1-IQ3_XXS.gguf b/gama-12b.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..7004617 --- /dev/null +++ b/gama-12b.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:24b913ba0b33339a338316b8e955be5686de643b3743bb42a5d77fc75c31677d +size 4784901984 diff --git a/gama-12b.i1-IQ4_NL.gguf b/gama-12b.i1-IQ4_NL.gguf new file mode 100644 index 0000000..35eaa18 --- /dev/null +++ b/gama-12b.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:822ee15e3202d684e98d9d5e57746c617aee2a0c591950e30b87877c7eaba571 +size 6887165664 diff --git a/gama-12b.i1-IQ4_XS.gguf b/gama-12b.i1-IQ4_XS.gguf new file mode 100644 index 0000000..ca4ce00 --- /dev/null +++ b/gama-12b.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3e9e6fc55807891f394ec7099a90deed0f30a8dca5443352f9557e6f317ca5f5 +size 6550965984 diff --git a/gama-12b.i1-Q2_K.gguf b/gama-12b.i1-Q2_K.gguf new file mode 100644 index 0000000..ee94898 --- /dev/null +++ b/gama-12b.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5e06582a5277c153356ffb9ed04d844bc5506080e66b0c8dfc5aa9fd0071f3b8 +size 4768222944 diff --git a/gama-12b.i1-Q2_K_S.gguf b/gama-12b.i1-Q2_K_S.gguf new file mode 100644 index 0000000..e263d47 --- /dev/null +++ b/gama-12b.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6c579cb67bc78b066c22792446bdfe7dce110e6677142e4a29c71309a1097255 +size 4448612064 diff --git a/gama-12b.i1-Q3_K_L.gguf b/gama-12b.i1-Q3_K_L.gguf new file mode 100644 index 0000000..b7f7f6f --- /dev/null +++ b/gama-12b.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9aa538e6fed1d3eee38d920f4c07d9d6819aa571e11c172c8f86ab66bcc1ff01 +size 6480187104 diff --git a/gama-12b.i1-Q3_K_M.gguf b/gama-12b.i1-Q3_K_M.gguf new file mode 100644 index 0000000..fb22ead --- /dev/null +++ b/gama-12b.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c56f433640f8eb0a80b33b73389b8212c831ee2f1ec8f0532d78b435ba67be81 +size 6008819424 diff --git a/gama-12b.i1-Q3_K_S.gguf b/gama-12b.i1-Q3_K_S.gguf new file mode 100644 index 0000000..f314e6c --- /dev/null +++ b/gama-12b.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aa7a0a779db2169a677481cbcfdd6653ed109f117c50006442dec6ade0a0ef36 +size 5458317024 diff --git a/gama-12b.i1-Q4_0.gguf b/gama-12b.i1-Q4_0.gguf new file mode 100644 index 0000000..994757a --- /dev/null +++ b/gama-12b.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1ef4f66386410aca4fd65e6490c8d381039807b71e3d9eee3d96c3123ec1788d +size 6909284064 diff --git a/gama-12b.i1-Q4_1.gguf b/gama-12b.i1-Q4_1.gguf new file mode 100644 index 0000000..bef0894 --- /dev/null +++ b/gama-12b.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b1139b5bbf083e266a568a1109cb9a03f9ad0316db1011580b3d969f9b9a2386 +size 7559565024 diff --git a/gama-12b.i1-Q4_K_M.gguf b/gama-12b.i1-Q4_K_M.gguf new file mode 100644 index 0000000..e0dda51 --- /dev/null +++ b/gama-12b.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b554a8407c3ec68baf06e2943c453b9783de2e859fb0388c24b2d9dda2ce530b +size 7300779744 diff --git a/gama-12b.i1-Q4_K_S.gguf b/gama-12b.i1-Q4_K_S.gguf new file mode 100644 index 0000000..baa848c --- /dev/null +++ b/gama-12b.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:318aca3627b07c58dfc92537c85944a6a289aff0cb05f5811875e4caae3d744e +size 6935334624 diff --git a/gama-12b.i1-Q5_K_M.gguf b/gama-12b.i1-Q5_K_M.gguf new file mode 100644 index 0000000..bd0506c --- /dev/null +++ b/gama-12b.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8699f3d88e7b0ae6130d29db9d466d759c5af0855a9b9a2f6aed20603de95360 +size 8445038304 diff --git a/gama-12b.i1-Q5_K_S.gguf b/gama-12b.i1-Q5_K_S.gguf new file mode 100644 index 0000000..3e5d88d --- /dev/null +++ b/gama-12b.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:701b07aeab9704a82e5cf214a7789d2ce36d4fe40e5e859f39f275ca8a5cce81 +size 8231964384 diff --git a/gama-12b.i1-Q6_K.gguf b/gama-12b.i1-Q6_K.gguf new file mode 100644 index 0000000..f9ed9bb --- /dev/null +++ b/gama-12b.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c58eea429567b7778b3531765b4079de14d01a13deb126d60d99cd81fb7d5140 +size 9660813024 diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..e34ba40 --- /dev/null +++ b/imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:38bdefae52983c4a85191cb98b8f558b77f062c362a2ac7748d734de9fa924a6 +size 7433101