mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Compare commits

base: mradermacher:83ab313c824e3e65ea68ecee7380bb264ea6c0cc
Branches Tags
mradermacher:main
..
compare: mradermacher:83c5502ebe1f7b87f5f0f41f52fa2ee4c67498c3
Branches Tags
mradermacher:main

10 Commits
83ab313c82 ... 83c5502ebe

Author SHA1 Message Date
team mradermacher
83c5502ebe auto-patch README.md 2025-07-10 03:10:31 +00:00
team mradermacher
3d60fafa41 auto-patch README.md 2025-06-04 01:38:09 +00:00
team mradermacher
02356cec56 uploaded from nico1 2025-06-04 01:35:17 +00:00
team mradermacher
e49fe7f599 uploaded from nico1 2025-06-04 01:31:25 +00:00
team mradermacher
02d83134c5 uploaded from nico1 2025-06-04 01:23:04 +00:00
team mradermacher
142b5f2c55 uploaded from nico1 2025-06-04 01:16:54 +00:00
team mradermacher
c00df6db86 uploaded from nico1 2025-06-04 01:15:10 +00:00
team mradermacher
fd72ae716f uploaded from nico1 2025-06-04 01:06:24 +00:00
team mradermacher
a267b5fb0c uploaded from nico1 2025-06-04 01:03:25 +00:00
team mradermacher
b69783c70b uploaded from nico1 2025-06-04 00:55:52 +00:00
10 changed files with 51 additions and 0 deletions
Expand all files Collapse all files

8
.gitattributes vendored
View File

@@ -49,3 +49,11 @@ gemma3-27b-v2-glitterlike.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma3-27b-v2-glitterlike.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma3-27b-v2-glitterlike.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma3-27b-v2-glitterlike.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma3-27b-v2-glitterlike.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma3-27b-v2-glitterlike.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma3-27b-v2-glitterlike.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma3-27b-v2-glitterlike.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma3-27b-v2-glitterlike.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma3-27b-v2-glitterlike.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma3-27b-v2-glitterlike.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
gemma3-27b-v2-glitterlike.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

19
README.md
View File

@@ -3,6 +3,8 @@ base_model: ToastyPigeon/gemma3-27b-v2-glitterlike
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
@@ -15,7 +17,12 @@ quantized_by: mradermacher
weighted/imatrix quants of https://huggingface.co/ToastyPigeon/gemma3-27b-v2-glitterlike
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#gemma3-27b-v2-glitterlike-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
@@ -28,16 +35,28 @@ more details, including on how to concatenate multi-part files.
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-IQ1_S.gguf) | i1-IQ1_S | 6.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-IQ1_M.gguf) | i1-IQ1_M | 6.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 7.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-IQ2_XS.gguf) | i1-IQ2_XS | 8.5 | |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-IQ2_S.gguf) | i1-IQ2_S | 8.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-IQ2_M.gguf) | i1-IQ2_M | 9.6 | |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-Q2_K_S.gguf) | i1-Q2_K_S | 9.9 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-Q2_K.gguf) | i1-Q2_K | 10.6 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 10.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-IQ3_XS.gguf) | i1-IQ3_XS | 11.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-IQ3_S.gguf) | i1-IQ3_S | 12.3 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-Q3_K_S.gguf) | i1-Q3_K_S | 12.3 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-IQ3_M.gguf) | i1-IQ3_M | 12.6 | |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-Q3_K_M.gguf) | i1-Q3_K_M | 13.5 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-Q3_K_L.gguf) | i1-Q3_K_L | 14.6 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-IQ4_XS.gguf) | i1-IQ4_XS | 14.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-Q4_0.gguf) | i1-Q4_0 | 15.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-Q4_K_S.gguf) | i1-Q4_K_S | 15.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-Q4_K_M.gguf) | i1-Q4_K_M | 16.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-Q4_1.gguf) | i1-Q4_1 | 17.3 | |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-Q5_K_S.gguf) | i1-Q5_K_S | 18.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-Q5_K_M.gguf) | i1-Q5_K_M | 19.4 | |
| [GGUF](https://huggingface.co/mradermacher/gemma3-27b-v2-glitterlike-i1-GGUF/resolve/main/gemma3-27b-v2-glitterlike.i1-Q6_K.gguf) | i1-Q6_K | 22.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant

3
gemma3-27b-v2-glitterlike.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e478d7df67aa2ca6ffcc335528a432349f3e0b3d07d64b8b05e995f4b7fe2f3c
size 6264247776

3
gemma3-27b-v2-glitterlike.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c41342f9c73a10186ad8f5aab9132ec5c24debac312959c7cd982d063897b988
size 8782409184

3
gemma3-27b-v2-glitterlike.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c4b3ddc48e021e2082d25c46e030ea52dc01e3649eae3a0a4463b64019b06a33
size 12167614560

3
gemma3-27b-v2-glitterlike.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:143cb08f41d4c483b42ab7613a4cb035e72669ff6b95ded96bcebdaa1a1e9122
size 11562233952

3
gemma3-27b-v2-glitterlike.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e9a9edca6da29d16c1681c282feaabb99c6a531568a83bda4f6660c8338fbec
size 15617974368

3
gemma3-27b-v2-glitterlike.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d717dae4b4c4a7e0490888f9722c6952557a8fe06592886683e5595a608a65c4
size 17167294560

3
gemma3-27b-v2-glitterlike.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c08c33be7abeec3d39887bebdd4d036428e1ae0ee6c6f615ab90217d4cf75ce2
size 19271676000

3
gemma3-27b-v2-glitterlike.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:946f923e4d74c1600567059ffac1dc9991788a07b27fa52babbc4d0e22c7f616
size 18767192160