mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-10 08:54:18 +08:00
commit 190ed62a3e
27 changed files with 220 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GemmaX2-28-2B-v0.2.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
GemmaX2-28-2B-v0.2.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cf4c19157a60342b33846a8a95978ec3b2dbfd0a7fed9992bbd99e308cd0b759
size 873797600

3
GemmaX2-28-2B-v0.2.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0cc9b9c7fc7472880e04c65348c981d75f37a3828a484b18d564ad3497950b9a
size 832159712

3
GemmaX2-28-2B-v0.2.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0d1d4a7f46f8ea6cd1deeabbaedc047599da50e849b279efb2f8de28a410d4fd
size 1088014304

3
GemmaX2-28-2B-v0.2.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:09b5fbbdc86b0c1af6420278bb5bebcc3cfac1564e199eb596979404b6c1642f
size 1032497120

3
GemmaX2-28-2B-v0.2.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dcd3ffceb1d70cadfe2e3ee75186828263d483dfa98fe1bcb707d33b7ed18d06
size 1002545120

3
GemmaX2-28-2B-v0.2.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0a77721527186d5a7db4015a34e6d710b35a7160e48125c83cd755e9c7504711
size 943194080

3
GemmaX2-28-2B-v0.2.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:31f4fafc9f484861f226d8d701b8f00ad458129cb9d72e48afaea4d286cdd7bf
size 1393561568

3
GemmaX2-28-2B-v0.2.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5f2b984bbb0e6293c0936d0c93d4b5a1dfb295491d553f02739db9c19cbdd267
size 1360660448

3
GemmaX2-28-2B-v0.2.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eea07e50f7a30c24793df6b83e7c6c5a5b475fd9b2499771eb5024a5d55d3e50
size 1314211808

3
GemmaX2-28-2B-v0.2.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5cf048520acbea58719d33306548d19fb22fe5c64dfcd0d830629ddcd62b1c4a
size 1181685728

3
GemmaX2-28-2B-v0.2.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:64c94d6b1ae1e8d3598b521f1662c5693ef9612c61efe1cfe85ee436d8e2d2e6
size 1629509600

3
GemmaX2-28-2B-v0.2.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17ab4ac727ea95347b17d37dac1f06b38c1f585e752885bc7b55b800ceb009db
size 1566250976

3
GemmaX2-28-2B-v0.2.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d441e32d734311506107ff6f1a84b5c32845e4c0e06a5cc4a54019935496a7f8
size 1229830112

3
GemmaX2-28-2B-v0.2.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:569b9b69d6875db96cb23cc45ceb935dfd8cfdfe51ec6f20166073b3616ef37b
size 1169999840

3
GemmaX2-28-2B-v0.2.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:57128f873c268ad7f2c223b0e663555517bca465fb13148949a2cf47573e3501
size 1550436320

3
GemmaX2-28-2B-v0.2.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:acd458ed2074ab247091ab1b9d88c0dc063b12883b5330f65f0f87ad506d7f33
size 1461667808

3
GemmaX2-28-2B-v0.2.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8930f2b0e65da9b625bdfd59a3c9ec4137e2a3424903f50e7beea79837c40cf6
size 1360660448

3
GemmaX2-28-2B-v0.2.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:01b2fdd8c5191e2fc903f0654d21eace85a258ce336e108ba7fd13056c9ce133
size 1633490912

3
GemmaX2-28-2B-v0.2.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:707749848b82bce9413e1609072b391b8bbb3b124fa3e041f73c0e950dbd3a0a
size 1756026848

3
GemmaX2-28-2B-v0.2.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b2673cc867c86e9325f44a558a1436ae0c51419cf860859fa4ed1d664d3c0c89
size 1708582880

3
GemmaX2-28-2B-v0.2.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ac5e739309e686965d5d2cc05ae01de95f5f3d2b71c419aa1bf24087df91377b
size 1638651872

3
GemmaX2-28-2B-v0.2.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:59df80b249c62f2da7005882d85d7b78b3d5bfc2edc81443bd8659163410414a
size 1923278816

3
GemmaX2-28-2B-v0.2.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4cb45edcb964a4638463c36deffb3fbff6ce1f9ad253cf618798496a6a8567c3
size 1882544096

3
GemmaX2-28-2B-v0.2.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:64fdf5d00e293e6cc95f7c4c2551e4d87a61bd3245be0b36c89a500ba4c47271
size 2151393248

3
GemmaX2-28-2B-v0.2.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b7a05f8db4bcd6b1a78f5819637000b55d7146731d80ee71fbb5fc86ffcb4873
size 2397568

85
README.md Normal file
View File

@@ -0,0 +1,85 @@
---
base_model: xiaomi-research/GemmaX2-28-2B-v0.2
language:
- en
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/xiaomi-research/GemmaX2-28-2B-v0.2
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#GemmaX2-28-2B-v0.2-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-IQ2_S.gguf) | i1-IQ2_S | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-IQ2_M.gguf) | i1-IQ2_M | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.3 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.3 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-Q2_K.gguf) | i1-Q2_K | 1.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-IQ3_S.gguf) | i1-IQ3_S | 1.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-IQ3_M.gguf) | i1-IQ3_M | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.7 | |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.7 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-Q4_0.gguf) | i1-Q4_0 | 1.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-Q4_1.gguf) | i1-Q4_1 | 1.9 | |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/GemmaX2-28-2B-v0.2-i1-GGUF/resolve/main/GemmaX2-28-2B-v0.2.i1-Q6_K.gguf) | i1-Q6_K | 2.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->