mradermacher/gemma-2-2b-it-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gemma-2-2b-it-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-28 11:13:17 +08:00
commit f5917f81ac
27 changed files with 218 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-Q4_0_4_8.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-Q4_0_8_8.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

83
README.md Normal file
View File

@@ -0,0 +1,83 @@
---
base_model: google/gemma-2-2b-it
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- en
library_name: transformers
license: gemma
quantized_by: mradermacher
tags:
- conversational
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/google/gemma-2-2b-it
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/gemma-2-2b-it-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-IQ2_S.gguf) | i1-IQ2_S | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-IQ2_M.gguf) | i1-IQ2_M | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.3 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-Q2_K.gguf) | i1-Q2_K | 1.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-IQ3_S.gguf) | i1-IQ3_S | 1.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-IQ3_M.gguf) | i1-IQ3_M | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-Q4_0_4_4.gguf) | i1-Q4_0_4_4 | 1.7 | fast on arm, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-Q4_0_4_8.gguf) | i1-Q4_0_4_8 | 1.7 | fast on arm+i8mm, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-Q4_0_8_8.gguf) | i1-Q4_0_8_8 | 1.7 | fast on arm+sve, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-Q4_0.gguf) | i1-Q4_0 | 1.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF/resolve/main/gemma-2-2b-it.i1-Q6_K.gguf) | i1-Q6_K | 2.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
gemma-2-2b-it.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e33809f227b24eef5edf987f4db39c8605fec7845f57554e8fcbeba9fb5df14b
size 873798144

3
gemma-2-2b-it.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:760e04389367707c9865c1b2612d9e0b5ebba9057369936119ab40f7e8adfdf8
size 832160256

3
gemma-2-2b-it.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c416d5d3f1a700115a21f4e81b6aacf3c24a25bb96b761cb1890ad9f8b04b83b
size 1088014848

3
gemma-2-2b-it.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:97df186c45f8f0dc8a32d640a7ebe46828a6d85aa4e6e5364c9694e531fe91ca
size 1032497664

3
gemma-2-2b-it.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ede9dc8c1a510a9c331715005c10070108960b23e35eee0ee84245b64b27fe2b
size 1002545664

3
gemma-2-2b-it.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a9b12be0a6952c8d937a73dba9d4dde017e5c22f76666ef870818e68618bf622
size 943194624

3
gemma-2-2b-it.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:38217fc9c52a30d28d766983db44f4792b3aea5d12753fccfc7b9c9094cb7da7
size 1393562112

3
gemma-2-2b-it.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:19f8ffdca59ecf4c836bedf009954caac5c777f47922d2bf0b2b7be7d2bd9cae
size 1360660992

3
gemma-2-2b-it.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:821c9edefc64aaa4075c7e04d4b5e816d8aedf0249501d15e3c6d285e5abf5a6
size 1314212352

3
gemma-2-2b-it.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:96375ee00af2db842ac8f87ff136d27402e6ec5a8161acf268e40ecda5222655
size 1181686272

3
gemma-2-2b-it.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:10348474e4c8dbdc7410b96d90f36643a2923302b07a3cd129e878ee9c67a7de
size 1566251520

3
gemma-2-2b-it.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9f1b2dd591e76e0bc85b9de3d8ada5f3f1258c450dcc61cbd7c0a455b4223bf2
size 1229830656

3
gemma-2-2b-it.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7fc00a56ec9ebcbb87748f8bad456304ac55517b593ba8ad72c53699b816bb4c
size 1550436864

3
gemma-2-2b-it.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fe7dff406c25a35d4d2101ebc2e8f8955aeb01bea9085e4589b2d087449f37b3
size 1461668352

3
gemma-2-2b-it.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dd3fa4b709875685e23a38379e7c9040cb1d541094b277f5640d430dab6b262a
size 1360660992

3
gemma-2-2b-it.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a6b4949bc73ed57f9041ee520362b342b99834681ba5f9ee44364ac8a7e4bd61
size 1633491456

3
gemma-2-2b-it.i1-Q4_0_4_4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b8709655bc7f4bf601a1f9daee2298b6b78d015d619009b0cf8fac4fbc272db1
size 1629510144

3
gemma-2-2b-it.i1-Q4_0_4_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1d7a29104562b3d396c24fde46bc1d6bad75ec41dbacf72eed77cd5a5ef07e10
size 1629510144

3
gemma-2-2b-it.i1-Q4_0_8_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:73cf19f29189b6b5f7e95b5f1555b9c911fe699fda3fb6e3a0d4fa98d940fbe9
size 1629510144

3
gemma-2-2b-it.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b94de700a98b168773e3afccfb189a9e7370d9d548221eb566b34e25281dcbb6
size 1708583424

3
gemma-2-2b-it.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ed11024cdd2549fc51e5b8b35f5e88644e26b681b70b5a45c5aa63d6cdde1f7
size 1638652416

3
gemma-2-2b-it.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8e112d48a103aff0530607e38c14c2c1f3de5b2d460fb4e89c9d402e8a49cb91
size 1923279360

3
gemma-2-2b-it.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2c2030dade93963060662e85d489a03504b8bae82c611be50de22fbb7cd982d7
size 1882544640

3
gemma-2-2b-it.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5fc4308334ac06c4cd7100c31c14bdadb72ba9be95f1e9b6ed4d79b0cd29c7d5
size 2151393792

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:759943a9082c0745b99dac5b0028f7fa642e8944675cb50b1158a310ad4d4604
size 2375559