mradermacher/gemma-2-2b-it-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gemma-2-2b-it-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-14 14:48:17 +08:00
commit d9a03dbfc1
15 changed files with 159 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

48
.gitattributes vendored Normal file
View File

@@ -0,0 +1,48 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.f16.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text

72
README.md Normal file
View File

@@ -0,0 +1,72 @@
---
base_model: google/gemma-2-2b-it
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- en
library_name: transformers
license: gemma
quantized_by: mradermacher
tags:
- conversational
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: -->
static quants of https://huggingface.co/google/gemma-2-2b-it
<!-- provided-files -->
weighted/imatrix quants are available at https://huggingface.co/mradermacher/gemma-2-2b-it-i1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-GGUF/resolve/main/gemma-2-2b-it.Q2_K.gguf) | Q2_K | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-GGUF/resolve/main/gemma-2-2b-it.Q3_K_S.gguf) | Q3_K_S | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-GGUF/resolve/main/gemma-2-2b-it.Q3_K_M.gguf) | Q3_K_M | 1.6 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-GGUF/resolve/main/gemma-2-2b-it.Q3_K_L.gguf) | Q3_K_L | 1.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-GGUF/resolve/main/gemma-2-2b-it.IQ4_XS.gguf) | IQ4_XS | 1.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-GGUF/resolve/main/gemma-2-2b-it.Q4_0_4_4.gguf) | Q4_0_4_4 | 1.7 | fast on arm, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-GGUF/resolve/main/gemma-2-2b-it.Q4_K_S.gguf) | Q4_K_S | 1.7 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-GGUF/resolve/main/gemma-2-2b-it.Q4_K_M.gguf) | Q4_K_M | 1.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-GGUF/resolve/main/gemma-2-2b-it.Q5_K_S.gguf) | Q5_K_S | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-GGUF/resolve/main/gemma-2-2b-it.Q5_K_M.gguf) | Q5_K_M | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-GGUF/resolve/main/gemma-2-2b-it.Q6_K.gguf) | Q6_K | 2.3 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-GGUF/resolve/main/gemma-2-2b-it.Q8_0.gguf) | Q8_0 | 2.9 | fast, best quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-it-GGUF/resolve/main/gemma-2-2b-it.f16.gguf) | f16 | 5.3 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->

3
gemma-2-2b-it.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3c437f53950551877468302fee64eef9a113f3c20d8c3d5cb8108ac39fa1de32
size 1576204544

3
gemma-2-2b-it.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8523b598dacfc95f9474581d5dae6ac54cee3ef6396577d540c256046cbfdb58
size 1229830400

3
gemma-2-2b-it.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d56eb2f916873439d59f8b802944dc3f00e5ae94eecbfc89ad1fc10a30362a7d
size 1550436608

3
gemma-2-2b-it.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a390de530f3dd23898afb9b17374036c72f62e197344ed2af85a69000aa8ec21
size 1461668096

3
gemma-2-2b-it.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cd39a6be061df986b3480f67656f1183d9395e46fb482bae1093463845c489a3
size 1360660736

3
gemma-2-2b-it.Q4_0_4_4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:63e639cd42a45fca14dd38b0337e55870ebcdcf458bb555429033c61c4edcac9
size 1629509888

3
gemma-2-2b-it.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff7c35808d3b2fc5c4f955ca931efdec71c0808b9ec89a9878cb771608787058
size 1708583168

3
gemma-2-2b-it.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b210bff5a6ab2e2d6319e7f96602997dd038b92469ea43f1d78b7988429afd14
size 1638652160

3
gemma-2-2b-it.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b8f0df64c3edbb900334de4e2a4764f033fd4a7920a52fb8bf0c325dfdbed681
size 1923279104

3
gemma-2-2b-it.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:19981e89533170b7f099361200a9f617fcfd6cdb59862b8451884ce5c1d9b69c
size 1882544384

3
gemma-2-2b-it.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2d829a432d9e296dccbd7035148a5f492449a23a812d4431d7d54cd08ca0e909
size 2151393536

3
gemma-2-2b-it.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3ed90effada16373019eea7dbb795a984be941524b6baf8fc4df5a2bc0768477
size 2784495872

3
gemma-2-2b-it.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d1fabb7a1bef0d1244cc656cbe4346afb2e3eb1257066f2b347565259bf3c808
size 5235214592