SanctumAI/gemma-2-2b-it-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: SanctumAI/gemma-2-2b-it-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-11 07:43:15 +08:00
commit dee3d52941
20 changed files with 170 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

52
.gitattributes vendored Normal file
View File

@@ -0,0 +1,52 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.f16.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-it.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

64
README.md Normal file
View File

@@ -0,0 +1,64 @@
---
license: gemma
pipeline_tag: text-generation
tags:
- conversational
---
![image/png](https://cdn-uploads.huggingface.co/production/uploads/64a28db2f1968b7d7f357182/NZMTmZ7lEO6kQhD3sw8yg.png)
*This model was quantized by [SanctumAI](https://sanctum.ai). To leave feedback, join our community in [Discord](https://discord.gg/7ZNE78HJKh).*
# Gemma 2 2B IT GGUF
**Model creator:** [google](https://huggingface.co/google)<br>
**Original model**: [gemma-2-2b-it](https://huggingface.co/google/gemma-2-2b-it)<br>
## Model Summary:
Gemma is a family of lightweight, state-of-the-art open models from Google,
built from the same research and technology used to create the Gemini models.
They are text-to-text, decoder-only large language models, available in English,
with open weights for both pre-trained variants and instruction-tuned variants.
Gemma models are well-suited for a variety of text generation tasks, including
question answering, summarization, and reasoning. Their relatively small size
makes it possible to deploy them in environments with limited resources such as
a laptop, desktop or your own cloud infrastructure, democratizing access to
state of the art AI models and helping foster innovation for everyone.
## Prompt Template:
If you're using Sanctum app, simply use `Gemma` model preset.
Prompt template:
```
<start_of_turn>user
{prompt}<end_of_turn>
<start_of_turn>model
```
## Hardware Requirements Estimate
| Name | Quant method | Size | Memory (RAM, vRAM) required |
| ---- | ---- | ---- | ---- |
| [gemma-2-2b-it.Q2_K.gguf](https://huggingface.co/SanctumAI/gemma-2-2b-it-GGUF/blob/main/gemma-2-2b-it.Q2_K.gguf) | Q2_K | 1.23 GB | 7.88 GB |
| [gemma-2-2b-it.Q3_K_S.gguf](https://huggingface.co/SanctumAI/gemma-2-2b-it-GGUF/blob/main/gemma-2-2b-it.Q3_K_S.gguf) | Q3_K_S | 1.36 GB | 8.00 GB |
| [gemma-2-2b-it.Q3_K_M.gguf](https://huggingface.co/SanctumAI/gemma-2-2b-it-GGUF/blob/main/gemma-2-2b-it.Q3_K_M.gguf) | Q3_K_M | 1.46 GB | 8.10 GB |
| [gemma-2-2b-it.Q3_K_L.gguf](https://huggingface.co/SanctumAI/gemma-2-2b-it-GGUF/blob/main/gemma-2-2b-it.Q3_K_L.gguf) | Q3_K_L | 1.55 GB | 8.18 GB |
| [gemma-2-2b-it.Q4_0.gguf](https://huggingface.co/SanctumAI/gemma-2-2b-it-GGUF/blob/main/gemma-2-2b-it.Q4_0.gguf) | Q4_0 | 1.63 GB | 8.26 GB |
| [gemma-2-2b-it.Q4_K_S.gguf](https://huggingface.co/SanctumAI/gemma-2-2b-it-GGUF/blob/main/gemma-2-2b-it.Q4_K_S.gguf) | Q4_K_S | 1.64 GB | 8.26 GB |
| [gemma-2-2b-it.Q4_K_M.gguf](https://huggingface.co/SanctumAI/gemma-2-2b-it-GGUF/blob/main/gemma-2-2b-it.Q4_K_M.gguf) | Q4_K_M | 1.71 GB | 8.33 GB |
| [gemma-2-2b-it.Q4_K.gguf](https://huggingface.co/SanctumAI/gemma-2-2b-it-GGUF/blob/main/gemma-2-2b-it.Q4_K.gguf) | Q4_K | 1.71 GB | 8.33 GB |
| [gemma-2-2b-it.Q4_1.gguf](https://huggingface.co/SanctumAI/gemma-2-2b-it-GGUF/blob/main/gemma-2-2b-it.Q4_1.gguf) | Q4_1 | 1.76 GB | 8.37 GB |
| [gemma-2-2b-it.Q5_0.gguf](https://huggingface.co/SanctumAI/gemma-2-2b-it-GGUF/blob/main/gemma-2-2b-it.Q5_0.gguf) | Q5_0 | 1.88 GB | 8.49 GB |
| [gemma-2-2b-it.Q5_K_S.gguf](https://huggingface.co/SanctumAI/gemma-2-2b-it-GGUF/blob/main/gemma-2-2b-it.Q5_K_S.gguf) | Q5_K_S | 1.88 GB | 8.49 GB |
| [gemma-2-2b-it.Q5_K_M.gguf](https://huggingface.co/SanctumAI/gemma-2-2b-it-GGUF/blob/main/gemma-2-2b-it.Q5_K_M.gguf) | Q5_K_M | 1.92 GB | 8.53 GB |
| [gemma-2-2b-it.Q5_K.gguf](https://huggingface.co/SanctumAI/gemma-2-2b-it-GGUF/blob/main/gemma-2-2b-it.Q5_K.gguf) | Q5_K | 1.92 GB | 8.53 GB |
| [gemma-2-2b-it.Q5_1.gguf](https://huggingface.co/SanctumAI/gemma-2-2b-it-GGUF/blob/main/gemma-2-2b-it.Q5_1.gguf) | Q5_1 | 2.01 GB | 8.61 GB |
| [gemma-2-2b-it.Q6_K.gguf](https://huggingface.co/SanctumAI/gemma-2-2b-it-GGUF/blob/main/gemma-2-2b-it.Q6_K.gguf) | Q6_K | 2.15 GB | 8.74 GB |
| [gemma-2-2b-it.Q8_0.gguf](https://huggingface.co/SanctumAI/gemma-2-2b-it-GGUF/blob/main/gemma-2-2b-it.Q8_0.gguf) | Q8_0 | 2.78 GB | 9.33 GB |
| [gemma-2-2b-it.f16.gguf](https://huggingface.co/SanctumAI/gemma-2-2b-it-GGUF/blob/main/gemma-2-2b-it.f16.gguf) | f16 | 5.24 GB | 11.61 GB |
## Disclaimer
Sanctum is not the creator, originator, or owner of any Model featured in the Models section of the Sanctum application. Each Model is created and provided by third parties. Sanctum does not endorse, support, represent or guarantee the completeness, truthfulness, accuracy, or reliability of any Model listed there. You understand that supported Models can produce content that might be offensive, harmful, inaccurate or otherwise inappropriate, or deceptive. Each Model is the sole responsibility of the person or entity who originated such Model. Sanctum may not monitor or control the Models supported and cannot, and does not, take responsibility for any such Model. Sanctum disclaims all warranties or guarantees about the accuracy, reliability or benefits of the Models. Sanctum further disclaims any warranty that the Model will meet your requirements, be secure, uninterrupted or available at any time or location, or error-free, viruses-free, or that any errors will be corrected, or otherwise. You will be solely responsible for any damage resulting from your use of or access to the Models, your downloading of any Model, or use of any other Model provided by or through Sanctum.

3
config.json Normal file
View File

@@ -0,0 +1,3 @@
{
"model_type": "gemma2"
}

3
gemma-2-2b-it.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cb02d72e99b7090bb671e12207ee2157cccb73493052d768e4007f4ed503ae6d
size 1229829728

3
gemma-2-2b-it.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:58540ef781c1afe6e30db299f2c11bf523a554674857350555c1cc7ee40ef075
size 1550435936

3
gemma-2-2b-it.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0603d9d1416c648aa1eda7fabe61f74c9dd4f501d6deae4b0c3d9f6cc1650d12
size 1461667424

3
gemma-2-2b-it.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b5608c3236c653b75b24ed153d8b1dddd0cc13eddc9f8910c3f99a8f4b98886c
size 1360660064

3
gemma-2-2b-it.Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8301048850599715f545d32f78ebd532962b42607b71cd38e4b9ddaf5fbb7a16
size 1629509216

3
gemma-2-2b-it.Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4bcae0ab12e71d372b4f13650a46fab1701aa6e976b1edd736c62babf57d49ad
size 1756026464

3
gemma-2-2b-it.Q4_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:07983c59b70f3247a427b807d301ab1f0761bb81640b6448c539f0a96dda55c8
size 1708582496

3
gemma-2-2b-it.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:07983c59b70f3247a427b807d301ab1f0761bb81640b6448c539f0a96dda55c8
size 1708582496

3
gemma-2-2b-it.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d7c02f020cc74151c1031cc609b0e06ed63d35f504a94b8e331e90f141d4c7fc
size 1638651488

3
gemma-2-2b-it.Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ad382772816578372cc51c8d2a7baabeb9822e44f1c08b6172d5282cee0976d6
size 1882543712

3
gemma-2-2b-it.Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:76e4989938bb22c45fd7b8aa68560912cbb1509a9e41ab46663513029d503aeb
size 2009060960

3
gemma-2-2b-it.Q5_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:545e8ebb4817180b65c9ac6b75ca8fa37dff2336dc3c3ac66b92c89551bfac13
size 1923278432

3
gemma-2-2b-it.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:545e8ebb4817180b65c9ac6b75ca8fa37dff2336dc3c3ac66b92c89551bfac13
size 1923278432

3
gemma-2-2b-it.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d9ecf2815b8525330ce2b302ba30b2afc93cc997d619ab823234c340a2729bbf
size 1882543712

3
gemma-2-2b-it.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a96086d8ba483046f3d274de1ff2b5612473df21cc5241c92c3a5f83c523d4df
size 2151392864

3
gemma-2-2b-it.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e943e00b329d9d23133850e45d8fea9d8bb36c28754c61dbbb288f51e86efe78
size 2784495200

3
gemma-2-2b-it.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7edd84a0e2c29598c2baa87b3bd9a8687463498a9f31696484beefad03208e57
size 5235213920