mradermacher/shieldgemma-9b-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/shieldgemma-9b-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-10 19:01:59 +08:00
commit e1a452fbaf
17 changed files with 167 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

50
.gitattributes vendored Normal file
View File

@@ -0,0 +1,50 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
shieldgemma-9b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
shieldgemma-9b.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
shieldgemma-9b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
shieldgemma-9b.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
shieldgemma-9b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
shieldgemma-9b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
shieldgemma-9b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
shieldgemma-9b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
shieldgemma-9b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
shieldgemma-9b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
shieldgemma-9b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
shieldgemma-9b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
shieldgemma-9b.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
shieldgemma-9b.f16.gguf filter=lfs diff=lfs merge=lfs -text
shieldgemma-9b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text

72
README.md Normal file
View File

@@ -0,0 +1,72 @@
---
base_model: google/shieldgemma-9b
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- en
library_name: transformers
license: gemma
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: -->
static quants of https://huggingface.co/google/shieldgemma-9b
<!-- provided-files -->
weighted/imatrix quants are available at https://huggingface.co/mradermacher/shieldgemma-9b-i1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/shieldgemma-9b-GGUF/resolve/main/shieldgemma-9b.Q2_K.gguf) | Q2_K | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/shieldgemma-9b-GGUF/resolve/main/shieldgemma-9b.IQ3_XS.gguf) | IQ3_XS | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/shieldgemma-9b-GGUF/resolve/main/shieldgemma-9b.IQ3_S.gguf) | IQ3_S | 4.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/shieldgemma-9b-GGUF/resolve/main/shieldgemma-9b.Q3_K_S.gguf) | Q3_K_S | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/shieldgemma-9b-GGUF/resolve/main/shieldgemma-9b.IQ3_M.gguf) | IQ3_M | 4.6 | |
| [GGUF](https://huggingface.co/mradermacher/shieldgemma-9b-GGUF/resolve/main/shieldgemma-9b.Q3_K_M.gguf) | Q3_K_M | 4.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/shieldgemma-9b-GGUF/resolve/main/shieldgemma-9b.Q3_K_L.gguf) | Q3_K_L | 5.2 | |
| [GGUF](https://huggingface.co/mradermacher/shieldgemma-9b-GGUF/resolve/main/shieldgemma-9b.IQ4_XS.gguf) | IQ4_XS | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/shieldgemma-9b-GGUF/resolve/main/shieldgemma-9b.Q4_K_S.gguf) | Q4_K_S | 5.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/shieldgemma-9b-GGUF/resolve/main/shieldgemma-9b.Q4_K_M.gguf) | Q4_K_M | 5.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/shieldgemma-9b-GGUF/resolve/main/shieldgemma-9b.Q5_K_S.gguf) | Q5_K_S | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/shieldgemma-9b-GGUF/resolve/main/shieldgemma-9b.Q5_K_M.gguf) | Q5_K_M | 6.7 | |
| [GGUF](https://huggingface.co/mradermacher/shieldgemma-9b-GGUF/resolve/main/shieldgemma-9b.Q6_K.gguf) | Q6_K | 7.7 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/shieldgemma-9b-GGUF/resolve/main/shieldgemma-9b.Q8_0.gguf) | Q8_0 | 9.9 | fast, best quality |
| [GGUF](https://huggingface.co/mradermacher/shieldgemma-9b-GGUF/resolve/main/shieldgemma-9b.f16.gguf) | f16 | 18.6 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->

3
shieldgemma-9b.IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2d933f2c833e83f5220d774bb465c7a8ded9a63066baa153f7199d70fd51235f
size 4494616608

3
shieldgemma-9b.IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ec1ac3498c97375ed0ee34054ac382e2015199f5b5a2d95a4caa1926e934390d
size 4337666080

3
shieldgemma-9b.IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3f356377d83a5cd57921ed7483c16290cd43081a8824f35a5f16eddfea03fee1
size 4144990240

3
shieldgemma-9b.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:882d38325bbfe26c53629b9412dcc8a4f245d4790b34ec31d2eed1bafc0a1619
size 5223172128

3
shieldgemma-9b.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b17eaaf6f3895ddef1c8f2d7ecb26e500c1e70d17bbdc39a5d2436066a16ce63
size 3805399072

3
shieldgemma-9b.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:35e94b97a6d9cfc8d0f9b57cfbdef4633b8430d6db811b0456bef83385734503
size 5132453920

3
shieldgemma-9b.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9c13153b05b48d063beb994e2b7022de322d5a1839673d9b5a5c099388e4f398
size 4761782304

3
shieldgemma-9b.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c8f9f710a8288618c185e84c2b173ef811f95fa5232fcb8887dcd80981f3ff38
size 4337666080

3
shieldgemma-9b.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2f622d7f1fd673dc708246456709a2136284966fd77330c8547d619ad09e2b2e
size 5761058848

3
shieldgemma-9b.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7498dde7a597fad6509921e44ea63742134f606b71ed23ca5cf4a252199f1e9f
size 5478926368

3
shieldgemma-9b.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5f18711978337b3daf40bc88a336a525c27655258e2fb753735eb2a384d31cbe
size 6647367712

3
shieldgemma-9b.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c81bb990f3d4995d1bc51de0bcff56d0e37d251629fd26d1fed6c2c0fcaa8ad4
size 6483593248

3
shieldgemma-9b.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f98fc7a68576db9d59660e7be35a550e959cda8516c91a29a89af73f4f30e4d9
size 7589070880

3
shieldgemma-9b.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b6f0fa886c6a79a5440eb572f371971862ce513f1070323f276e0b7c436f4243
size 9827149856

3
shieldgemma-9b.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0e88d9bd30cdf233656d04e4fc0106e3d0b84f46fc2dee7b334f6af41d584614
size 18490681376