mradermacher/gemma-3-4b-pt-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gemma-3-4b-pt-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-15 04:04:16 +08:00
commit a5b19d9c3f
27 changed files with 223 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-4b-pt.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

88
README.md Normal file
View File

@@ -0,0 +1,88 @@
---
base_model: google/gemma-3-4b-pt
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- en
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/google/gemma-3-4b-pt
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#gemma-3-4b-pt-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/gemma-3-4b-pt-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/gemma-3-4b-pt-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-IQ1_S.gguf) | i1-IQ1_S | 1.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-IQ1_M.gguf) | i1-IQ1_M | 1.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-IQ2_S.gguf) | i1-IQ2_S | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-IQ2_M.gguf) | i1-IQ2_M | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-Q2_K.gguf) | i1-Q2_K | 1.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-IQ3_XS.gguf) | i1-IQ3_XS | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-IQ3_S.gguf) | i1-IQ3_S | 2.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-IQ3_M.gguf) | i1-IQ3_M | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.3 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-Q4_0.gguf) | i1-Q4_0 | 2.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-Q4_1.gguf) | i1-Q4_1 | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-4b-pt-i1-GGUF/resolve/main/gemma-3-4b-pt.i1-Q6_K.gguf) | i1-Q6_K | 3.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
gemma-3-4b-pt.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:699d3b8e476873134aaf894375b8628606c75b32def3e55a3fbddcfe047a3adc
size 1199455264

3
gemma-3-4b-pt.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e11a788ed6587e346dc2539a91a13318b95bc2e93500c540f3b87084efde244f
size 1132977184

3
gemma-3-4b-pt.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fa151379c9e102a1815933e016970a02ef682114e7e758ff2b89dd014d1fba5b
size 1537866784

3
gemma-3-4b-pt.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4e509f54b7f07a132fcc28eaea2d4b289ca3ac7c202a8ea731fbea6cbc9b31b8
size 1449229344

3
gemma-3-4b-pt.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:03b14c0da5ea07ce771d6412fc817e3d787de579138ebb76314d96a15f2ec53f
size 1404460064

3
gemma-3-4b-pt.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a15e900f54f178676a5339e20f790372dadb58b38a04725f7e1ca518c5166df9
size 1310252064

3
gemma-3-4b-pt.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:faadd09e9983ca15185ba6456ac2b48d39fcaeababc2b254ea1ad9978b87fcd7
size 1986665504

3
gemma-3-4b-pt.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:11ac74a75c63489c154444fd463db2ec2ec763cddd9b0b537d11aa182c0b8821
size 1937226784

3
gemma-3-4b-pt.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7e35d8c4a32e9552d129cb292f8d2b67ea0cc4f487820470203356f7b5d3264f
size 1863253024

3
gemma-3-4b-pt.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dca1090fef3e790eed78a03795b6a7ff430f9478306fcd65498df137d22f5e07
size 1689336864

3
gemma-3-4b-pt.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef13cfd3d0929c52895a14dce132930c47f46834202613e69f4358e27cada238
size 2363374624

3
gemma-3-4b-pt.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:008f5ec0a2dbefea5f3b6e3f27d1eb7c87cf12eb5abaf8ffb249a5a96decc63d
size 2263104544

3
gemma-3-4b-pt.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:08a32714a5171d3d417026b9391cf9910d2b62eda1514260ad240d945eca5e17
size 1729027104

3
gemma-3-4b-pt.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c947cbb181aff8b4d0955ce6ae8364f08841463b9c9fb44fdacf8c5eb6892ae8
size 1635925024

3
gemma-3-4b-pt.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eda7b1cb83104822439b32efc4120dcc3c79947d0a56872dd6ceb21cea354e23
size 2235948064

3
gemma-3-4b-pt.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:324b8b207229818e97dbd68bf294e45ef30c7c7e7014f2d2baa2a03bbeedf4ac
size 2098322464

3
gemma-3-4b-pt.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:568955defcc9c82b8e586feb04edee8409cf6be8269103cb163d0cf73a12a9c3
size 1937226784

3
gemma-3-4b-pt.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c458b2283537fdd8fd8e70d3dafa4e7f4b663f28fedeecc214e01b8d8ef6ad45
size 2369928224

3
gemma-3-4b-pt.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d68737de53b52a38d6c82f801c9faa4d0ca95ded271c2fe18f582dad4ba6f008
size 2563914784

3
gemma-3-4b-pt.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dd8d55199c411d004b356ee927ae72748544ea4a98cd4b44133bc17029afae10
size 2489756704

3
gemma-3-4b-pt.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e81b1d333c2774b8462f9929712dd10a3e4e47576c04cb809d347120ee8dbfdc
size 2377792544

3
gemma-3-4b-pt.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:971311adfa8581e27e3a3b6a9d20051597b3354257ff26634fe21885321d72b5
size 2829560864

3
gemma-3-4b-pt.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:10cce50d1f641bae2d876a48a3bf5786d4a81e5393adf99083ffb8f2c87c506f
size 2764454944

3
gemma-3-4b-pt.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0030f3229bc7448a9e114b779b22dcf12835948fbf251e1e486ed0f6fa3e382b
size 3190602784

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:72eafc3234fa93f16ff11f581b0b9ae743cde6e06fae7936a523fb8246da03ec
size 3419855