mradermacher/gemma-3-1b-it-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gemma-3-1b-it-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-15 00:05:17 +08:00
commit 67a4cf0cef
14 changed files with 152 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

47
.gitattributes vendored Normal file
View File

@@ -0,0 +1,47 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-it.f16.gguf filter=lfs diff=lfs merge=lfs -text

69
README.md Normal file
View File

@@ -0,0 +1,69 @@
---
base_model: google/gemma-3-1b-it
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- en
library_name: transformers
license: gemma
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: -->
static quants of https://huggingface.co/google/gemma-3-1b-it
<!-- provided-files -->
weighted/imatrix quants are available at https://huggingface.co/mradermacher/gemma-3-1b-it-i1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-GGUF/resolve/main/gemma-3-1b-it.Q3_K_S.gguf) | Q3_K_S | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-GGUF/resolve/main/gemma-3-1b-it.Q2_K.gguf) | Q2_K | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-GGUF/resolve/main/gemma-3-1b-it.IQ4_XS.gguf) | IQ4_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-GGUF/resolve/main/gemma-3-1b-it.Q3_K_M.gguf) | Q3_K_M | 0.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-GGUF/resolve/main/gemma-3-1b-it.Q3_K_L.gguf) | Q3_K_L | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-GGUF/resolve/main/gemma-3-1b-it.Q4_K_S.gguf) | Q4_K_S | 0.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-GGUF/resolve/main/gemma-3-1b-it.Q4_K_M.gguf) | Q4_K_M | 0.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-GGUF/resolve/main/gemma-3-1b-it.Q5_K_S.gguf) | Q5_K_S | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-GGUF/resolve/main/gemma-3-1b-it.Q5_K_M.gguf) | Q5_K_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-GGUF/resolve/main/gemma-3-1b-it.Q6_K.gguf) | Q6_K | 1.1 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-GGUF/resolve/main/gemma-3-1b-it.Q8_0.gguf) | Q8_0 | 1.2 | fast, best quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-it-GGUF/resolve/main/gemma-3-1b-it.f16.gguf) | f16 | 2.1 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->

3
gemma-3-1b-it.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0811b711e7afd5296f3cb5fa5129593419125a5d5468d1d6710ffe2f16811fbe
size 718168000

3
gemma-3-1b-it.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9357cd4083225974058f164bddfdb5a6fe5a331a975ee91b50bcf29a0527bf8b
size 689814976

3
gemma-3-1b-it.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a3143233e4c432fd8539626cc3be49fc088be170571c3ff6498ebeaf6d378873
size 751576000

3
gemma-3-1b-it.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f5c9d3144357b125298a4fc88c66e5012a5a1ca4eafbaadaebff77f54aaf23ce
size 722416576

3
gemma-3-1b-it.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:92735b72156ac8b5015919203507b513434a687a9b40b40ec723f937d23da7c6
size 688856512

3
gemma-3-1b-it.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5eb34776f24a960c1e66cb170fef87aab8f7b466e413201d58fc5d8612eca2a0
size 806058688

3
gemma-3-1b-it.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b50d62ba2aee8d91f0c39aab04f624badd4a779d71967027f2d0a0a359d650cb
size 780993472

3
gemma-3-1b-it.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:351c5178f43aed205150f97e5b20eac7b166bb129bab4f0a434922817d696bfb
size 851346112

3
gemma-3-1b-it.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bdadc29d3f8ee036c5b82fd653f47bf782c89148177df420a2fe355798c10aba
size 836400064

3
gemma-3-1b-it.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9511ec986f8ee61a48952883b50aeefa9354cbe408511c4b918053f2856d18c2
size 1011739072

3
gemma-3-1b-it.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f75972a988207e34a35ae0c9c582e0bd200d0e9930d9f06d134477b376b07ec7
size 1069306816

3
gemma-3-1b-it.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8bc1b8e34c5c9b3013158e6d6d5854e504d8df278f8a1bf087da85ec412e56a4
size 2006574016