初始化项目,由ModelHub XC社区提供模型

Model: mradermacher/gemma-3-1b-pt-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-22 11:22:49 +08:00
commit f4f676df39
27 changed files with 216 additions and 0 deletions

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-1b-pt.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

81
README.md Normal file
View File

@@ -0,0 +1,81 @@
---
base_model: google/gemma-3-1b-pt
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, youre required to review and
agree to Googles usage license. To do this, please ensure youre logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- en
library_name: transformers
license: gemma
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/google/gemma-3-1b-pt
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/gemma-3-1b-pt-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-IQ1_S.gguf) | i1-IQ1_S | 0.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-IQ1_M.gguf) | i1-IQ1_M | 0.7 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-IQ3_S.gguf) | i1-IQ3_S | 0.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-IQ3_M.gguf) | i1-IQ3_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-Q4_0.gguf) | i1-Q4_0 | 0.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.8 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-Q4_1.gguf) | i1-Q4_1 | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-1b-pt-i1-GGUF/resolve/main/gemma-3-1b-pt.i1-Q6_K.gguf) | i1-Q6_K | 1.1 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:65e66e68af5b1150b9cc498f99b65212d43a571caaf27b23bce42788b0b2f282
size 643484544

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4cf45e44dad67bca5a9b0f4de21e98ad0f92f137e7f769ebcd7eff499de4d215
size 639192192

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c69de1ca2e1e9a8bf97f42aac6ada921fa7dfc020340ad97948f38061a90beb7
size 669782400

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5ac899f5efdff30fefe63d1af5cbfaad7c3337fe1723b5fb5059f1aee7d2965b
size 664059264

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cf2427ecd8108221d8661b8b8cca5d36c30fcff4450857625ab2eac6208089f0
size 657320064

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:67cfc48d9f7909eae2a8ee654af702e9cd81ec3434e1f0a737c62f7d6176cd48
size 650638464

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5779b66c901f8e2a0ca3fcabf1f0b4a8778dfb0dfd275312db516c6463e2daef
size 697059456

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:32323b4c8ea70f6f66dbc933ea0a921efeefdcde8fa1df90bdc0ba1bf997e054
size 689813376

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b56d760f5f61ca574af61fd53d53237954c80ce68055c6d9681af9c01e37a95e
size 689813376

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:749f70dcf9f1ec94e475ccb14a0b09c0f51c7f091c82b04239a05ca3dd64bac6
size 680108928

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3e04fbe02ecee06968b8576937699709fc0de3a6fe5153ba612c78fe6a5d3e3c
size 721862016

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:73a66ff1e3809b36dc5b91984be8c693dafc87f6f8725c65fa5877d7bfb25204
size 714433920

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:443407a993afa6e07d3150632c74065f34671d848fc3b13b8956572ce9965106
size 689813376

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1581e2531ad0febd3855922a60d708fda8681d945490c1904e92d63b5ab71f32
size 671270784

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:48916d252ef9e4f09ef4f2732c0e1e89045c168a5ce6873aa9e6aaf5ebf4dad5
size 751574400

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:661062f23fd9c8b2b799aac958cd333fa0f32e1569790a1666916a168a58838b
size 722414976

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e3adf3a95ca2564788b6496c47ea4612cc8a899d02a93d82e443126c26149f4
size 688854912

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:557ee0a2e2e724200ea3f3fb4f26cf2ac5cc34b68beabbe3232bfc2231619c35
size 721917312

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:74e33fc4047aa33a6b222eef860734480d1fde976a076eafc61db01f489c0c7f
size 764034432

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:182cedf70c9b8ca472ccc4300b5ead82a9fa9b917416543b66217db761373da9
size 806057088

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a883aabd83bc350ca72a3176aa70cf2fed3a05d708223adb77e2309c0ccc0476
size 780991872

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:784aed5d4d86dc28e94141ed4b9dcf3b83e8be983a0ef58170aab1376adbb5a3
size 851344512

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6b15cc058fd42702fdeeae57207e7ee60b167b5a4ac5a16010511781b899422e
size 836398464

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9f3cd639dad2eeec421b737203d450cc5d5c0ba90fe3df0cac98e7e8348c5a3e
size 1011737472

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:24e79b4748c17314f2013114bbde6ddc9e4da477475b403979d4b1bb2cfae241
size 1430407