mradermacher/gemma-2b-aps-it-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gemma-2b-aps-it-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-08 03:56:16 +08:00
commit 5a055c4141
27 changed files with 216 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-Q4_0_4_8.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-Q4_0_8_8.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2b-aps-it.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

81
README.md Normal file
View File

@@ -0,0 +1,81 @@
---
base_model: google/gemma-2b-aps-it
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- en
library_name: transformers
license: gemma
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/google/gemma-2b-aps-it
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/gemma-2b-aps-it-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-IQ1_M.gguf) | i1-IQ1_M | 0.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-IQ2_S.gguf) | i1-IQ2_S | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-IQ2_M.gguf) | i1-IQ2_M | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-Q2_K.gguf) | i1-Q2_K | 1.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-IQ3_S.gguf) | i1-IQ3_S | 1.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-IQ3_M.gguf) | i1-IQ3_M | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.5 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.6 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-Q4_0_4_4.gguf) | i1-Q4_0_4_4 | 1.7 | fast on arm, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-Q4_0_4_8.gguf) | i1-Q4_0_4_8 | 1.7 | fast on arm+i8mm, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-Q4_0_8_8.gguf) | i1-Q4_0_8_8 | 1.7 | fast on arm+sve, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-Q4_0.gguf) | i1-Q4_0 | 1.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.7 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2b-aps-it-i1-GGUF/resolve/main/gemma-2b-aps-it.i1-Q6_K.gguf) | i1-Q6_K | 2.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
gemma-2b-aps-it.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b7e5a3e560fe29d227cc3f32847f88d3227d6de6765fb9d5781578d967d40540
size 813844864

3
gemma-2b-aps-it.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6e537cc4cf1bc4ebfa61cf155b85f8756809b3421a4b0115134c80b1a56b2f05
size 770959744

3
gemma-2b-aps-it.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:83b96b9204532107e6392907b7b69769c7202b2f9130c34ca00df712af604ba6
size 1019472256

3
gemma-2b-aps-it.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f72b8af371987a34fcbd45127b1da90b1c07cd780c61947c6e0e183a4282e798
size 962292096

3
gemma-2b-aps-it.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1bc6dc82834037527cd045bec05ba4eb863bb5c3c93bf8b1453d2e8b1cdf225e
size 944859520

3
gemma-2b-aps-it.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3c28b3aa6a46c53bb78f8814bf79398a056b7433d8e65acf7aa404b36881307e
size 885320064

3
gemma-2b-aps-it.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:704cd7614835361d602d2da1d2df9cb38ec8866611c059ce4504cf693da5d0b8
size 1308174720

3
gemma-2b-aps-it.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c6b290bb4f630b3ed41de0a1f06f9a469b098ef6f0022a09991e66b1df6abcf6
size 1289234816

3
gemma-2b-aps-it.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:349558db7be452b3a24c9c92209bcc4521c07f0946b5985216f0d4451e71c4db
size 1244359040

3
gemma-2b-aps-it.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:397a98a79b744e0694cffff908edab3406f377fb0cfd10342f7e2eb8c1035c9f
size 1125378432

3
gemma-2b-aps-it.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:61f4c86d2c30659b86ea55f84e8c5f2f74ffc362cd85cae2e5ec9d206d689486
size 1490733440

3
gemma-2b-aps-it.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:977f6f45ba705de0ef05746ee5874e6450a819c285835715f2e40984b5165212
size 1157925248

3
gemma-2b-aps-it.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c4e87a86b4e250c67f30870d24a8ec9897aefb3c373760fc6cdc2bd6c6404003
size 1465592192

3
gemma-2b-aps-it.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17935a5095eebcbafc6c24f43be4329ce707ad7f2c04994b15560f76c526f1f7
size 1383803264

3
gemma-2b-aps-it.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7363ff90a15550cc88a96011b4d1e0c535aee56605a50c54e6233f65e22a4db7
size 1287981440

3
gemma-2b-aps-it.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17aa24d2b5aa4dfb33a4d42d6e9b43dfcf8582a193c93d62dad11087bef036b9
size 1555384704

3
gemma-2b-aps-it.i1-Q4_0_4_4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f1d972b1e8eddacd0ae049307c0f2754d8d58518ce8fa485b471aa873e1b17d1
size 1551190400

3
gemma-2b-aps-it.i1-Q4_0_4_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b17d5b1c90dbc6981fccbc3cff8cbda4b401e87741efc96b07fe974635b5e1f1
size 1551190400

3
gemma-2b-aps-it.i1-Q4_0_8_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c35c64a5cfe709807061060db47d1310ebf5d5413ccc6fd7a693bf9e1d03cc1b
size 1551190400

3
gemma-2b-aps-it.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:27f827f8d02357da76e3b0931a8027fbc178ea89a9d551470cb9bd68974b12ef
size 1630263680

3
gemma-2b-aps-it.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4dad3ac60dec6c05c11a6c117cd81bbdcc4035c234b25aa0cc122020edad358a
size 1559841152

3
gemma-2b-aps-it.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c637868ce0cf2d0c0fd33ea26fae51faf24369d82470d163e17511f86e59f009
size 1839651200

3
gemma-2b-aps-it.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d3d94f358702fab5ae58efdec56a5f878bb082a1c40b4da4e3c51b25cb78c2cb
size 1798916480

3
gemma-2b-aps-it.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:715e4f4ae6d08b36089a78e2f0cc94248b0ba88f5059b35a969384f7df11ee15
size 2062125440

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:779c897645a590e781b18c917fcac6e6e69098e469528975f8f03c69af07ee16
size 2068543