mradermacher/gemma-7b-aps-it-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gemma-7b-aps-it-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-12 03:27:17 +08:00
commit 7035b2ddd9
26 changed files with 212 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-aps-it.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

81
README.md Normal file
View File

@@ -0,0 +1,81 @@
---
base_model: google/gemma-7b-aps-it
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- en
library_name: transformers
license: gemma
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/google/gemma-7b-aps-it
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/gemma-7b-aps-it-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-IQ1_S.gguf) | i1-IQ1_S | 2.3 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-IQ1_M.gguf) | i1-IQ1_M | 2.4 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-IQ2_S.gguf) | i1-IQ2_S | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-IQ2_M.gguf) | i1-IQ2_M | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.3 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-Q2_K.gguf) | i1-Q2_K | 3.6 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.6 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-IQ3_S.gguf) | i1-IQ3_S | 4.1 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-Q3_K_S.gguf) | i1-Q3_K_S | 4.1 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-IQ3_M.gguf) | i1-IQ3_M | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.5 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.8 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-IQ4_NL.gguf) | i1-IQ4_NL | 5.1 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-Q4_0.gguf) | i1-Q4_0 | 5.1 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-Q4_K_S.gguf) | i1-Q4_K_S | 5.1 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-Q4_1.gguf) | i1-Q4_1 | 5.6 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-Q5_K_S.gguf) | i1-Q5_K_S | 6.1 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.2 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-7b-aps-it-i1-GGUF/resolve/main/gemma-7b-aps-it.i1-Q6_K.gguf) | i1-Q6_K | 7.1 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
gemma-7b-aps-it.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f1860d91bab7ac3fb325ee0c6ee3e21d377db73f27af0076a1c9e1ab898c748c
size 2320035456

3
gemma-7b-aps-it.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:52c316b0f1cd462fc626005fbfa6c2ec97dd0ec5c8c7c907d79122569e1cc268
size 2160193152

3
gemma-7b-aps-it.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:77d6dc3bc043588733bf8ad609691ffbdb4701d07b3f1fc963729b3df98bf5a0
size 3132026496

3
gemma-7b-aps-it.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2de0c9089e6287ae1a44eeb8ae97f21f3897e8255aefb9de845930d6bbf72340
size 2918903424

3
gemma-7b-aps-it.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e060aad9a0c99511e8bbe6ca394d97b51b7afe3460cb6fa43968ef7f4988bd60
size 2810572416

3
gemma-7b-aps-it.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c2c8cf44d74f939b461126be53d6746d2117948891ef54939722b06d58620ca5
size 2586439296

3
gemma-7b-aps-it.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b1b894e4d7befced85ff2a66be69c05c38ac15b7c872c1fc1d77e379e70a8f9d
size 4106071680

3
gemma-7b-aps-it.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c67ad38a0591266f2a5b5110627f16acc0ab483a6fb87a1bc129ff2600c66a69
size 3982405248

3
gemma-7b-aps-it.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:746477ebdd5d2b017376b0c7154f98081d3f5ab62322122a87150800ed8000f9
size 3800739456

3
gemma-7b-aps-it.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a02771c2a5c0ec9f992b5d62a816a96088391a882dce016fb0e70b2619f9ed1
size 3487100544

3
gemma-7b-aps-it.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:407626365bb4af8dab6944374746afd6b110f14e98defcc83599beb20eb85679
size 5011844736

3
gemma-7b-aps-it.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba4d343cbfbd2ae203c3b1ecc39c910337fb4be45109a29cb6c57d764056405f
size 4769623680

3
gemma-7b-aps-it.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9aa0f40307d577309a00082d105c21145613b49c173426a0388d5f297d92911a
size 3481448064

3
gemma-7b-aps-it.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f9ef8130f77282b2eb107d0626fad1a2056939ebccc45fa676d96bbe44ce9f82
size 3248270976

3
gemma-7b-aps-it.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7e4d831388cd75d719060c6fee1bc7c415d5332ee33fd59e317cc3d9e5f38b2c
size 4709068416

3
gemma-7b-aps-it.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ce88e0622fe66e7248e14b9a9feedd2b6f44e6972adc553d4a6dd51df3b91ff
size 4369329792

3
gemma-7b-aps-it.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cb8fcd00587681cb26d41d816aeafa0f5324ccd892d07a949eec8adebe28147c
size 3982405248

3
gemma-7b-aps-it.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:61f1ab5e674e5b775c5e143c7fee94b375bf2d01028b1cbf8d7c3571e2d07029
size 5026000512

3
gemma-7b-aps-it.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ae6686e46d51f55cebf3398254a89e685e9dcb905e1553f746128a32f5886a53
size 5496286848

3
gemma-7b-aps-it.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:799d4789af29508a621d62ec9d0b961ecf79894176300cfe7cac915234082414
size 5329759872

3
gemma-7b-aps-it.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2aebc1fb1ed60005339f3105a5d01a08b5528306b103f622533d02f8e57d2051
size 5046447744

3
gemma-7b-aps-it.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:725cfa667fabb3d25d130c42baae34d6befceaf4c727dde9ce9b75a61538b60c
size 6144503424

3
gemma-7b-aps-it.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:991548522c412c7edd9613296830e18658b0142fb8329a5368f7d6427097533d
size 5980728960

3
gemma-7b-aps-it.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:833f754e05e115f7e87b8e90ab60540935ec220ce095755e2b62965c6cd16b08
size 7010168448