mradermacher/Gemma-9B-Base-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Gemma-9B-Base-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-06 13:05:19 +08:00
commit 3811081fe7
27 changed files with 213 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-9B-Base.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Gemma-9B-Base.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ebc62ddb431e473233b3dc6fdf34c32abf906876497dd1f4fdf0aeda503a541c
size 2545954080

3
Gemma-9B-Base.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:310b87c1ccf07386f61d4d069766047f0a7b2431be55b966cc703550eae8ed53
size 2378566944

3
Gemma-9B-Base.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ae75b89ca2bf805471c17ffd3667fac8ed63637a9b0800be4962baa43be08645
size 3434671392

3
Gemma-9B-Base.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9dca6085dcb73a88bd72f143e44073067f20536ee576d9d37b65073da44a0e37
size 3211488544

3
Gemma-9B-Base.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7bef29186ceae18fd2b82c241b826c662d6f5a7d6501401b9c696b0a909ce97d
size 3067383072

3
Gemma-9B-Base.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba1bfdc73511dcc2052a70c501c0cfa1017b962fa7090c850cff32e4a43c4ccc
size 2824932640

3
Gemma-9B-Base.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a162f9b3fd2dc87cb0a080bb4ae3df08796b970e2ca17867e5ae66348471a6d
size 4494617888

3
Gemma-9B-Base.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c1538774fe08f3a66867d404d3389e4c80dc182313abb1b3c8b04bef25556d86
size 4337667360

3
Gemma-9B-Base.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d09f69f9e0d88a6b7b7ff29dc5348420c347c6cd42eb1796a9b8c82619406272
size 4144991520

3
Gemma-9B-Base.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d331be300a9309d1f4213ba94abff10656b12b15536d2e3126e7b8517ec5d209
size 3796741408

3
Gemma-9B-Base.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a2c2a5593194584464f9b172dcf20876a6df08144bef1082b97ad8ec51f1ae9c
size 5443144992

3
Gemma-9B-Base.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a710d1fe23c8ea1b8bfc6a73968147891bcc104b427d1cb7667b1498c36ba3be
size 5183032608

3
Gemma-9B-Base.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4d15885f0f0c51030dab13e285074a3dff3e092cac822c7473f71ebca366b842
size 3805400352

3
Gemma-9B-Base.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:44c3a6af7edf83d975d7e41de1719ba4649868f23e036b7b282006f610038e77
size 3552513312

3
Gemma-9B-Base.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e151ac3273c1538a6bf7fe0d912bb957bff45bbaf66382993295f3fff5f3e3b1
size 5132455200

3
Gemma-9B-Base.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e26c25ba9ae24a6f2b674b9eb054d4f7336dcec6903556e6908e7e7a714a887e
size 4761783584

3
Gemma-9B-Base.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:304d6c04dc706fae54692f462af47552fd2f6c455e159ebe657a002129b509f1
size 4337667360

3
Gemma-9B-Base.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dd93b757a347bce99cd40e219f2e1e72591126a32488a991df872ff530371b12
size 5459201312

3
Gemma-9B-Base.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b50bddd5b4b84caaf57c4dee4a3986da246d74a259920e9b675a82ca415325bf
size 5963369760

3
Gemma-9B-Base.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:91841afeaa6b9ddd635b26abc6b12d21ecc338c2cc55d1467586b7646ab141eb
size 5761060128

3
Gemma-9B-Base.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3e37e88a6ec2017f610b384a9bc2c7c8e9ca64c47094d72b02859a1cb245c1ff
size 5478927648

3
Gemma-9B-Base.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b32917e38e9bd52e858bb4846ba5e0654984aeeb5190c9869ba51b8e51ab2136
size 6647368992

3
Gemma-9B-Base.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa361a27ce0313fbb5088506adf9a7f59c2c8b500cf924e1b6a74e49d0e22cfd
size 6483594528

3
Gemma-9B-Base.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:97fde599263c87e0dc43a99ef73d926ac5e97d9d6c44c8d24190e64061339f7d
size 7589072160

78
README.md Normal file
View File

@@ -0,0 +1,78 @@
---
base_model: Sorawiz/Gemma-9B-Base
language:
- en
library_name: transformers
quantized_by: mradermacher
tags:
- mergekit
- merge
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Sorawiz/Gemma-9B-Base
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Gemma-9B-Base-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-IQ1_S.gguf) | i1-IQ1_S | 2.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-IQ1_M.gguf) | i1-IQ1_M | 2.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-IQ2_S.gguf) | i1-IQ2_S | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-IQ2_M.gguf) | i1-IQ2_M | 3.5 | |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-Q2_K.gguf) | i1-Q2_K | 3.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-IQ3_XS.gguf) | i1-IQ3_XS | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-IQ3_S.gguf) | i1-IQ3_S | 4.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-Q3_K_S.gguf) | i1-Q3_K_S | 4.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-IQ3_M.gguf) | i1-IQ3_M | 4.6 | |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-Q3_K_L.gguf) | i1-Q3_K_L | 5.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-IQ4_XS.gguf) | i1-IQ4_XS | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-IQ4_NL.gguf) | i1-IQ4_NL | 5.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-Q4_0.gguf) | i1-Q4_0 | 5.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-Q4_K_S.gguf) | i1-Q4_K_S | 5.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-Q4_1.gguf) | i1-Q4_1 | 6.1 | |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-Q5_K_S.gguf) | i1-Q5_K_S | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.7 | |
| [GGUF](https://huggingface.co/mradermacher/Gemma-9B-Base-i1-GGUF/resolve/main/Gemma-9B-Base.i1-Q6_K.gguf) | i1-Q6_K | 7.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cb1bb9ae2086aa5138a53d88765014e1205d906e8a2d264bf688bfbfd0553e02
size 6116887