mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-02 14:09:19 +08:00
commit b757648085
24 changed files with 196 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

57
.gitattributes vendored Normal file
View File

@@ -0,0 +1,57 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5e6102c48c24a5245163ee946fe27fe225d9e5b4c66803123b61de32a3cb4022
size 873797920

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3ed1e3204c2a77ae0e702f3d9d617b1f9ad32d075aabac25f954cc54b1896dec
size 832160032

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:61249c20a0e54a5d5e804eab35de8aff3bce285b1fd88ab81e67c9d83ef9bbf0
size 1088014624

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:45380ab6b331371263c0932e2c1646e234740beafb52b24dcc7de0c8976414a5
size 1032497440

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:78cb31ff08ced95e887e3707b9c88c066f9676380ae618c09f5e756121d99168
size 1002545440

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1c91fa2263f1f83868330ee437e3595c7c2e262c0c60d897b16fcd7025aafb42
size 943194400

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c3c1226bfb7e71dc5b36dede85fb24f56a2135d4ac5ec3ba68b287fbd52b2da
size 1393561888

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f92df39918ffc276c7fae454b17c54d34fd84af7c871b20f73ee11afa84b8d4e
size 1360660768

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6c1474d9034c1548aa1dbfdf627293e3d264bac6cf226d05758503ba15331031
size 1314212128

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2f9f4f9ee89da9ee87d7be71b9bef0c4ce0852c183ed47939f19dae21a20ddff
size 1181686048

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:de3a389bc699dd02aff0e908036dec7b199e243ced07d4a626b7b362e17b63f1
size 1566251296

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:81a10562aa793fca374b1f979540c498cffdfe7bc694a7e0b8fbbaf6ce1f04c0
size 1229830432

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9300bc61c6c62ad6a9c45d9976bebad4a2d80750d51c2e219a5903dbca179d77
size 1550436640

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d17dd3e42ecde5b39294c0954f910e3b2b7bf2ebedf7b1ec367aee38a7808f60
size 1461668128

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d5eb23496815b553a3d202e3e545260d14833026a69d73694d73506e740e9d2b
size 1360660768

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5db8b4dd4110420b45408c387d3d9459ee93b80e4954eec77dadfd186db6678a
size 1633491232

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8452ed55fe4878aee4299f6e6f184d03be3a24347e7de209276a7c01830c136e
size 1708583200

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:233d4ee1d73dabddca762b9d6a4555793f3d472c290e05254071115a29c85f6b
size 1638652192

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:596475cf0cec5b434cef93b6ca2b76432d8370883022aeb9c94487ee162faa39
size 1923279136

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2b823ab2f9b8d724562bf0ec2ece139ebd1004e5d8fdab856851ebb0231e0a8d
size 1882544416

3
Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f92394ab38b5c76bf73d2aa1176c0a58dfd11087e353911c0a8e1be6447e46cd
size 2151393568

73
README.md Normal file
View File

@@ -0,0 +1,73 @@
---
base_model: ArliAI/Gemma-2-2B-ArliAI-RPMax-v1.1
language:
- en
library_name: transformers
license: gemma
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/ArliAI/Gemma-2-2B-ArliAI-RPMax-v1.1
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ2_S.gguf) | i1-IQ2_S | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ2_M.gguf) | i1-IQ2_M | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.3 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q2_K.gguf) | i1-Q2_K | 1.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ3_S.gguf) | i1-IQ3_S | 1.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ3_M.gguf) | i1-IQ3_M | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.7 | |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q4_0.gguf) | i1-Q4_0 | 1.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/Gemma-2-2B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Gemma-2-2B-ArliAI-RPMax-v1.1.i1-Q6_K.gguf) | i1-Q6_K | 2.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d24d8a293aa79cea67fbb0be339ebcb18ffe06adb96beb6906b0911dff45f388
size 2375559