mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-30 22:55:24 +08:00
commit e955184d28
24 changed files with 198 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

57
.gitattributes vendored Normal file
View File

@@ -0,0 +1,57 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2f9939cf6b281920adce67154890284851d2696c29c7494ba4c3f61ac51d8eb3
size 5267141952

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dbef8ba9ef0f58ed9a31ac5b388614c57f18f7d2fab062d122b4ebf6775d1e2b
size 4829492544

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:37a637c2e3ac50c0265c5173767861ea8019f522cf51bb1c2fef49447d281107
size 7618966848

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:26b486f9927634d80f78ce2a0796ff780a6bac6757802719ac70ecdcbc110e3a
size 7035434304

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6aeb442848794c8df95ac696b78c352acc440225f45a163ee306fdac75afa469
size 6646150464

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa6d13e4bf3dfd65355bfbd7e566d60ab097c4fb38547aca3e731ca501eadf0b
size 5996557632

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5838c5563ffb9db44de6e2a2c129d28ec7c7886f7cfb51eac17500870140933b
size 10062411072

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:05ca0b7f58a5d14436311ac298490b54e6a737698f1bd5a8b542bcf7a14701b4
size 9688069440

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8787e17c35fdf09276c499a00f384a0f66d68580295fa07d8b078fdc48628231
size 9176102208

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:12ed2078edebfc9706c8354e0406cb2526e923c725e378775f8f1b9c80eaf338
size 8598861120

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7c6aaef009ef161e0d4c69bf0c460d4857c93160face78a53d84150cde60bd97
size 11935298880

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3fe69d07a21dea4096d1ba8bed64740e67efbd8d16202d2f59dfcc3db81f6365
size 8272098624

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a028b618a2c317ec812b163b10f317b22c93c5a5a5d607deb83d301a1e8532f9
size 11730433344

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2d72ee09c2c7805fd8b73312f465926c43f832b310a19dbc9c2c74cf287b983c
size 10756830528

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d4752517a4ff0361c1c5ce12fcf78545cb9c5321cb102d0498526f607cf0bf8a
size 9641276736

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7c0a1ec4727b8ce57178270f72fc3be9ca87801da89bc7cbea143e296e1dbfc4
size 12613203264

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d81019c9030619d5fbcb8b7403680f00eaa8e543a61f7b5dfd7fb52261ee73bf
size 13341242688

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8a645757178701f12bc2a02876ce6af904b9bf045dc67dd81599082500d857df
size 12660389184

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:660115a873d68973122267bc8bc696c505375d61f0f69f7a961a1206cb05bc87
size 15722558784

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:949ed2336999a1f3764e05f23f47a6cbe4a0111e04c4bde7eade96cc79bf8839
size 15324820800

3
Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5b184757aa10a98e1648a81f99a8d9c4cb853917640185640143a93bea9c2ac5
size 18252707136

75
README.md Normal file
View File

@@ -0,0 +1,75 @@
---
base_model: ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1
language:
- en
library_name: transformers
license: other
license_link: https://mistral.ai/licenses/MRL-0.1.md
license_name: mrl
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ1_S.gguf) | i1-IQ1_S | 4.9 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ1_M.gguf) | i1-IQ1_M | 5.4 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.1 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 6.7 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ2_S.gguf) | i1-IQ2_S | 7.1 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ2_M.gguf) | i1-IQ2_M | 7.7 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q2_K.gguf) | i1-Q2_K | 8.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 8.7 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 9.3 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 9.7 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ3_S.gguf) | i1-IQ3_S | 9.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ3_M.gguf) | i1-IQ3_M | 10.2 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 10.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 11.8 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.0 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q4_0.gguf) | i1-Q4_0 | 12.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 12.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 13.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 15.4 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 15.8 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF/resolve/main/Mistral-Small-22B-ArliAI-RPMax-v1.1.i1-Q6_K.gguf) | i1-Q6_K | 18.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a4026c8a2f1fabbaf9c1f4bf962ce2a92f64d35fd3354ec41a39fe1f062fec63
size 11940565