mradermacher/RSI-AI-V1.0-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/RSI-AI-V1.0-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-29 13:23:15 +08:00
commit 671623370f
27 changed files with 224 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-MXFP4_MOE.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

89
README.md Normal file
View File

@@ -0,0 +1,89 @@
---
base_model: EpistemeAI/RSI-AI-V1.0
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- gpt_oss
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: MXFP4_MOE Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/EpistemeAI/RSI-AI-V1.0
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#RSI-AI-V1.0-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/RSI-AI-V1.0-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ1_M.gguf) | i1-IQ1_M | 12.1 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ1_S.gguf) | i1-IQ1_S | 12.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 12.1 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ2_XS.gguf) | i1-IQ2_XS | 12.1 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q3_K_S.gguf) | i1-Q3_K_S | 12.2 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ2_M.gguf) | i1-IQ2_M | 12.2 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ2_S.gguf) | i1-IQ2_S | 12.2 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ3_S.gguf) | i1-IQ3_S | 12.2 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ3_XS.gguf) | i1-IQ3_XS | 12.2 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 12.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q2_K.gguf) | i1-Q2_K | 12.2 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.2 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q2_K_S.gguf) | i1-Q2_K_S | 12.2 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q4_0.gguf) | i1-Q4_0 | 12.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ3_M.gguf) | i1-IQ3_M | 12.3 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q3_K_M.gguf) | i1-Q3_K_M | 13.0 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q3_K_L.gguf) | i1-Q3_K_L | 13.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q4_1.gguf) | i1-Q4_1 | 13.5 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q4_K_S.gguf) | i1-Q4_K_S | 14.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q4_K_M.gguf) | i1-Q4_K_M | 15.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.0 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q5_K_M.gguf) | i1-Q5_K_M | 17.0 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q6_K.gguf) | i1-Q6_K | 22.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
RSI-AI-V1.0.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bb6199d63f85ebc4d2ebb5992c33d31fc751ef42191d6b02c1621c59478e624c
size 12016853152

3
RSI-AI-V1.0.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:67815a5243a338020a13257f00e295bfe74975fc3e93b64c050b7c56bfa3c243
size 12016853152

3
RSI-AI-V1.0.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:86b402df7963dfa11fa86098380c22e6ac9ff67acd25588f5a49100e7e297a0e
size 12065513632

3
RSI-AI-V1.0.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:45dffa8f0cefa0bf2f3405b7a8254601e06721deba0edf41862df3d725bc0eda
size 12065513632

3
RSI-AI-V1.0.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:617cb688869f5b98ae247a4c8d023bc77f7eff29c242035e7d475d0e4bd28e2a
size 12025700512

3
RSI-AI-V1.0.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ec655db8024cc88812817754d259bf8161f8d7f4408df9133efac7b09d3acbd7
size 12016853152

3
RSI-AI-V1.0.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:167fb6832cdf9f2c919d3dffcca049825435b7909e0432d18355bf5c471e3772
size 12202647712

3
RSI-AI-V1.0.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:86adb203cfbeb39bbebe8de0ab0f0cc01cebd4d91fcf62d7573a2c0be37687b9
size 12065513632

3
RSI-AI-V1.0.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aaa2a4c32ab86ec5bbfcdb5d1b74ce284eac62d83f21745454bd10612a296914
size 12065513632

3
RSI-AI-V1.0.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ab4ba7b963f43b52ab755c514b4fcc276fdbf8b90470eb0811a63e41d638f2ba
size 12065513632

3
RSI-AI-V1.0.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a5970c083449188393835ed2133f3cdf78a030005c5634f591e0105e8ea893d9
size 12096479392

3
RSI-AI-V1.0.i1-MXFP4_MOE.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d7e229e647477b226f17c7ff3e0f61904bd35379dda8bb2685ff3030b8a32313
size 12109566112

3
RSI-AI-V1.0.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ac93a2c3944c81134f30dbfd8d102c506713e197ea82558a20329c0974656ae4
size 12065513632

3
RSI-AI-V1.0.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a9f6c0aa08a1da3bc009c28bb7da34b99e698751ec178ae1766d7e860f2e4962
size 12136292512

3
RSI-AI-V1.0.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e9f7580d6e61e086b8e8f075124dbf2d67029024b4fb400675893fceec5e386b
size 13335109792

3
RSI-AI-V1.0.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21803f9d1c0956d140d3db7ba6c13f6cbc888aa64956e2802fd0ca73bfa091c7
size 12916150432

3
RSI-AI-V1.0.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e7ac7a28491a4465e64fd999ff4b22699b5a5a24b29057d8dc5c0fb79215b4a5
size 12061089952

3
RSI-AI-V1.0.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8e0b09326238d2ac7f62fedf9906e36c6736cb50ad31ce0bb1e6b21871215c52
size 12148457632

3
RSI-AI-V1.0.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1f69cfaea00b8fbcebf98c2c90e1e915cae6d3ba649d82cfe957ddb3e173b07e
size 13369093792

3
RSI-AI-V1.0.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:13e1bfdb8e79802c6053dea5383d4636720de894d653c94ee5d76402b00a34d7
size 15805136032

3
RSI-AI-V1.0.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:74282fdfc181c4ef794f6fd2c3b1b4b3e1177c830ac281c1445bdfa3185de5a6
size 14654241952

3
RSI-AI-V1.0.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1040c7b9b1cec5f2ef9dc487f53b6d7ab653211174964ffef6c90a724d9e844d
size 16893061792

3
RSI-AI-V1.0.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0fdf2e7302e27c589ea3f1733ff7daacd6659fd816b4a3ac8c67a549c9a9d445
size 15892204192

3
RSI-AI-V1.0.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8b17c36a96dbd3e3519f4de7df3f05266272c8bc9d881e9901b4b766931f0cf8
size 22193344672

3
RSI-AI-V1.0.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:67250f915f9c4cc470ed07fd76eec69fc196853b9014425a48c11928babdbf61
size 28079776