mradermacher/RSI-AI-V1.0-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Compare commits

base: mradermacher:87212109c76b19a387968460590f112d95c6731c
Branches Tags
mradermacher:main
...
compare: mradermacher:544353e8c66ab42b1c6dd6b261bf829eaaff209a
Branches Tags
mradermacher:main

10 Commits
87212109c7 ... 544353e8c6

Author SHA1 Message Date
team mradermacher
544353e8c6 auto-patch README.md 2026-01-14 17:00:05 +00:00
team mradermacher
30cd652d71 uploaded from leia 2026-01-14 16:51:40 +00:00
team mradermacher
e46847e0db uploaded from leia 2026-01-14 16:35:59 +00:00
team mradermacher
eaef90d040 uploaded from leia 2026-01-14 16:22:35 +00:00
team mradermacher
0447517606 auto-patch README.md 2026-01-14 16:15:44 +00:00
team mradermacher
c540aeba39 uploaded from leia 2026-01-14 16:05:46 +00:00
team mradermacher
21350a0206 uploaded from leia 2026-01-14 16:03:37 +00:00
team mradermacher
11541b51dd uploaded from leia 2026-01-14 15:50:58 +00:00
team mradermacher
3c3dee04b1 uploaded from leia 2026-01-14 15:33:54 +00:00
team mradermacher
44aacce2b6 uploaded from leia 2026-01-14 15:17:37 +00:00
10 changed files with 40 additions and 0 deletions
Expand all files Collapse all files

8
.gitattributes vendored
View File

@@ -50,3 +50,11 @@ RSI-AI-V1.0.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
RSI-AI-V1.0.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

8
README.md
View File

@@ -44,19 +44,27 @@ more details, including on how to concatenate multi-part files.
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ1_M.gguf) | i1-IQ1_M | 12.1 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ1_S.gguf) | i1-IQ1_S | 12.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 12.1 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ2_XS.gguf) | i1-IQ2_XS | 12.1 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q3_K_S.gguf) | i1-Q3_K_S | 12.2 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ2_M.gguf) | i1-IQ2_M | 12.2 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ2_S.gguf) | i1-IQ2_S | 12.2 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ3_S.gguf) | i1-IQ3_S | 12.2 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ3_XS.gguf) | i1-IQ3_XS | 12.2 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 12.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q2_K.gguf) | i1-Q2_K | 12.2 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.2 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q2_K_S.gguf) | i1-Q2_K_S | 12.2 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q4_0.gguf) | i1-Q4_0 | 12.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-IQ3_M.gguf) | i1-IQ3_M | 12.3 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q3_K_M.gguf) | i1-Q3_K_M | 13.0 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q3_K_L.gguf) | i1-Q3_K_L | 13.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q4_1.gguf) | i1-Q4_1 | 13.5 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q4_K_S.gguf) | i1-Q4_K_S | 14.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q4_K_M.gguf) | i1-Q4_K_M | 15.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.0 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q5_K_M.gguf) | i1-Q5_K_M | 17.0 | |
| [GGUF](https://huggingface.co/mradermacher/RSI-AI-V1.0-i1-GGUF/resolve/main/RSI-AI-V1.0.i1-Q6_K.gguf) | i1-Q6_K | 22.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant

3
RSI-AI-V1.0.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:67815a5243a338020a13257f00e295bfe74975fc3e93b64c050b7c56bfa3c243
size 12016853152

3
RSI-AI-V1.0.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:45dffa8f0cefa0bf2f3405b7a8254601e06721deba0edf41862df3d725bc0eda
size 12065513632

3
RSI-AI-V1.0.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:86adb203cfbeb39bbebe8de0ab0f0cc01cebd4d91fcf62d7573a2c0be37687b9
size 12065513632

3
RSI-AI-V1.0.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aaa2a4c32ab86ec5bbfcdb5d1b74ce284eac62d83f21745454bd10612a296914
size 12065513632

3
RSI-AI-V1.0.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8e0b09326238d2ac7f62fedf9906e36c6736cb50ad31ce0bb1e6b21871215c52
size 12148457632

3
RSI-AI-V1.0.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1f69cfaea00b8fbcebf98c2c90e1e915cae6d3ba649d82cfe957ddb3e173b07e
size 13369093792

3
RSI-AI-V1.0.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1040c7b9b1cec5f2ef9dc487f53b6d7ab653211174964ffef6c90a724d9e844d
size 16893061792

3
RSI-AI-V1.0.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0fdf2e7302e27c589ea3f1733ff7daacd6659fd816b4a3ac8c67a549c9a9d445
size 15892204192