mradermacher/SapientiaOcculta-12B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Compare commits

base: mradermacher:38f6c9de6fc0f3c5cb8da4db1ad17c6051ddcc16
Branches Tags
mradermacher:main
...
compare: mradermacher:91fc034ddba99bffd6383b5d32dca2dfa9a48a80
Branches Tags
mradermacher:main

10 Commits
38f6c9de6f ... 91fc034ddb

Author SHA1 Message Date
team mradermacher
91fc034ddb auto-patch README.md 2026-01-12 01:15:05 +00:00
team mradermacher
65fbf0eabc uploaded from rich1 2026-01-12 01:06:52 +00:00
team mradermacher
76036c5132 uploaded from rich1 2026-01-12 01:03:21 +00:00
team mradermacher
84bbed1a83 uploaded from rich1 2026-01-12 00:59:51 +00:00
team mradermacher
e99c9c2d89 uploaded from rich1 2026-01-12 00:59:30 +00:00
team mradermacher
9680c6184e uploaded from rich1 2026-01-12 00:58:31 +00:00
team mradermacher
727dad324f uploaded from rich1 2026-01-12 00:58:15 +00:00
team mradermacher
f234110ff0 uploaded from rich1 2026-01-12 00:57:25 +00:00
team mradermacher
d6ef8b49ce uploaded from rich1 2026-01-12 00:56:18 +00:00
team mradermacher
5dc52903e4 uploaded from rich1 2026-01-12 00:55:29 +00:00
11 changed files with 60 additions and 0 deletions
Expand all files Collapse all files

9
.gitattributes vendored
View File

@@ -49,3 +49,12 @@ SapientiaOcculta-12B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
SapientiaOcculta-12B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
SapientiaOcculta-12B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
SapientiaOcculta-12B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
SapientiaOcculta-12B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
SapientiaOcculta-12B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
SapientiaOcculta-12B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
SapientiaOcculta-12B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
SapientiaOcculta-12B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SapientiaOcculta-12B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
SapientiaOcculta-12B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
SapientiaOcculta-12B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
SapientiaOcculta-12B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text

24
README.md
View File

@@ -40,6 +40,30 @@ more details, including on how to concatenate multi-part files.
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-IQ1_S.gguf) | i1-IQ1_S | 3.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-IQ2_S.gguf) | i1-IQ2_S | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-IQ2_M.gguf) | i1-IQ2_M | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-IQ3_S.gguf) | i1-IQ3_S | 5.7 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.8 | |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-Q4_0.gguf) | i1-Q4_0 | 7.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-Q4_1.gguf) | i1-Q4_1 | 7.9 | |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.6 | |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.8 | |
| [GGUF](https://huggingface.co/mradermacher/SapientiaOcculta-12B-i1-GGUF/resolve/main/SapientiaOcculta-12B.i1-Q6_K.gguf) | i1-Q6_K | 10.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):

3
SapientiaOcculta-12B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5de11001896ae02244c315d423f4a34aa8dd08f9bf2a5f17543cdc5f4524be43
size 2999215712

3
SapientiaOcculta-12B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b57f31deb709d2c8ab82addb30a702f27427cdb400a2f38bd2dfde9f2c1c1d17
size 3915081312

3
SapientiaOcculta-12B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:41485017680c6a03dbc5a517fd1e803adf0847b06b682b86b4f3b50575d4297c
size 5562082912

3
SapientiaOcculta-12B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ab5ef3fa2e3a47609d6d07de1533488e668dd551266aa27d1fe68fe64301ccf4
size 5306492512

3
SapientiaOcculta-12B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b4dce9f6992f5dbe86d41c47253106bea5ad0826e35f5125b524f7955a1c8f14
size 7097919072

3
SapientiaOcculta-12B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a283e2f27075cda0836946ec977ff6233f1a645ef7c881da86ede5156bb58f0c
size 7094642272

3
SapientiaOcculta-12B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:52f07e302cb2c0baddaaf7410bab2d0a6dbb87c2f55addff68d6ca9c6f4f6932
size 7795222112

3
SapientiaOcculta-12B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ddc0e857e3fda01dbb4f73d208b807a112f2f7d4cdbccbdd8d34c9f35f72790b
size 8727635552

3
SapientiaOcculta-12B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6de1da849e253ef24b49735e106dd4ec8d9fb491a2e8c7670d49fc4028d88d44
size 8518739552