Compare commits
10 Commits
49fb46001f
...
3a1fb8206e
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
3a1fb8206e | ||
|
|
2fac35f87d | ||
|
|
492d811a58 | ||
|
|
fa374b4a84 | ||
|
|
f9c9e7bcd5 | ||
|
|
494d786b03 | ||
|
|
70a35da9a4 | ||
|
|
d46bdacfa7 | ||
|
|
71f8fe1d0a | ||
|
|
d128f8ff25 |
9
.gitattributes
vendored
9
.gitattributes
vendored
@@ -49,3 +49,12 @@ AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -t
|
||||
AuroGodSlayerEtherealKrix-12B-Wg.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
AuroGodSlayerEtherealKrix-12B-Wg.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
AuroGodSlayerEtherealKrix-12B-Wg.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
AuroGodSlayerEtherealKrix-12B-Wg.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
AuroGodSlayerEtherealKrix-12B-Wg.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
AuroGodSlayerEtherealKrix-12B-Wg.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
AuroGodSlayerEtherealKrix-12B-Wg.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
AuroGodSlayerEtherealKrix-12B-Wg.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
|
||||
3
AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ1_S.gguf
Normal file
3
AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:1e39b2c2d019cd7a87b1e32ba0e73c85c320c9926668b80860bca0625f0ab17f
|
||||
size 2999228128
|
||||
3
AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ2_S.gguf
Normal file
3
AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:cb8e471e8bf4cdf256a9043e062daf245338f5432b316984f554cfbaacd12e13
|
||||
size 4138491136
|
||||
3
AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ3_S.gguf
Normal file
3
AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8bcdb5f913c2c8423dbc581ea6f4befc81c6ed5a25031fe01eae0d9158223900
|
||||
size 5562098944
|
||||
3
AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ3_XS.gguf
Normal file
3
AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:63ab086262a5e8d1a52699f6eeac4ac4eabbaadeb58f68563ba74b5a0de03b0c
|
||||
size 5306508544
|
||||
3
AuroGodSlayerEtherealKrix-12B-Wg.i1-Q3_K_S.gguf
Normal file
3
AuroGodSlayerEtherealKrix-12B-Wg.i1-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ed333e0aad958cc93d938af1aeb3d19bba1fea18fb25a62a2d54a64b8dc36610
|
||||
size 5534246144
|
||||
3
AuroGodSlayerEtherealKrix-12B-Wg.i1-Q4_0.gguf
Normal file
3
AuroGodSlayerEtherealKrix-12B-Wg.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:815af3b7c37a9f2d91777d370f5b9a8cf2d3e2a8846eb42ea5008ea208610604
|
||||
size 7094660320
|
||||
3
AuroGodSlayerEtherealKrix-12B-Wg.i1-Q4_1.gguf
Normal file
3
AuroGodSlayerEtherealKrix-12B-Wg.i1-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:752b3ca52a424f3a050532218d86328749b073371e82bb4da52ad9d4e1621b84
|
||||
size 7795241120
|
||||
3
AuroGodSlayerEtherealKrix-12B-Wg.i1-Q5_K_M.gguf
Normal file
3
AuroGodSlayerEtherealKrix-12B-Wg.i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0d72178d4e2fc1b5c87f2f3b6a63264a2b5ad479400f251e4b69e73676685f55
|
||||
size 8727655520
|
||||
3
AuroGodSlayerEtherealKrix-12B-Wg.i1-Q5_K_S.gguf
Normal file
3
AuroGodSlayerEtherealKrix-12B-Wg.i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f18518303e20f7e81bb8032cfc7b8421885e9443ece65c011af31d2da3d36df3
|
||||
size 8518759520
|
||||
17
README.md
17
README.md
@@ -41,13 +41,30 @@ more details, including on how to concatenate multi-part files.
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ1_S.gguf) | i1-IQ1_S | 3.1 | for the desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.7 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ2_S.gguf) | i1-IQ2_S | 4.2 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ2_M.gguf) | i1-IQ2_M | 4.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.6 | very low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.0 | lower quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.4 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ3_S.gguf) | i1-IQ3_S | 5.7 | beats Q3_K* |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.2 | IQ3_S probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.7 | IQ3_M probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.8 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-Q4_0.gguf) | i1-Q4_0 | 7.2 | fast, low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.2 | prefer IQ4_XS |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.2 | optimal size/speed/quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.6 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-Q4_1.gguf) | i1-Q4_1 | 7.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.6 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.8 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/AuroGodSlayerEtherealKrix-12B-Wg-i1-GGUF/resolve/main/AuroGodSlayerEtherealKrix-12B-Wg.i1-Q6_K.gguf) | i1-Q6_K | 10.2 | practically like static Q6_K |
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||
Reference in New Issue
Block a user