mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Compare commits

base: mradermacher:b34448121741d45a61a352eff37fcb203da9dd7f
Branches Tags
mradermacher:main
...
compare: mradermacher:303a0c3cc7e4990c14b4f12d0873b81ef5bbd41b
Branches Tags
mradermacher:main

10 Commits
b344481217 ... 303a0c3cc7

Author SHA1 Message Date
team mradermacher
303a0c3cc7 auto-patch README.md 2026-01-02 14:14:54 +00:00
team mradermacher
3c913f01b5 uploaded from rich1 2026-01-02 14:14:36 +00:00
team mradermacher
0972aac784 uploaded from rich1 2026-01-02 13:59:16 +00:00
team mradermacher
a48e2da1f5 auto-patch README.md 2026-01-02 13:54:48 +00:00
team mradermacher
ce28e41c62 uploaded from rich1 2026-01-02 13:31:00 +00:00
team mradermacher
62c610cb00 uploaded from rich1 2026-01-02 13:04:07 +00:00
team mradermacher
e1bff94f4d auto-patch README.md 2026-01-02 12:48:16 +00:00
team mradermacher
c6fce434c3 uploaded from rich1 2026-01-02 12:42:45 +00:00
team mradermacher
7eea907fe2 uploaded from rich1 2026-01-02 12:16:51 +00:00
team mradermacher
e97d369c1f uploaded from rich1 2026-01-02 11:58:36 +00:00
9 changed files with 35 additions and 0 deletions
Expand all files Collapse all files

7
.gitattributes vendored
View File

@@ -50,3 +50,10 @@ IQuest-Coder-V1-40B-Base.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
IQuest-Coder-V1-40B-Base.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
IQuest-Coder-V1-40B-Base.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
IQuest-Coder-V1-40B-Base.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
IQuest-Coder-V1-40B-Base.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
IQuest-Coder-V1-40B-Base.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
IQuest-Coder-V1-40B-Base.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
IQuest-Coder-V1-40B-Base.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
IQuest-Coder-V1-40B-Base.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
IQuest-Coder-V1-40B-Base.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
IQuest-Coder-V1-40B-Base.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
IQuest-Coder-V1-40B-Base.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e27414090d41c4fd92119a3bcaf8b04f26afb04c675775ae9e81fe4cc10db491
size 8496100512

3
IQuest-Coder-V1-40B-Base.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:774f3bdfa9e533e6a715a4d6fcc4464ac9066de45a929e742145aca41e4efb3d
size 12328522912

3
IQuest-Coder-V1-40B-Base.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f25e8b80d737b6723dd6312cbaca10c95ac4aaa98ce634c083c5a4226f866159
size 17365578912

3
IQuest-Coder-V1-40B-Base.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ecba10cc57bea54f52dfa7fa30f7ac5860cd9898bf9e7ef34db85fba3d893da
size 16451351712

3
IQuest-Coder-V1-40B-Base.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d0ca71518a3b53a7ab0e289a82c6f6afb43763906d517361a96e31c802ee49ce
size 22578762912

3
IQuest-Coder-V1-40B-Base.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8c5a5b18bb156d173c479b26e80e303895d33cf41f91e19be5b335ac3afbc99d
size 24952804512

3
IQuest-Coder-V1-40B-Base.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9acf44cd4252bee58acbea97d1c5f01de9dfc8c0e269cd0c6c79eb3bcf16f006
size 28195198112

7
README.md
View File

@@ -40,21 +40,28 @@ more details, including on how to concatenate multi-part files.
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-IQ1_S.gguf) | i1-IQ1_S | 8.6 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-IQ1_M.gguf) | i1-IQ1_M | 9.4 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 10.8 | |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-IQ2_XS.gguf) | i1-IQ2_XS | 11.9 | |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-IQ2_S.gguf) | i1-IQ2_S | 12.4 | |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-IQ2_M.gguf) | i1-IQ2_M | 13.5 | |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-Q2_K_S.gguf) | i1-Q2_K_S | 13.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-Q2_K.gguf) | i1-Q2_K | 14.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 15.5 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-IQ3_XS.gguf) | i1-IQ3_XS | 16.6 | |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-IQ3_S.gguf) | i1-IQ3_S | 17.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-Q3_K_S.gguf) | i1-Q3_K_S | 17.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-IQ3_M.gguf) | i1-IQ3_M | 17.9 | |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-Q3_K_M.gguf) | i1-Q3_K_M | 19.3 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-Q3_K_L.gguf) | i1-Q3_K_L | 20.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-IQ4_XS.gguf) | i1-IQ4_XS | 21.4 | |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-Q4_0.gguf) | i1-Q4_0 | 22.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-Q4_K_S.gguf) | i1-Q4_K_S | 22.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-Q4_K_M.gguf) | i1-Q4_K_M | 24.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-Q4_1.gguf) | i1-Q4_1 | 25.1 | |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-Q5_K_S.gguf) | i1-Q5_K_S | 27.5 | |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-Q5_K_M.gguf) | i1-Q5_K_M | 28.3 | |
| [GGUF](https://huggingface.co/mradermacher/IQuest-Coder-V1-40B-Base-i1-GGUF/resolve/main/IQuest-Coder-V1-40B-Base.i1-Q6_K.gguf) | i1-Q6_K | 32.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant