mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Compare commits

base: mradermacher:36b662500b2692e943327773a615af9680f9801c
Branches Tags
mradermacher:main
...
compare: mradermacher:main
Branches Tags
mradermacher:main

10 Commits
36b662500b ... main

Author SHA1 Message Date
team mradermacher
9450a032c0 auto-patch README.md 2025-12-28 01:00:18 +00:00
team mradermacher
f64f4ea126 uploaded from rich1 2025-12-28 00:51:14 +00:00
team mradermacher
b30464e932 uploaded from rich1 2025-12-28 00:46:19 +00:00
team mradermacher
c90a707361 uploaded from rich1 2025-12-28 00:45:58 +00:00
team mradermacher
b0a35f8847 uploaded from rich1 2025-12-28 00:44:56 +00:00
team mradermacher
86d0935542 uploaded from rich1 2025-12-28 00:44:22 +00:00
team mradermacher
3d77cf1cd7 uploaded from rich1 2025-12-28 00:44:03 +00:00
team mradermacher
cad7b29eb8 uploaded from rich1 2025-12-28 00:40:34 +00:00
team mradermacher
1de693c95c uploaded from rich1 2025-12-28 00:36:23 +00:00
team mradermacher
4019a2fc35 uploaded from rich1 2025-12-28 00:36:09 +00:00
11 changed files with 45 additions and 0 deletions
Expand all files Collapse all files

9
.gitattributes vendored
View File

@@ -49,3 +49,12 @@ PsycheChat-Seeker-Qwen3-8B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
PsycheChat-Seeker-Qwen3-8B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
PsycheChat-Seeker-Qwen3-8B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
PsycheChat-Seeker-Qwen3-8B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
PsycheChat-Seeker-Qwen3-8B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
PsycheChat-Seeker-Qwen3-8B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
PsycheChat-Seeker-Qwen3-8B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
PsycheChat-Seeker-Qwen3-8B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
PsycheChat-Seeker-Qwen3-8B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
PsycheChat-Seeker-Qwen3-8B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
PsycheChat-Seeker-Qwen3-8B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
PsycheChat-Seeker-Qwen3-8B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
PsycheChat-Seeker-Qwen3-8B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text

3
PsycheChat-Seeker-Qwen3-8B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0debe96d9e0bb850975f24e0172f64eb4cd54bd29c1bad85d43851c65602bd58
size 2115769920

3
PsycheChat-Seeker-Qwen3-8B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:daadb7056db32f7cd3f1908f3764b9ffd472dc573b907fcba5c29d07aed30bd4
size 3896620608

3
PsycheChat-Seeker-Qwen3-8B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:74b3cba4e2372d317a2a052b5bd94fe0c6fda6e29a61300f6da285782f19d366
size 3789665856

3
PsycheChat-Seeker-Qwen3-8B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:31e7b3c80ba3aba8c0e68c9b030520d5fc6720ebc5c066ebdc7188e32a3f9dc6
size 3626874432

3
PsycheChat-Seeker-Qwen3-8B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2b90a805317e1d2398c7876750ba911f0786adda8ff72e12cb2a2fe690f1539f
size 3281733184

3
PsycheChat-Seeker-Qwen3-8B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:039be837f350a4509971f0511e43c04125062bffa42f59e636790c62af1e840e
size 4431394368

3
PsycheChat-Seeker-Qwen3-8B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:34315a2ccf4153d970c0d5b965cb22c5faf8f4107b54f6dc3ad6eb57541313b4
size 3769611840

3
PsycheChat-Seeker-Qwen3-8B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:017900a4e743651c5928381994b546c4baac68bdfe320fb2e18e037bd2ee6a44
size 5027784256

3
PsycheChat-Seeker-Qwen3-8B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b47abac3bf6349e432ae95c884568ab00f0f4da939834cccfd9c863193e09fae
size 5851113024

9
README.md
View File

@@ -37,20 +37,29 @@ more details, including on how to concatenate multi-part files.
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-IQ1_S.gguf) | i1-IQ1_S | 2.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-IQ1_M.gguf) | i1-IQ1_M | 2.4 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.6 | |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.8 | |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-IQ2_S.gguf) | i1-IQ2_S | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-IQ2_M.gguf) | i1-IQ2_M | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.2 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-Q2_K.gguf) | i1-Q2_K | 3.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.5 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.9 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-IQ3_S.gguf) | i1-IQ3_S | 3.9 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-IQ3_M.gguf) | i1-IQ3_M | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.7 | |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-Q4_0.gguf) | i1-Q4_0 | 4.9 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.9 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-Q4_1.gguf) | i1-Q4_1 | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.0 | |
| [GGUF](https://huggingface.co/mradermacher/PsycheChat-Seeker-Qwen3-8B-i1-GGUF/resolve/main/PsycheChat-Seeker-Qwen3-8B.i1-Q6_K.gguf) | i1-Q6_K | 6.8 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant