Compare commits

..

10 Commits

Author SHA1 Message Date
team mradermacher
df9f903779 auto-patch README.md 2025-07-31 03:16:25 +00:00
team mradermacher
e0dff8bf2f auto-patch README.md 2025-07-11 00:33:55 +00:00
team mradermacher
1b0424e32d auto-patch README.md 2025-07-10 04:48:40 +00:00
team mradermacher
df32f311a9 auto-patch README.md 2025-06-25 08:31:20 +00:00
team mradermacher
298e891e7d auto-patch README.md 2025-06-24 01:49:40 +00:00
team mradermacher
d2bb8a37af uploaded from nico1 2025-06-23 16:58:57 +00:00
team mradermacher
58fce36df0 uploaded from nico1 2025-06-23 16:58:08 +00:00
team mradermacher
548b260e72 uploaded from nico1 2025-06-23 16:54:18 +00:00
team mradermacher
935921a42f uploaded from nico1 2025-06-23 16:54:09 +00:00
team mradermacher
03de43c359 uploaded from nico1 2025-06-23 16:52:47 +00:00
7 changed files with 42 additions and 2 deletions

5
.gitattributes vendored
View File

@@ -39,3 +39,8 @@ Soar-qwen-32b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Soar-qwen-32b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Soar-qwen-32b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Soar-qwen-32b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Soar-qwen-32b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Soar-qwen-32b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Soar-qwen-32b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Soar-qwen-32b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Soar-qwen-32b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text

View File

@@ -1,10 +1,22 @@
---
base_model: julien31/Soar-qwen-32b
datasets:
- julien31/soar_arc_train_5M
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation
- code-generation
- program-synthesis
- evolutionary-algorithms
- arc
- arc-agi
- soar
---
## About
@@ -16,7 +28,10 @@ quantized_by: mradermacher
static quants of https://huggingface.co/julien31/Soar-qwen-32b
<!-- provided-files -->
weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Soar-qwen-32b-GGUF).***
weighted/imatrix quants are available at https://huggingface.co/mradermacher/Soar-qwen-32b-i1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
@@ -30,9 +45,14 @@ more details, including on how to concatenate multi-part files.
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q2_K.gguf) | Q2_K | 12.4 | |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q3_K_S.gguf) | Q3_K_S | 14.5 | |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q3_K_M.gguf) | Q3_K_M | 16.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q3_K_L.gguf) | Q3_K_L | 17.3 | |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.IQ4_XS.gguf) | IQ4_XS | 18.0 | |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q4_K_S.gguf) | Q4_K_S | 18.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q4_K_M.gguf) | Q4_K_M | 20.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q5_K_S.gguf) | Q5_K_S | 22.7 | |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q5_K_M.gguf) | Q5_K_M | 23.4 | |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q6_K.gguf) | Q6_K | 27.0 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q8_0.gguf) | Q8_0 | 34.9 | fast, best quality |
@@ -53,6 +73,6 @@ questions you might have and/or if you want some other model quantized.
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
this work in my free time.
<!-- end -->

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:97ba947d62e3daf45bde3b044f4c86375a35da06a26fe60c34492d1ad04b1f5b
size 17870101024

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eafe7cb228845f57120f703c47578dee179d019924a921186eef456b134b653d
size 17247078944

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dd2b529b6aa0eaefec3a85e2eae6c6241784a234bd94691f1b48eecf1a57fc99
size 14392330784

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e406cc1767152ec45c97914f3ed8ec85a3c68bca9821c9f899124850e5f9a57d
size 19851336224

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0bcb1c40b866dbebdae027eba3b216d359230c1cf0523d248d94155a5770469b
size 23262157344