Compare commits

..

10 Commits

Author SHA1 Message Date
team mradermacher
df9f903779 auto-patch README.md 2025-07-31 03:16:25 +00:00
team mradermacher
e0dff8bf2f auto-patch README.md 2025-07-11 00:33:55 +00:00
team mradermacher
1b0424e32d auto-patch README.md 2025-07-10 04:48:40 +00:00
team mradermacher
df32f311a9 auto-patch README.md 2025-06-25 08:31:20 +00:00
team mradermacher
298e891e7d auto-patch README.md 2025-06-24 01:49:40 +00:00
team mradermacher
d2bb8a37af uploaded from nico1 2025-06-23 16:58:57 +00:00
team mradermacher
58fce36df0 uploaded from nico1 2025-06-23 16:58:08 +00:00
team mradermacher
548b260e72 uploaded from nico1 2025-06-23 16:54:18 +00:00
team mradermacher
935921a42f uploaded from nico1 2025-06-23 16:54:09 +00:00
team mradermacher
03de43c359 uploaded from nico1 2025-06-23 16:52:47 +00:00
7 changed files with 42 additions and 2 deletions

5
.gitattributes vendored
View File

@@ -39,3 +39,8 @@ Soar-qwen-32b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Soar-qwen-32b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text Soar-qwen-32b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Soar-qwen-32b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text Soar-qwen-32b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Soar-qwen-32b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text Soar-qwen-32b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Soar-qwen-32b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Soar-qwen-32b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Soar-qwen-32b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Soar-qwen-32b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Soar-qwen-32b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text

View File

@@ -1,10 +1,22 @@
--- ---
base_model: julien31/Soar-qwen-32b base_model: julien31/Soar-qwen-32b
datasets:
- julien31/soar_arc_train_5M
language: language:
- en - en
library_name: transformers library_name: transformers
license: apache-2.0 license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher quantized_by: mradermacher
tags:
- text-generation
- code-generation
- program-synthesis
- evolutionary-algorithms
- arc
- arc-agi
- soar
--- ---
## About ## About
@@ -16,7 +28,10 @@ quantized_by: mradermacher
static quants of https://huggingface.co/julien31/Soar-qwen-32b static quants of https://huggingface.co/julien31/Soar-qwen-32b
<!-- provided-files --> <!-- provided-files -->
weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Soar-qwen-32b-GGUF).***
weighted/imatrix quants are available at https://huggingface.co/mradermacher/Soar-qwen-32b-i1-GGUF
## Usage ## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's If you are unsure how to use GGUF files, refer to one of [TheBloke's
@@ -30,9 +45,14 @@ more details, including on how to concatenate multi-part files.
| Link | Type | Size/GB | Notes | | Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------| |:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q2_K.gguf) | Q2_K | 12.4 | | | [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q2_K.gguf) | Q2_K | 12.4 | |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q3_K_S.gguf) | Q3_K_S | 14.5 | |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q3_K_M.gguf) | Q3_K_M | 16.0 | lower quality | | [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q3_K_M.gguf) | Q3_K_M | 16.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q3_K_L.gguf) | Q3_K_L | 17.3 | |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.IQ4_XS.gguf) | IQ4_XS | 18.0 | |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q4_K_S.gguf) | Q4_K_S | 18.9 | fast, recommended | | [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q4_K_S.gguf) | Q4_K_S | 18.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q4_K_M.gguf) | Q4_K_M | 20.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q5_K_S.gguf) | Q5_K_S | 22.7 | | | [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q5_K_S.gguf) | Q5_K_S | 22.7 | |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q5_K_M.gguf) | Q5_K_M | 23.4 | |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q6_K.gguf) | Q6_K | 27.0 | very good quality | | [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q6_K.gguf) | Q6_K | 27.0 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q8_0.gguf) | Q8_0 | 34.9 | fast, best quality | | [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q8_0.gguf) | Q8_0 | 34.9 | fast, best quality |
@@ -53,6 +73,6 @@ questions you might have and/or if you want some other model quantized.
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. this work in my free time.
<!-- end --> <!-- end -->

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:97ba947d62e3daf45bde3b044f4c86375a35da06a26fe60c34492d1ad04b1f5b
size 17870101024

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eafe7cb228845f57120f703c47578dee179d019924a921186eef456b134b653d
size 17247078944

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dd2b529b6aa0eaefec3a85e2eae6c6241784a234bd94691f1b48eecf1a57fc99
size 14392330784

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e406cc1767152ec45c97914f3ed8ec85a3c68bca9821c9f899124850e5f9a57d
size 19851336224

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0bcb1c40b866dbebdae027eba3b216d359230c1cf0523d248d94155a5770469b
size 23262157344