Compare commits
10 Commits
add789e033
...
df9f903779
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
df9f903779 | ||
|
|
e0dff8bf2f | ||
|
|
1b0424e32d | ||
|
|
df32f311a9 | ||
|
|
298e891e7d | ||
|
|
d2bb8a37af | ||
|
|
58fce36df0 | ||
|
|
548b260e72 | ||
|
|
935921a42f | ||
|
|
03de43c359 |
5
.gitattributes
vendored
5
.gitattributes
vendored
@@ -39,3 +39,8 @@ Soar-qwen-32b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Soar-qwen-32b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Soar-qwen-32b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Soar-qwen-32b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Soar-qwen-32b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Soar-qwen-32b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Soar-qwen-32b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Soar-qwen-32b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Soar-qwen-32b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
|
||||
24
README.md
24
README.md
@@ -1,10 +1,22 @@
|
||||
---
|
||||
base_model: julien31/Soar-qwen-32b
|
||||
datasets:
|
||||
- julien31/soar_arc_train_5M
|
||||
language:
|
||||
- en
|
||||
library_name: transformers
|
||||
license: apache-2.0
|
||||
mradermacher:
|
||||
readme_rev: 1
|
||||
quantized_by: mradermacher
|
||||
tags:
|
||||
- text-generation
|
||||
- code-generation
|
||||
- program-synthesis
|
||||
- evolutionary-algorithms
|
||||
- arc
|
||||
- arc-agi
|
||||
- soar
|
||||
---
|
||||
## About
|
||||
|
||||
@@ -16,7 +28,10 @@ quantized_by: mradermacher
|
||||
static quants of https://huggingface.co/julien31/Soar-qwen-32b
|
||||
|
||||
<!-- provided-files -->
|
||||
weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
|
||||
|
||||
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Soar-qwen-32b-GGUF).***
|
||||
|
||||
weighted/imatrix quants are available at https://huggingface.co/mradermacher/Soar-qwen-32b-i1-GGUF
|
||||
## Usage
|
||||
|
||||
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||
@@ -30,9 +45,14 @@ more details, including on how to concatenate multi-part files.
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q2_K.gguf) | Q2_K | 12.4 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q3_K_S.gguf) | Q3_K_S | 14.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q3_K_M.gguf) | Q3_K_M | 16.0 | lower quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q3_K_L.gguf) | Q3_K_L | 17.3 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.IQ4_XS.gguf) | IQ4_XS | 18.0 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q4_K_S.gguf) | Q4_K_S | 18.9 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q4_K_M.gguf) | Q4_K_M | 20.0 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q5_K_S.gguf) | Q5_K_S | 22.7 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q5_K_M.gguf) | Q5_K_M | 23.4 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q6_K.gguf) | Q6_K | 27.0 | very good quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Soar-qwen-32b-GGUF/resolve/main/Soar-qwen-32b.Q8_0.gguf) | Q8_0 | 34.9 | fast, best quality |
|
||||
|
||||
@@ -53,6 +73,6 @@ questions you might have and/or if you want some other model quantized.
|
||||
|
||||
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||
me use its servers and providing upgrades to my workstation to enable
|
||||
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||
this work in my free time.
|
||||
|
||||
<!-- end -->
|
||||
|
||||
3
Soar-qwen-32b.IQ4_XS.gguf
Normal file
3
Soar-qwen-32b.IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:97ba947d62e3daf45bde3b044f4c86375a35da06a26fe60c34492d1ad04b1f5b
|
||||
size 17870101024
|
||||
3
Soar-qwen-32b.Q3_K_L.gguf
Normal file
3
Soar-qwen-32b.Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:eafe7cb228845f57120f703c47578dee179d019924a921186eef456b134b653d
|
||||
size 17247078944
|
||||
3
Soar-qwen-32b.Q3_K_S.gguf
Normal file
3
Soar-qwen-32b.Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:dd2b529b6aa0eaefec3a85e2eae6c6241784a234bd94691f1b48eecf1a57fc99
|
||||
size 14392330784
|
||||
3
Soar-qwen-32b.Q4_K_M.gguf
Normal file
3
Soar-qwen-32b.Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e406cc1767152ec45c97914f3ed8ec85a3c68bca9821c9f899124850e5f9a57d
|
||||
size 19851336224
|
||||
3
Soar-qwen-32b.Q5_K_M.gguf
Normal file
3
Soar-qwen-32b.Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0bcb1c40b866dbebdae027eba3b216d359230c1cf0523d248d94155a5770469b
|
||||
size 23262157344
|
||||
Reference in New Issue
Block a user