mradermacher/Llama-3.1-Argunaut-1-8B-SPIN-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Llama-3.1-Argunaut-1-8B-SPIN-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-18 20:04:18 +08:00
commit 58422861b9
14 changed files with 160 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

47
.gitattributes vendored Normal file
View File

@@ -0,0 +1,47 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Llama-3.1-Argunaut-1-8B-SPIN.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-Argunaut-1-8B-SPIN.f16.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-Argunaut-1-8B-SPIN.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-Argunaut-1-8B-SPIN.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-Argunaut-1-8B-SPIN.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-Argunaut-1-8B-SPIN.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-Argunaut-1-8B-SPIN.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-Argunaut-1-8B-SPIN.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-Argunaut-1-8B-SPIN.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-Argunaut-1-8B-SPIN.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-Argunaut-1-8B-SPIN.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-Argunaut-1-8B-SPIN.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text

3
Llama-3.1-Argunaut-1-8B-SPIN.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5c5d9e791006559b155add8c13d086fc3a57f5fb2919c864565e81d86d92aa36
size 4484369088

3
Llama-3.1-Argunaut-1-8B-SPIN.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2cb53b7b01e39e6d5e7c1421b6e6c905cba781ce2b320b42622dd00e6db14955
size 3179137728

3
Llama-3.1-Argunaut-1-8B-SPIN.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0417a0dc02977d1b63e8fdd3b7ce1dde5672ab1f0120493d3b4c386be69878d4
size 4321962688

3
Llama-3.1-Argunaut-1-8B-SPIN.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:12c69b49a4e62c53031a2f0f330a62ec8ccdb221e83aa288ada34b38a37f68cd
size 4018924224

3
Llama-3.1-Argunaut-1-8B-SPIN.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2f2ca84f05f3d62fc6e24755255de5ad607e0a8218b6d54fe9a88fcd16de5d9e
size 3664505536

3
Llama-3.1-Argunaut-1-8B-SPIN.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bce17c5981fdb70fb018d94bb2a27d2bf1371708c8903e310d8349cca7228e4b
size 4920740544

3
Llama-3.1-Argunaut-1-8B-SPIN.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0dbb22168c5f8544adc5337579e156582691edff9d9c4715b4f250e91f7e59af
size 4692675264

3
Llama-3.1-Argunaut-1-8B-SPIN.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0461d6f85bce56989bdcd90273ce05a17d73d49f59984bd575df4d36e64a1a52
size 5732993728

3
Llama-3.1-Argunaut-1-8B-SPIN.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2b4369c6b0c8736a93e231bbb56b3399f53c719a3420105cd73695b53fc2ebea
size 5599300288

3
Llama-3.1-Argunaut-1-8B-SPIN.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b321e18c871db34bf1e1d2919875751201e81332b34aa81ec814ef3dfd70c420
size 6596012736

3
Llama-3.1-Argunaut-1-8B-SPIN.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3101a9bab18fd773145311c930aa38c3b1925dbf3f00312ac89043d0d94b822e
size 8540777152

3
Llama-3.1-Argunaut-1-8B-SPIN.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:23a69366666ec8e516a1d62d68e42c1f5a9efeea830d7fbd408f6b7763986518
size 16068897472

77
README.md Normal file
View File

@@ -0,0 +1,77 @@
---
base_model: DebateLabKIT/Llama-3.1-Argunaut-1-8B-SPIN
datasets:
- DebateLabKIT/argdown_line-by-line
- DebateLabKIT/argument_mapping_dpo_pairs
- allenai/llama-3.1-tulu-3-70b-preference-mixture
language:
- en
library_name: transformers
model_name: Llama-3.1-Argunaut-1-8B-SPIN
quantized_by: mradermacher
tags:
- logic
- argumentation
- critical-thinking
- argument-mapping
- generated_from_trainer
- trl
- dpo
- spin
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: -->
static quants of https://huggingface.co/DebateLabKIT/Llama-3.1-Argunaut-1-8B-SPIN
<!-- provided-files -->
weighted/imatrix quants are available at https://huggingface.co/mradermacher/Llama-3.1-Argunaut-1-8B-SPIN-i1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-Argunaut-1-8B-SPIN-GGUF/resolve/main/Llama-3.1-Argunaut-1-8B-SPIN.Q2_K.gguf) | Q2_K | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-Argunaut-1-8B-SPIN-GGUF/resolve/main/Llama-3.1-Argunaut-1-8B-SPIN.Q3_K_S.gguf) | Q3_K_S | 3.8 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-Argunaut-1-8B-SPIN-GGUF/resolve/main/Llama-3.1-Argunaut-1-8B-SPIN.Q3_K_M.gguf) | Q3_K_M | 4.1 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-Argunaut-1-8B-SPIN-GGUF/resolve/main/Llama-3.1-Argunaut-1-8B-SPIN.Q3_K_L.gguf) | Q3_K_L | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-Argunaut-1-8B-SPIN-GGUF/resolve/main/Llama-3.1-Argunaut-1-8B-SPIN.IQ4_XS.gguf) | IQ4_XS | 4.6 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-Argunaut-1-8B-SPIN-GGUF/resolve/main/Llama-3.1-Argunaut-1-8B-SPIN.Q4_K_S.gguf) | Q4_K_S | 4.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-Argunaut-1-8B-SPIN-GGUF/resolve/main/Llama-3.1-Argunaut-1-8B-SPIN.Q4_K_M.gguf) | Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-Argunaut-1-8B-SPIN-GGUF/resolve/main/Llama-3.1-Argunaut-1-8B-SPIN.Q5_K_S.gguf) | Q5_K_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-Argunaut-1-8B-SPIN-GGUF/resolve/main/Llama-3.1-Argunaut-1-8B-SPIN.Q5_K_M.gguf) | Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-Argunaut-1-8B-SPIN-GGUF/resolve/main/Llama-3.1-Argunaut-1-8B-SPIN.Q6_K.gguf) | Q6_K | 6.7 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-Argunaut-1-8B-SPIN-GGUF/resolve/main/Llama-3.1-Argunaut-1-8B-SPIN.Q8_0.gguf) | Q8_0 | 8.6 | fast, best quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-Argunaut-1-8B-SPIN-GGUF/resolve/main/Llama-3.1-Argunaut-1-8B-SPIN.f16.gguf) | f16 | 16.2 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->