mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-19 02:57:54 +08:00
commit 6afe2e923f
24 changed files with 202 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

57
.gitattributes vendored Normal file
View File

@@ -0,0 +1,57 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2328d4c1b6c81bde363613ae0a7f78c19513b9d982d71339e26ab2b17b48d4d8
size 2161985792

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ea50be2f1a37e0879bc56c1ba6a8939859ba3f4ed27d250074e97a398abecdd8
size 2019641600

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ec5bbc957c632f037204fa28cea18921dc9bbff9f94f608e9b87bdd18a378fae
size 2948296160

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bd034cd7948c8eacb54167a04dafd78b86adeea6b558350f85c6a3d235a9cda3
size 2758503904

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d310d5bc7bbfdfa31c212e6a425f5b5c783963b6a27db284ffec0e7145088a30
size 2605795584

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e1f6ab43a0dfc7fab3f2a04b3551aacb06f7547864ae7c42e000342961d05000
size 2399226112

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0c77247012e87e10278a61a7d508a821051462a9921098d4eac26cf9178bdee9
size 3784840256

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:efab3725434789b9fe431582ab309cd5f98155d9c9f2336d12bb61a447bd6506
size 3682341952

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:68206670bbb1d2f03ce9d0bcf2c0e881fc7761fb930f8eeb753bfa55a9ef0adc
size 3518764096

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d9091569e7108c2c66f60604e5d626d8bb7c8569496131bbfbe9432ffccb972
size 3274927584

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c2c1887ebaf4516d2cf02a2b62884f8aa8e9400aa04b8d2341cd916fabb03b1a
size 4447680800

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d2fb228800758214461fe8ec7475b540d6e1c39ff1b9d3cc535cea7bddb34d20
size 3179147104

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b5401c960e1d3f3b36d983a9aee77c5515bb251c8214b74bffd3a9f6f4a8bba5
size 4321973312

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba5030d2ba5eb3e7aab05710d0e0dc87f48b5882f19a5c6ae6ef51f4cd402394
size 4018934848

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c29c4e5c9c25ba79df729c8d609e3a805e730901a3aed684df809e9e2c20dfad
size 3664516160

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9ed268494ff7f2ea4d238273f0efd698d6bd52210671cf6a1bb00b537643925e
size 4675910304

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2ed96b63b2d96f411840783ac7ebd8d79711d0b4b46297596b29eeb8307f3b62
size 4920752800

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:acba5bf6c747bdf53fa0337ab8e20dc531e6ceaa3ee8614d811fbc76aa081abf
size 4692687520

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3cbb1655f759153b7265df76ae317f149e91ac6aeac8fcaaa3b7537ae93023af
size 5733007520

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d659c7ad8fa8bf07fcfe4eac79aba4c468bf91f0221a39663aaac3b48e9b9f07
size 5599314080

3
Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ebc0ecd6dcd6aedc4862749ebc1a2cabc00927d692aa5a61d23701e22ecb4d6f
size 6596028160

79
README.md Normal file
View File

@@ -0,0 +1,79 @@
---
base_model: Magpie-Align/Llama-3.1-8B-Magpie-Align-SFT-v0.1
datasets:
- Magpie-Align/Magpie-Reasoning-150K
- Magpie-Align/Magpie-Pro-MT-300K-v0.1
language:
- en
library_name: transformers
license: llama3.1
quantized_by: mradermacher
tags:
- axolotl
- generated_from_trainer
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Magpie-Align/Llama-3.1-8B-Magpie-Align-SFT-v0.1
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ1_M.gguf) | i1-IQ1_M | 2.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ2_M.gguf) | i1-IQ2_M | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q2_K.gguf) | i1-Q2_K | 3.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ3_S.gguf) | i1-IQ3_S | 3.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ3_M.gguf) | i1-IQ3_M | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q4_0.gguf) | i1-Q4_0 | 4.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF/resolve/main/Llama-3.1-8B-Magpie-Align-SFT-v0.1.i1-Q6_K.gguf) | i1-Q6_K | 6.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ea61f07fb4753b16fdfb46832287009976321a793d8bbe1730bcecdf30274c2b
size 4988157