mradermacher/llama3.1-8b-spaetzle-v51-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/llama3.1-8b-spaetzle-v51-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-16 16:48:10 +08:00
commit 84b81ebf13
17 changed files with 166 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

50
.gitattributes vendored Normal file
View File

@@ -0,0 +1,50 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
llama3.1-8b-spaetzle-v51.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-8b-spaetzle-v51.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-8b-spaetzle-v51.f16.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-8b-spaetzle-v51.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-8b-spaetzle-v51.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-8b-spaetzle-v51.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-8b-spaetzle-v51.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-8b-spaetzle-v51.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-8b-spaetzle-v51.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-8b-spaetzle-v51.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-8b-spaetzle-v51.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-8b-spaetzle-v51.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-8b-spaetzle-v51.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-8b-spaetzle-v51.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-8b-spaetzle-v51.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text

71
README.md Normal file
View File

@@ -0,0 +1,71 @@
---
base_model: cstr/llama3.1-8b-spaetzle-v51
language:
- en
- de
library_name: transformers
license: llama3.1
quantized_by: mradermacher
tags:
- merge
- mergekit
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: -->
static quants of https://huggingface.co/cstr/llama3.1-8b-spaetzle-v51
<!-- provided-files -->
weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/llama3.1-8b-spaetzle-v51-GGUF/resolve/main/llama3.1-8b-spaetzle-v51.Q2_K.gguf) | Q2_K | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-8b-spaetzle-v51-GGUF/resolve/main/llama3.1-8b-spaetzle-v51.IQ3_XS.gguf) | IQ3_XS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-8b-spaetzle-v51-GGUF/resolve/main/llama3.1-8b-spaetzle-v51.Q3_K_S.gguf) | Q3_K_S | 3.8 | |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-8b-spaetzle-v51-GGUF/resolve/main/llama3.1-8b-spaetzle-v51.IQ3_S.gguf) | IQ3_S | 3.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-8b-spaetzle-v51-GGUF/resolve/main/llama3.1-8b-spaetzle-v51.IQ3_M.gguf) | IQ3_M | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-8b-spaetzle-v51-GGUF/resolve/main/llama3.1-8b-spaetzle-v51.Q3_K_M.gguf) | Q3_K_M | 4.1 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-8b-spaetzle-v51-GGUF/resolve/main/llama3.1-8b-spaetzle-v51.Q3_K_L.gguf) | Q3_K_L | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-8b-spaetzle-v51-GGUF/resolve/main/llama3.1-8b-spaetzle-v51.IQ4_XS.gguf) | IQ4_XS | 4.6 | |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-8b-spaetzle-v51-GGUF/resolve/main/llama3.1-8b-spaetzle-v51.Q4_K_S.gguf) | Q4_K_S | 4.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-8b-spaetzle-v51-GGUF/resolve/main/llama3.1-8b-spaetzle-v51.Q4_K_M.gguf) | Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-8b-spaetzle-v51-GGUF/resolve/main/llama3.1-8b-spaetzle-v51.Q5_K_S.gguf) | Q5_K_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-8b-spaetzle-v51-GGUF/resolve/main/llama3.1-8b-spaetzle-v51.Q5_K_M.gguf) | Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-8b-spaetzle-v51-GGUF/resolve/main/llama3.1-8b-spaetzle-v51.Q6_K.gguf) | Q6_K | 6.7 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-8b-spaetzle-v51-GGUF/resolve/main/llama3.1-8b-spaetzle-v51.Q8_0.gguf) | Q8_0 | 8.6 | fast, best quality |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-8b-spaetzle-v51-GGUF/resolve/main/llama3.1-8b-spaetzle-v51.f16.gguf) | f16 | 16.2 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->

3
llama3.1-8b-spaetzle-v51.IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c6781b2a0a55325eb3702098d15a761bfbef1079a3203598ef934a7050470c75
size 3784824064

3
llama3.1-8b-spaetzle-v51.IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8a64a22229fc0cecba51fec200a35662cd8f22e9b4101bd1195cb63af8ce6418
size 3682325760

3
llama3.1-8b-spaetzle-v51.IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:92113defdf8e4bbb2adc8cf76505cc252b330396fd7b347060b3bcbfc8667791
size 3518747904

3
llama3.1-8b-spaetzle-v51.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c8405b98de1e312baa2a9362eb75eb95f240ee15bf8c04c3cb48f0220a451757
size 4484363520

3
llama3.1-8b-spaetzle-v51.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b066c983485a1ea8247d2345e00e794b7ea8cc0b36a1ff48f21613e4855f5cb5
size 3179132160

3
llama3.1-8b-spaetzle-v51.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:36c8ccf1027274b49274799d21df336c151aef8e9a61041567cf805eb3538e46
size 4321957120

3
llama3.1-8b-spaetzle-v51.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4ae77ba9f52b0a8fb135cb6acba920c1e1e4e61c4389e1d679c2b8fa3f36d94
size 4018918656

3
llama3.1-8b-spaetzle-v51.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b14638d136b7eda5d3db1d0a16b79f5906b8255781e588d17a07c8e84f63aa54
size 3664499968

3
llama3.1-8b-spaetzle-v51.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b4cc03ebf24b835b9c3cde4355079ecd2712fed5c7a161e83454b96670b04f34
size 4920734976

3
llama3.1-8b-spaetzle-v51.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:02c1bf588a9d9790860dec09a25cac21da39eedfba33d955ada5beaf19493958
size 4692669696

3
llama3.1-8b-spaetzle-v51.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:46a029bab61fd5ee43af5cbe09bc5acbbd81ee30f4c8cdcb33bc4828a72d998c
size 5732988160

3
llama3.1-8b-spaetzle-v51.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:49132cd6113852685549c4aa7c712608cd456cb615681821452cfdd1ae6bc02a
size 5599294720

3
llama3.1-8b-spaetzle-v51.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9cf173fcdd1e05e407b4988a852260fcdd20407952780827b5e7cb0e95b32646
size 6596007168

3
llama3.1-8b-spaetzle-v51.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:64bdcf7f64cb20819578c0a82bcad901dc37ff3e3153bda5d6a69119be0f2776
size 8540771584

3
llama3.1-8b-spaetzle-v51.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8645ff0b575a57c4624e4b3032c1d42b13d385063aa7698b5f98aa274b185982
size 16068891904