mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-15 02:51:05 +08:00
commit eb842209f1
27 changed files with 215 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fdcb28f1b90ef83c6b4ba88f5407364d9e08da702c3a0fff65031aecdefbac0d
size 2161974304

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:36ddb2e21580980cec8fd715386bf5f9ad47ec6e7de4d571362af44d1c5435dd
size 2019630112

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f3dea51981e9ba7a0bb34ac3884b9f64011f858b2ce767815bc2fc6615d39a0d
size 2948283424

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:acee33dff49e5384830b9a1c8ed73c90694f0848702ff6385485120633d15a16
size 2758491168

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6416109603141edfcf340b048d0baf1a8772e5c2cb5117deaaf2870682263740
size 2605784096

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:986766200621ecb7ba2adfaa8c212d2ede011403fac0e9a0bef03b728b5e11dd
size 2399214624

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba9c935d3f3ccc6c126296fad9689fcbdb5e2802e9e31a9dcc14f06ce4b62f66
size 3784825888

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1f2926f5fd51fde2c3c6f2a6f0a9bc7702c9f508dcd1d61298f3f297d32f55e0
size 3682327584

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc93aca82c8e71abb1c50ed5d4cf6842d19427b68a52c016a21e31879b350b8b
size 3518749728

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7049d1b5e21f915bc65c82b3e0b38bcbd3337af71ebbf24040d3935254a6c514
size 3274914848

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:957725f5fdf60277835cb07ceec3ed60a418b7372b9d3acec41c1d0b3791fbec
size 4677991456

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2bff27951b72bc9ffaf14b40ac92de88c56e3ad764c58bfe2f4115158855f514
size 4447665184

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7c297e0fd155714124b170650dab230b6849c18c9dba1bd0c8f7f2d371a04904
size 3179133984

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:563887a09188a9e04cafcf4b3732e06a85bb39bab882b2f86cbffc6f31a15469
size 2988817440

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:291a418c91ada0d7fcc91186ba36cd52c8161d544fbc5864fff6a8d6f11eca09
size 4321958944

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4ef92e339509b2b04194ed630adaff3fd78d992eb126ba1b6367344ef6eadd9c
size 4018920480

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a2132b04b5fda08c5eb8d87065b1c1120836bc2502c75fc61a9422c3dc201304
size 3664501792

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3c5dfb15433a2b04847a344a05477f3d653ccf362f1d87c1095c213bc442cf46
size 4675894304

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:da0e5437efd82a8f03bbbca0dec2fcb2a84f0d8694f84f374d4048937924fb09
size 5130255392

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c7781f454117bccfde9a71bbbd61e27e88540c326fdb057a4d6fa4de2bff7b1a
size 4920736800

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb9cd02945a761e25bd23e58f7aa45854af9fbb7d9b37c37bd07c264f964e82c
size 4692671520

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:148eb0b5a52933f3747a655064aefda4058f91549e50f00ac7a8272855d63c2e
size 5732989984

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:84af721a5d85f4391904ce4a08ad23199217ecb91dc86ebe0e1781e0c044d41c
size 5599296544

3
Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9262182bad5925397ed737dc8dc9e28ada364effbcceb82165e1889f52409d33
size 6596008992

80
README.md Normal file
View File

@@ -0,0 +1,80 @@
---
base_model: ZeroXClem/Llama-3.1-8B-SuperNova-EtherealHermes
language:
- en
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
tags:
- merge
- mergekit
- lazymergekit
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/ZeroXClem/Llama-3.1-8B-SuperNova-EtherealHermes
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ1_M.gguf) | i1-IQ1_M | 2.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ2_M.gguf) | i1-IQ2_M | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q2_K.gguf) | i1-Q2_K | 3.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ3_S.gguf) | i1-IQ3_S | 3.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ3_M.gguf) | i1-IQ3_M | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q4_0.gguf) | i1-Q4_0 | 4.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q4_1.gguf) | i1-Q4_1 | 5.2 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-SuperNova-EtherealHermes-i1-GGUF/resolve/main/Llama-3.1-8B-SuperNova-EtherealHermes.i1-Q6_K.gguf) | i1-Q6_K | 6.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4285b16de847509614c76b64582296d5e599f548da2cebd7ecf57efac609cd08
size 4988157