mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-18 05:03:10 +08:00
commit 0ea99e8d61
26 changed files with 223 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
L3.1-Pneuma-Allades-8B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
L3.1-Pneuma-Allades-8B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dc2aafe1afaa75b44514b2fa1b5735cadc05e6b3fbb9dcca5dd6aa94f7981b26
size 2161973664

3
L3.1-Pneuma-Allades-8B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e26339cf944e183e32b8d22c340687af2732571b692e4816ebc88cf6b3228868
size 2019629472

3
L3.1-Pneuma-Allades-8B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3013be70e6f5f5f88db66502ed6dce32763eef50cb71b4528d175367d7e052de
size 2948282784

3
L3.1-Pneuma-Allades-8B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d6845521acbad464ea8d1fda763adfabd385444975c576c4bca0faf56c94b2c2
size 2758490528

3
L3.1-Pneuma-Allades-8B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f61dbc6fd6fad75eb9f9208c2650ef2f87c0146c234f5f9c0cdf85ae0af6f42f
size 2605783456

3
L3.1-Pneuma-Allades-8B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3447086c5ffce7833ebcbe8b61f424bdc4048f1a8369b5eedee0101d53cefbf1
size 2399213984

3
L3.1-Pneuma-Allades-8B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:36e47406f64696c7f3915fdbd687a10af1c8f410c643f5c02db6ca0003d6a5e9
size 3784825248

3
L3.1-Pneuma-Allades-8B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9546cd7639478d5fda378ab0ccf92871146624fb9b9ac67640b73d1b6db4f110
size 3682326944

3
L3.1-Pneuma-Allades-8B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:911cffd5f836c408fceb25cfe2f34db9057e7c518c5a7299a82c9fd8e2c91bf2
size 3518749088

3
L3.1-Pneuma-Allades-8B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:11bbfaa158c179cb155cfe0b6f50e3c39334d3b6720881ba43c60aab019c7ec7
size 3274914208

3
L3.1-Pneuma-Allades-8B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:33cd9f195933c891f95e39a69ff23c7f9f892c55d0d80fe0718e011b06bef291
size 4677990816

3
L3.1-Pneuma-Allades-8B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7139c30fd89d69e0bd82a312986b599e6f1c585c941935928412d381cd686eaa
size 4447664544

3
L3.1-Pneuma-Allades-8B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d7fe1ccabb313e3a7197b95b8568b5cfb3f57daa71c431d58a7a220ac198621
size 3179133344

3
L3.1-Pneuma-Allades-8B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c1afd0a92926de16a06a36a6cde7dbfc7f4a022bee8873d72decab0fc820ef2f
size 2988816800

3
L3.1-Pneuma-Allades-8B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2a0619f32c8a6f0b2bbef951a0c8cf1f05a7655af6f87576b6b087d5c076cc7f
size 4321958304

3
L3.1-Pneuma-Allades-8B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ed1b1e342d25509550d08326a5354be4bba558ba8ce014f15a70bc1ff3188f9f
size 4018919840

3
L3.1-Pneuma-Allades-8B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e528d8198619d2cdc93905fd6ab0f38df302b6731c9097d26a84f93d5a3e0ac5
size 3664501152

3
L3.1-Pneuma-Allades-8B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0e1751276bff68b713c9c0af103fcdbcfd8424b27436b197c33a4ce9862784dc
size 4675893664

3
L3.1-Pneuma-Allades-8B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6bce727a32d2bdf7f0d3ec8593b9ef83a38a0151e1bd17f4c443f0aca4c799f2
size 5130254752

3
L3.1-Pneuma-Allades-8B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ce63ba7631ef7f96aedd5c70406c5a420427649fbe482df4e0eb983388856a7
size 4920736160

3
L3.1-Pneuma-Allades-8B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e7f126f1010b384318a36e92d1693b5956036c638f77d41889f4c497aaafe7a6
size 4692670880

3
L3.1-Pneuma-Allades-8B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:04a870e8d5f5979cf659baa7aac61b9f725b17f8aa8517a544d2ec59d3a12b88
size 5732989344

3
L3.1-Pneuma-Allades-8B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1b1ae017c061ec085226aef5dae1fa8df5158505c98d75c5870aba7a273bd72f
size 5599295904

3
L3.1-Pneuma-Allades-8B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8dfdb6bdb26b5b80e8dedfd8c9d0d6c40a0e50bd99c050094ac2298c748e6e80
size 6596008352

92
README.md Normal file
View File

@@ -0,0 +1,92 @@
---
base_model: ZeroXClem/L3.1-Pneuma-Allades-8B
language:
- en
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
tags:
- merge
- model_stock
- Llama3
- Pneuma
- Allades
- storytelling
- roleplaying
- instruction-following
- creative-writing
- reasoning
- long-form-generation
- text-generation
- lazymergekit
- nbeerbower/Llama3.1-Allades-8B
- mergekit-community/L3.1-Pneuma-8B-v1
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/ZeroXClem/L3.1-Pneuma-Allades-8B
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-IQ1_M.gguf) | i1-IQ1_M | 2.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-IQ2_M.gguf) | i1-IQ2_M | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-Q2_K.gguf) | i1-Q2_K | 3.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-IQ3_S.gguf) | i1-IQ3_S | 3.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-IQ3_M.gguf) | i1-IQ3_M | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-Q4_0.gguf) | i1-Q4_0 | 4.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-Q4_1.gguf) | i1-Q4_1 | 5.2 | |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/L3.1-Pneuma-Allades-8B-i1-GGUF/resolve/main/L3.1-Pneuma-Allades-8B.i1-Q6_K.gguf) | i1-Q6_K | 6.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->