mradermacher/Delphermes-8B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Delphermes-8B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-08 18:01:18 +08:00
commit 129ee911ce
27 changed files with 226 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Delphermes-8B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Delphermes-8B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3e60f2d4131ecee6d74820be66fecb683f304e0b1d0210a93157d1ff8dc51fb6
size 2256148864

3
Delphermes-8B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:74c65c7fe371152248ff32c4c667b4b71c8ede35f7e7e90e71d37b04967b600c
size 2115770752

3
Delphermes-8B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc9aadd671ed9f34ce66f4380b2a600d849b4314cfefed88a8c891a5dff2f795
size 3051915648

3
Delphermes-8B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:edbc86151a47a44903187a8564333278465555288bb30ffe691835acd214ad53
size 2864744832

3
Delphermes-8B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5d4d870c11a3e2104642cca949ecf9af11f912253f52d563f4304be27b6bae88
size 2696157568

3
Delphermes-8B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aca520a6b61516e1f9aac9e5adef52ba7c5952c8811d279b95e95782b83e1899
size 2490112384

3
Delphermes-8B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dc6a8f34171acda69d060772c6f66f4f66936909eb334a0532335b77d4e907c9
size 3896621440

3
Delphermes-8B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e363b858f2c5606fcecc677ec7579e9569cc2d013766d7ce6f1f38b265b17e84
size 3789666688

3
Delphermes-8B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9db88519ede5062634cc292e408dce4e2b7675f84a901d77d0f3f706c2aacbee
size 3626875264

3
Delphermes-8B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dc83dcaa2f2842c4930dc64a2e49f15765b9a153a6ce048c66e6899aae03e05d
size 3369634176

3
Delphermes-8B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9fbf6ca20cae91708b65697ee3525cc12bcb51727cd63c03001d34c4fff0d60f
size 4793624960

3
Delphermes-8B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7858856757abaa1c453247f2c211874b261aeb690e4e3267739d66b68925db93
size 4561840512

3
Delphermes-8B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f3f408e07190a8d42c0ad97f50b32bd7fdc765eb8c2eb778aa9d0a0bfda44683
size 3281734016

3
Delphermes-8B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:266355f9c16b94b2013e58f3551f959424556dfb2a15f9bc47230217a7ce895e
size 3083553152

3
Delphermes-8B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa303ba6ccddb3faaa87615bfd5b2b3d5f6e6cb067045c323e2a169d1802ad56
size 4431395200

3
Delphermes-8B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:41640dcbc94cb0fc4a71d3e6672d6dfb4322acaaabaeb4b24c9f8245fc36fcf1
size 4124162432

3
Delphermes-8B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:96069e2ef00e9e09e50bc2b8419b3fe6454cfb3623a70e70171227e1b73a0e2a
size 3769612672

3
Delphermes-8B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:318e4c78db1b860e8cb3ea5256e0b486c9a5752a23796affca51574d67b77f91
size 4787333504

3
Delphermes-8B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5940b6dc3c16a5b7768fd42d66fc71f50f8d5bdd2ef8b6e59871c437813ddef3
size 5247756672

3
Delphermes-8B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2fa9d79b74018b178a1298e84d832b5b7ffb634b9c13da47e017279c244c00a1
size 5027785088

3
Delphermes-8B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f580c13c4a41180f8cca5a3ab18f10a467e79d25ff70405104af9a2acdc45734
size 4802013568

3
Delphermes-8B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1ac5ee9c6a948ac59ea2bf985f86bf57178069e497401c3dcfd4ad375e3e7741
size 5851113856

3
Delphermes-8B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cccefc88dead9518c895d0ac61418a32743ee0df8ba9dc0971c7ab0d37bc304d
size 5720762752

3
Delphermes-8B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:676d18f9664741aa24eac3019d38bd3b8d0a8b02b0ef3d5d00fdbd48ddbdd79d
size 6725900672

3
Delphermes-8B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc0c05c4f11e6569e4a80023f7df0adcf258d13ee4c1df87dd527c1f6a9631c6
size 5347200

91
README.md Normal file
View File

@@ -0,0 +1,91 @@
---
base_model: justinj92/Delphermes-8B
datasets:
- NousResearch/Hermes-3-Dataset
- QuixiAI/dolphin
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- axolotl
- reasoning
- math
- commonsense
- primeintellect
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/justinj92/Delphermes-8B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Delphermes-8B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Delphermes-8B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-IQ1_S.gguf) | i1-IQ1_S | 2.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-IQ1_M.gguf) | i1-IQ1_M | 2.4 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.6 | |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.8 | |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-IQ2_S.gguf) | i1-IQ2_S | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-IQ2_M.gguf) | i1-IQ2_M | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.2 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-Q2_K.gguf) | i1-Q2_K | 3.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.5 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.9 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-IQ3_S.gguf) | i1-IQ3_S | 3.9 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-IQ3_M.gguf) | i1-IQ3_M | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.7 | |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-Q4_0.gguf) | i1-Q4_0 | 4.9 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.9 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-Q4_1.gguf) | i1-Q4_1 | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.0 | |
| [GGUF](https://huggingface.co/mradermacher/Delphermes-8B-i1-GGUF/resolve/main/Delphermes-8B.i1-Q6_K.gguf) | i1-Q6_K | 6.8 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->