mradermacher/messiah-7b-v1.0-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/messiah-7b-v1.0-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-12 21:22:17 +08:00
commit e914e3555e
18 changed files with 161 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

51
.gitattributes vendored Normal file
View File

@@ -0,0 +1,51 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
messiah-7b-v1.0.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
messiah-7b-v1.0.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
messiah-7b-v1.0.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
messiah-7b-v1.0.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
messiah-7b-v1.0.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
messiah-7b-v1.0.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
messiah-7b-v1.0.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
messiah-7b-v1.0.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
messiah-7b-v1.0.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
messiah-7b-v1.0.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
messiah-7b-v1.0.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
messiah-7b-v1.0.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
messiah-7b-v1.0.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
messiah-7b-v1.0.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
messiah-7b-v1.0.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
messiah-7b-v1.0.IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text

62
README.md Normal file
View File

@@ -0,0 +1,62 @@
---
base_model: meseca/messiah-7b-v1.0
language:
- en
library_name: transformers
quantized_by: mradermacher
---
## About
static quants of https://huggingface.co/meseca/messiah-7b-v1.0
<!-- provided-files -->
weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/messiah-7b-v1.0-GGUF/resolve/main/messiah-7b-v1.0.Q2_K.gguf) | Q2_K | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/messiah-7b-v1.0-GGUF/resolve/main/messiah-7b-v1.0.IQ3_XS.gguf) | IQ3_XS | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/messiah-7b-v1.0-GGUF/resolve/main/messiah-7b-v1.0.Q3_K_S.gguf) | Q3_K_S | 3.4 | |
| [GGUF](https://huggingface.co/mradermacher/messiah-7b-v1.0-GGUF/resolve/main/messiah-7b-v1.0.IQ3_S.gguf) | IQ3_S | 3.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/messiah-7b-v1.0-GGUF/resolve/main/messiah-7b-v1.0.IQ3_M.gguf) | IQ3_M | 3.5 | |
| [GGUF](https://huggingface.co/mradermacher/messiah-7b-v1.0-GGUF/resolve/main/messiah-7b-v1.0.Q3_K_M.gguf) | Q3_K_M | 3.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/messiah-7b-v1.0-GGUF/resolve/main/messiah-7b-v1.0.Q3_K_L.gguf) | Q3_K_L | 4.1 | |
| [GGUF](https://huggingface.co/mradermacher/messiah-7b-v1.0-GGUF/resolve/main/messiah-7b-v1.0.IQ4_XS.gguf) | IQ4_XS | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/messiah-7b-v1.0-GGUF/resolve/main/messiah-7b-v1.0.Q4_0.gguf) | Q4_0 | 4.4 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/messiah-7b-v1.0-GGUF/resolve/main/messiah-7b-v1.0.Q4_K_S.gguf) | Q4_K_S | 4.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/messiah-7b-v1.0-GGUF/resolve/main/messiah-7b-v1.0.IQ4_NL.gguf) | IQ4_NL | 4.4 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/messiah-7b-v1.0-GGUF/resolve/main/messiah-7b-v1.0.Q4_K_M.gguf) | Q4_K_M | 4.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/messiah-7b-v1.0-GGUF/resolve/main/messiah-7b-v1.0.Q5_K_S.gguf) | Q5_K_S | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/messiah-7b-v1.0-GGUF/resolve/main/messiah-7b-v1.0.Q5_K_M.gguf) | Q5_K_M | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/messiah-7b-v1.0-GGUF/resolve/main/messiah-7b-v1.0.Q6_K.gguf) | Q6_K | 6.2 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/messiah-7b-v1.0-GGUF/resolve/main/messiah-7b-v1.0.Q8_0.gguf) | Q8_0 | 7.9 | fast, best quality |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->

3
messiah-7b-v1.0.IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4b5a208f4f53558517a366248cfaf94a9b33be45cea4259830cf27c950653339
size 3439834976

3
messiah-7b-v1.0.IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:df5d65377eb6b105e7795369a9acfe2c15d9e42c7b1323d21889f287e3ffbc55
size 3337336672

3
messiah-7b-v1.0.IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d48835e318c88e9a5f41c8049a7afd6fc20a4270bb019cd6c622df735ca524c5
size 3173758816

3
messiah-7b-v1.0.IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c0796d62aae14e1c047c9de6c55de145df118349cae56420e7e8d456e59e80ad
size 4310014816

3
messiah-7b-v1.0.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2e792277bc4a407c552ff7046ef90259011c905b9e1c0c3654b3f5cf28aefc3d
size 4099345248

3
messiah-7b-v1.0.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:48dd3ff0d22be2878385a68569ca1ddaf1fb35556efa1b3533b62d3213252798
size 2874172256

3
messiah-7b-v1.0.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:60cdb7858aee707885fe57236b9f77ad80cade864057d2ccc2cec880fa5a9a57
size 3976968032

3
messiah-7b-v1.0.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1712c67efdfbcacebda8f33608aa9265b776ecf92308ac61e3a87bf9dbfea74f
size 3673929568

3
messiah-7b-v1.0.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3eed146a11f25e689babfa922182d6a1443c60f41fa100d8ea8be842cb6e73c2
size 3319510880

3
messiah-7b-v1.0.Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3a13987b429a4009d35cd72e8e6991fbdbf68adecc620c4530c38a70b3e8f5ba
size 4263877472

3
messiah-7b-v1.0.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3adeb68cae7b8be4efd6ed657a9dfdda4c248389bbd1a580e8c48b7cdd9499c6
size 4523400032

3
messiah-7b-v1.0.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be1b4c8c875515ca76a49adc416d9dc0cf90f62b2f72a7a1375fede35f727ffb
size 4295334752

3
messiah-7b-v1.0.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3cf921d6ab12f7c8a5e58f3c5e1a615d68c04239336b8acebe243bc9938271a8
size 5286386528

3
messiah-7b-v1.0.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fecf8d51237603e16ec8075b35b8ca2edcc7b4bad4410bf8e792e2f82e063b68
size 5152693088

3
messiah-7b-v1.0.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f9e6781f6b691186d5d9957f99a6eef245831ca10b2435641b9c6ecd91f43f14
size 6097059680

3
messiah-7b-v1.0.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a5c5a088935a760b7deb0a45df2289766dbb9ffab6d7c301f160cb8ff5a06b0c
size 7819139936