mradermacher/Morpheus-8B-v2-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Morpheus-8B-v2-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-21 04:56:16 +08:00
commit 5e19dcb539
27 changed files with 227 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Morpheus-8B-v2.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Morpheus-8B-v2.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:42a5466db816b66628ed440156db3b77e950ae38dfa3164ffa42f433ec48b04b
size 2165190368

3
Morpheus-8B-v2.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3310cc49a474d5c32fdbb0c861800dde27d011ea0d2c2462058549731e5b9200
size 2022846176

3
Morpheus-8B-v2.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e2cb6d353098a38f506c0a6bf061fb375f68f50d7c37591c7f81646bcf109407
size 2951818976

3
Morpheus-8B-v2.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d352dc1699920c6a1d2698558cb33c69f1db6f1004703a9b7ba3ca8612cda2f8
size 2762026720

3
Morpheus-8B-v2.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8134d121f6c43452d7ddc9a8fac5e8610453e4827fa895fca205298534f76a6b
size 2609000160

3
Morpheus-8B-v2.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5f60cef6b7eeaeb6a8223d8c38bc3ea7ea9879e8dbd262b4d482367ccdc8a735
size 2402430688

3
Morpheus-8B-v2.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:451212a3be22fb96e3e14138bb3016b9ce63e5cfb5a19a35b886b36e7e1d4b93
size 3788779232

3
Morpheus-8B-v2.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee17707a5e496e751193ffeacd063b92ba38e958b05c9c882ad86f2fc5d61282
size 3686280928

3
Morpheus-8B-v2.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:670fb5115fb141bb7c6422cfcc68fc80d098cb32997da41def67d6fc5250e127
size 3522703072

3
Morpheus-8B-v2.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d81268f011444c217cb9cc9353b0c309620fe951c97f8705eaa4197cc139d7fb
size 3278450400

3
Morpheus-8B-v2.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e34158097740a2e727b1779e27785edec07250ef1ca275d4a921f27b48080188
size 4682362592

3
Morpheus-8B-v2.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6c3dc5705ececab2c4cd1406dc09280e13e752e31e4e129ce992b5ed895ecad8
size 4451938016

3
Morpheus-8B-v2.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:68607ec260ef89d0f826899e1986fd7fec1af69c317909e9ba43f54a936596be
size 3182767840

3
Morpheus-8B-v2.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:98433291570b696adf186c96cf6a95564935d285903336c94e40f6c5900b45cd
size 2992451296

3
Morpheus-8B-v2.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:96e2897678565a6191e890d43aefc85fc33228a896cd39a362e55ba7ef05ab34
size 4325912288

3
Morpheus-8B-v2.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:160877eba3d3ce6c67be6a53825fe295127b27093e26587762850a3c7a57e399
size 4022873824

3
Morpheus-8B-v2.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ef3e1eb9036c671f6802f087c043dfbfe5bfd8dfaabff1d900f8a1d8831da31
size 3668455136

3
Morpheus-8B-v2.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d45536acc4bf2acc0b3312dc07b7957098c6a97d2a82f3aef192ffee26e654db
size 4680265440

3
Morpheus-8B-v2.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4ed49b7dec9e6935b32775f358cb46964e739b0ec7015aee8e4f2c0b81ef2703
size 5134823136

3
Morpheus-8B-v2.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3220679d0199970eeba3354325ad4a398a888a87c1e6981b38a4f921b9999193
size 4925107936

3
Morpheus-8B-v2.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f2c011fd199c440eed92ba1cbbdfa781fb39f2421698da2c7a14a9206e2696a4
size 4697042656

3
Morpheus-8B-v2.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6fe7f0a9ac9b302b1b8893151d15e7e17b7f4e3e0fdbecf5ac18465742a48541
size 5737754336

3
Morpheus-8B-v2.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b151118fd9c532d09f90a0c588c20a6cf1e73eb3bd8d450efb30d096d715f6a
size 5604060896

3
Morpheus-8B-v2.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:90658d5626589892c590117865e560241de38e5d9aa77382bec0b73d03869bf4
size 6601191136

3
Morpheus-8B-v2.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b055b28e612695d899b7afba0162a10580908d630541a3e2e4a9eb9a4af18a1
size 5015200

92
README.md Normal file
View File

@@ -0,0 +1,92 @@
---
base_model: OccultAI/Morpheus-8B-v2
datasets:
- OccultAI/Matrix_77
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- finetune
- llama
- occult
- uncensored
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/OccultAI/Morpheus-8B-v2
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Morpheus-8B-v2-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Morpheus-8B-v2-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-IQ1_M.gguf) | i1-IQ1_M | 2.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-IQ2_M.gguf) | i1-IQ2_M | 3.1 | |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-Q2_K.gguf) | i1-Q2_K | 3.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-IQ3_S.gguf) | i1-IQ3_S | 3.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-IQ3_M.gguf) | i1-IQ3_M | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.6 | |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-Q4_0.gguf) | i1-Q4_0 | 4.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-Q4_1.gguf) | i1-Q4_1 | 5.2 | |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Morpheus-8B-v2-i1-GGUF/resolve/main/Morpheus-8B-v2.i1-Q6_K.gguf) | i1-Q6_K | 6.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->