Lewdiculous/MN-12B-Mag-Mell-R1-GGUF-IQ-ARM-Imatrix
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: Lewdiculous/MN-12B-Mag-Mell-R1-GGUF-IQ-ARM-Imatrix
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-30 08:42:16 +08:00
commit 6c6f2aaf78
20 changed files with 2928 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

52
.gitattributes vendored Normal file
View File

@@ -0,0 +1,52 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
MN-12B-Mag-Mell-R1-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
MN-12B-Mag-Mell-R1-Q8_0-imat.gguf filter=lfs diff=lfs merge=lfs -text
ARM-MN-12B-Mag-Mell-R1-Q4_0_4_8-imat.gguf filter=lfs diff=lfs merge=lfs -text
MN-12B-Mag-Mell-R1-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
MN-12B-Mag-Mell-R1-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
MN-12B-Mag-Mell-R1-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
MN-12B-Mag-Mell-R1-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
MN-12B-Mag-Mell-R1-IQ3_XXS-imat.gguf filter=lfs diff=lfs merge=lfs -text
MN-12B-Mag-Mell-R1-Q3_K_L-imat.gguf filter=lfs diff=lfs merge=lfs -text
MN-12B-Mag-Mell-R1-Q3_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
MN-12B-Mag-Mell-R1-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
MN-12B-Mag-Mell-R1-BF16.gguf filter=lfs diff=lfs merge=lfs -text
MN-12B-Mag-Mell-R1-F16.gguf filter=lfs diff=lfs merge=lfs -text
MN-12B-Mag-Mell-R1-IQ3_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
MN-12B-Mag-Mell-R1-IQ3_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
MN-12B-Mag-Mell-R1-IQ3_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text

3
ARM-MN-12B-Mag-Mell-R1-Q4_0_4_8-imat.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6dc79de0b0245c505da3916ba72d2a81754eea76c0ed7bc4f8c8497df1f6a2be
size 7071701984

3
MN-12B-Mag-Mell-R1-BF16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0af85ad6c9949a32424cb86d65a7a4a807d3ca3abc7b35f0e5317493f481ca40
size 24504277696

3
MN-12B-Mag-Mell-R1-F16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc51da13db43df608f77cea192918926b5352c2b0dfe1808fc6b8b7e90a10ca9
size 24504277696

3
MN-12B-Mag-Mell-R1-IQ3_M-imat.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:634baf08dc17809a9377a9d6929e17e5093ee33d297933636a37f17b84512eb6
size 5722233824

3
MN-12B-Mag-Mell-R1-IQ3_S-imat.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:78fdfafe413bb9695649afc11e9999e570b24fa54e0a256903e7ad6948479e82
size 5562080224

3
MN-12B-Mag-Mell-R1-IQ3_XS-imat.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:68392fe27f55a8f0206064c1b80cc7fb01d60e49669eb7d86799a654f1001629
size 5306489824

3
MN-12B-Mag-Mell-R1-IQ3_XXS-imat.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f83cd13aec84e5a601a5eff6d557c10f21b9c3cf62fe904bb565f133050ca12c
size 4945386464

3
MN-12B-Mag-Mell-R1-IQ4_XS-imat.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:55671e66e1a0123ca6421f0d5df73f18086a68303c0970618f943f30d70ff015
size 6742711264

3
MN-12B-Mag-Mell-R1-Q3_K_L-imat.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2377daafe01c898ad3ad4ecd5c5ecffc18e899f478d2c76fc0ab70f4352084e3
size 6561504224

3
MN-12B-Mag-Mell-R1-Q3_K_M-imat.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa403b8a464282015095c0446e5df0492b590ffc25882d38b136ae24b93ff1c5
size 6083091424

3
MN-12B-Mag-Mell-R1-Q4_K_M-imat.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba0c9e64222b35f8c3828b7295e173ee54d83fd2e457ba67f6561a4a6d98481e
size 7477205984

3
MN-12B-Mag-Mell-R1-Q4_K_S-imat.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bc204902bc514140a653841b9530d4af96684f2c0b6170053fd8acf035881438
size 7120198624

3
MN-12B-Mag-Mell-R1-Q5_K_M-imat.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6b7452cb585fe7cb702f7416e2ddd1ce9838aacae0e2d4ff8893264351c1b7d6
size 8727632864

3
MN-12B-Mag-Mell-R1-Q5_K_S-imat.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0aba3313039a09b833cfb21f3cd1e0e803227da7aad91e0882f7edbd6fb7185b
size 8518736864

3
MN-12B-Mag-Mell-R1-Q6_K-imat.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4ead68359dcc64c5ff52885972800ac2a2bf355b037d58c3b02421fd2f03d63a
size 10056211424

3
MN-12B-Mag-Mell-R1-Q8_0-imat.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:91a34876146d53d20673f46421b446536cd4ce0555e01beb2dab9206e95c91ad
size 13022370784

24
README.md Normal file
View File

@@ -0,0 +1,24 @@
---
license: unlicense
language:
- en
base_model:
- inflatebot/MN-12B-Mag-Mell-R1
tags:
- roleplay
- rp
- sillytavern
- gguf
- mistral
- nemo
inference: false
---
My GGUF-IQ-ARM-Imatrix quants for [**inflatebot/MN-12B-Mag-Mell-R1**](https://huggingface.co/inflatebot/MN-12B-Mag-Mell-R1).
> Mag Mell R1 was tested with Temp 1.25 and MinP 0.2. This was fairly stable up to 10K, but this might be too "hot". If issues with coherency occur, try increasing MinP or decreasing Temperature.
> [!NOTE]
> Use the **ChatML** prompt format.
![model-card-image](https://i.imgur.com/wjyAaTO.png)

2801
imatrix-with-rp-v3.txt Normal file
View File

File diff suppressed because one or more lines are too long

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:86090267d92d01adcb96f27152b6ce47310a68f0388cca76539a35efb81e2451
size 7054419