25 lines
587 B
Markdown
25 lines
587 B
Markdown
---
|
|
license: unlicense
|
|
language:
|
|
- en
|
|
base_model:
|
|
- inflatebot/MN-12B-Mag-Mell-R1
|
|
tags:
|
|
- roleplay
|
|
- rp
|
|
- sillytavern
|
|
- gguf
|
|
- mistral
|
|
- nemo
|
|
inference: false
|
|
---
|
|
|
|
My GGUF-IQ-ARM-Imatrix quants for [**inflatebot/MN-12B-Mag-Mell-R1**](https://huggingface.co/inflatebot/MN-12B-Mag-Mell-R1).
|
|
|
|
> Mag Mell R1 was tested with Temp 1.25 and MinP 0.2. This was fairly stable up to 10K, but this might be too "hot". If issues with coherency occur, try increasing MinP or decreasing Temperature.
|
|
|
|
> [!NOTE]
|
|
> Use the **ChatML** prompt format.
|
|
|
|
|