MN-12B-Mag-Mell-R1-GGUF-IQ-ARM-Imatrix/README.md

license, language, base_model, tags, inference

license	language	base_model	tags	inference
unlicense	en	inflatebot/MN-12B-Mag-Mell-R1	roleplay rp sillytavern gguf mistral nemo	false

My GGUF-IQ-ARM-Imatrix quants for inflatebot/MN-12B-Mag-Mell-R1.

Mag Mell R1 was tested with Temp 1.25 and MinP 0.2. This was fairly stable up to 10K, but this might be too "hot". If issues with coherency occur, try increasing MinP or decreasing Temperature.

Note

Use the ChatML prompt format.