license, language, base_model, tags, inference
| license | language | base_model | tags | inference | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| unlicense |
|
|
|
false |
My GGUF-IQ-ARM-Imatrix quants for inflatebot/MN-12B-Mag-Mell-R1.
Mag Mell R1 was tested with Temp 1.25 and MinP 0.2. This was fairly stable up to 10K, but this might be too "hot". If issues with coherency occur, try increasing MinP or decreasing Temperature.
Note
Use the ChatML prompt format.
