43 lines
1.5 KiB
Markdown
43 lines
1.5 KiB
Markdown
---
|
||
base_model: Epiculous/Violet_Twilight-v0.2
|
||
license: apache-2.0
|
||
inference: false
|
||
tags:
|
||
- mistral
|
||
- nemo
|
||
- roleplay
|
||
- sillytavern
|
||
- gguf
|
||
---
|
||
|
||
**Model name:** <br>
|
||
Violet_Twilight-v0.2
|
||
|
||
**Description:** <br>
|
||
"Now for something a bit different, Violet_Twilight-v0.2! This model is a SLERP merge of Azure_Dusk-v0.2 and Crimson_Dawn-v0.2!" <br>
|
||
– by Author. <br>
|
||
|
||
Use the **ChatML** prompt format. <br>
|
||
|
||
> [!IMPORTANT]
|
||
> **[Added]** <br>
|
||
> ARM quants: <br>
|
||
> `"Q4_0_4_4", "Q4_0_4_8", "Q4_0_8_8"`
|
||
|
||
> [!TIP]
|
||
> **Presets:** <br>
|
||
> You can use ChatML presets within SillyTavern and adjust from there. <br>
|
||
> Alternatively, check out [Virt-io's ChatML v1.9 presets here](https://huggingface.co/Virt-io/SillyTavern-Presets/tree/main/Prompts/ChatML/v1.9), make sure you read the [repository page for how to use them properly](https://huggingface.co/Virt-io/SillyTavern-Presets/). <br>
|
||
> The author also provides links to custom sampler presets [in the model page here](https://huggingface.co/Epiculous/Violet_Twilight-v0.2#current-top-sampler-settings).
|
||
|
||
> [!NOTE]
|
||
> Original model page: <br>
|
||
> https://huggingface.co/Epiculous/Violet_Twilight-v0.2
|
||
>
|
||
> Quantized using [llama.cpp](https://github.com/ggerganov/llama.cpp)-[b3829](https://github.com/ggerganov/llama.cpp/releases/tag/b3829): <br>
|
||
> ```
|
||
> 1. Base⇢ Convert-GGUF(FP16)⇢ Generate-Imatrix-Data(FP16)
|
||
> 2. Base⇢ Convert-GGUF(BF16)⇢ Use-Imatrix-Data(FP16)⇢ Quantize-GGUF(Imatrix-Quants)
|
||
> ```
|
||
>
|
||
 |