初始化项目,由ModelHub XC社区提供模型
Model: Lewdiculous/Violet_Twilight-v0.2-GGUF-IQ-Imatrix Source: Original Platform
This commit is contained in:
43
README.md
Normal file
43
README.md
Normal file
@@ -0,0 +1,43 @@
|
||||
---
|
||||
base_model: Epiculous/Violet_Twilight-v0.2
|
||||
license: apache-2.0
|
||||
inference: false
|
||||
tags:
|
||||
- mistral
|
||||
- nemo
|
||||
- roleplay
|
||||
- sillytavern
|
||||
- gguf
|
||||
---
|
||||
|
||||
**Model name:** <br>
|
||||
Violet_Twilight-v0.2
|
||||
|
||||
**Description:** <br>
|
||||
"Now for something a bit different, Violet_Twilight-v0.2! This model is a SLERP merge of Azure_Dusk-v0.2 and Crimson_Dawn-v0.2!" <br>
|
||||
– by Author. <br>
|
||||
|
||||
Use the **ChatML** prompt format. <br>
|
||||
|
||||
> [!IMPORTANT]
|
||||
> **[Added]** <br>
|
||||
> ARM quants: <br>
|
||||
> `"Q4_0_4_4", "Q4_0_4_8", "Q4_0_8_8"`
|
||||
|
||||
> [!TIP]
|
||||
> **Presets:** <br>
|
||||
> You can use ChatML presets within SillyTavern and adjust from there. <br>
|
||||
> Alternatively, check out [Virt-io's ChatML v1.9 presets here](https://huggingface.co/Virt-io/SillyTavern-Presets/tree/main/Prompts/ChatML/v1.9), make sure you read the [repository page for how to use them properly](https://huggingface.co/Virt-io/SillyTavern-Presets/). <br>
|
||||
> The author also provides links to custom sampler presets [in the model page here](https://huggingface.co/Epiculous/Violet_Twilight-v0.2#current-top-sampler-settings).
|
||||
|
||||
> [!NOTE]
|
||||
> Original model page: <br>
|
||||
> https://huggingface.co/Epiculous/Violet_Twilight-v0.2
|
||||
>
|
||||
> Quantized using [llama.cpp](https://github.com/ggerganov/llama.cpp)-[b3829](https://github.com/ggerganov/llama.cpp/releases/tag/b3829): <br>
|
||||
> ```
|
||||
> 1. Base⇢ Convert-GGUF(FP16)⇢ Generate-Imatrix-Data(FP16)
|
||||
> 2. Base⇢ Convert-GGUF(BF16)⇢ Use-Imatrix-Data(FP16)⇢ Quantize-GGUF(Imatrix-Quants)
|
||||
> ```
|
||||
>
|
||||

|
||||
Reference in New Issue
Block a user