74 lines
2.7 KiB
Markdown
74 lines
2.7 KiB
Markdown
---
|
|
license: cc-by-nc-4.0
|
|
---
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
# This model is a collab between [IkariDev](https://huggingface.co/IkariDev) and [Undi](https://huggingface.co/Undi95)!
|
|
|
|
<!-- description start -->
|
|
## Description
|
|
|
|
<!-- [Recommended settings - contributed by localfultonextractor](https://files.catbox.moe/ue0tja.json) -->
|
|
|
|
This repo contains fp16 files of Noromaid-7b-v0.4-DPO.
|
|
|
|
[FP16 - by IkariDev and Undi](https://huggingface.co/NeverSleep/Noromaid-7B-0.4-DPO)
|
|
|
|
<!-- [GGUF - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GGUF)-->
|
|
|
|
<!-- [GPTQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GPTQ)-->
|
|
|
|
<!-- [exl2[8bpw-8h] - by AzureBlack](https://huggingface.co/AzureBlack/Echidna-13b-v0.3-8bpw-8h-exl2)-->
|
|
|
|
<!-- [AWQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-AWQ)-->
|
|
|
|
<!-- [fp16 - by IkariDev+Undi95](https://huggingface.co/IkariDev/Athena-v4)-->
|
|
|
|
[GGUF - by IkariDev and Undi](https://huggingface.co/NeverSleep/Noromaid-7B-0.4-DPO-GGUF)
|
|
<!-- [OLD(GGUF - by IkariDev+Undi95)](https://huggingface.co/IkariDev/Athena-v4-GGUF)-->
|
|
|
|
## Ratings:
|
|
|
|
Note: We have permission of all users to upload their ratings, we DONT screenshot random reviews without asking if we can put them here!
|
|
|
|
No ratings yet!
|
|
|
|
If you want your rating to be here, send us a message over on DC and we'll put up a screenshot of it here. DC name is "ikaridev" and "undi".
|
|
|
|
<!-- description end -->
|
|
<!-- prompt-template start -->
|
|
|
|
## Prompt format: Chatml
|
|
```
|
|
<|im_start|>system
|
|
{sysprompt}<|im_end|>
|
|
<|im_start|>user
|
|
{input}<|im_end|>
|
|
<|im_start|>assistant
|
|
{output}<|im_end|>
|
|
```
|
|
|
|
## Training data used:
|
|
- [no_robots dataset](https://huggingface.co/Undi95/Llama2-13B-no_robots-alpaca-lora) let the model have more human behavior, enhances the output.
|
|
- [Aesir Private RP dataset] New data from a new and never used before dataset, add fresh data, no LimaRP spam, this is 100% new. Thanks to the [MinvervaAI Team](https://huggingface.co/MinervaAI) and, in particular, [Gryphe](https://huggingface.co/Gryphe) for letting us use it!
|
|
- [Another private Aesir dataset]
|
|
- [Another private Aesir dataset]
|
|
- [limarp](https://huggingface.co/datasets/lemonilia/LimaRP)
|
|
|
|
## DPO training data used:
|
|
- [Intel/orca_dpo_pairs](https://huggingface.co/datasets/Intel/orca_dpo_pairs)
|
|
- [NobodyExistsOnTheInternet/ToxicDPOqa](https://huggingface.co/datasets/NobodyExistsOnTheInternet/ToxicDPOqa)
|
|
- [Undi95/toxic-dpo-v0.1-NoWarning](https://huggingface.co/datasets/Undi95/toxic-dpo-v0.1-NoWarning)
|
|
|
|
This is a full finetune.
|
|
|
|
## Others
|
|
|
|
Undi: If you want to support me, you can [here](https://ko-fi.com/undiai).
|
|
|
|
IkariDev: Visit my [retro/neocities style website](https://ikaridevgit.github.io/) please kek |