35 lines
1.0 KiB
Markdown
35 lines
1.0 KiB
Markdown
---
|
|
license: cc-by-nc-4.0
|
|
tags:
|
|
- not-for-all-audiences
|
|
- nsfw
|
|
---
|
|
|
|
<!-- description start -->
|
|
## Description
|
|
|
|
This repo contains fp16 files of C-Based-2x7B.
|
|
|
|
Created by taking the best benchmark scoring model with the smallest size on HF leaderboard as of today (29/03/2024) which is [zhengr/MixTAO-7Bx2-MoE-v8.1](https://huggingface.co/zhengr/MixTAO-7Bx2-MoE-v8.1) and merging to it some MoE done by myself using the human feedback data from [Chaiverse](https://console.chaiverse.com/) specifically to have high level of RP, intelligence and usage.
|
|
|
|
Since this is a frankenmoe, I really don't know what the result will be leaderboard side, but what interest me is the human interaction realism anyway (for RP/ERP).
|
|
|
|
<!-- description end -->
|
|
<!-- prompt-template start -->
|
|
## Prompt template: Alpaca
|
|
|
|
```
|
|
Below is an instruction that describes a task. Write a response that appropriately completes the request.
|
|
|
|
### Instruction:
|
|
{system prompt}
|
|
|
|
### Input:
|
|
{prompt}
|
|
|
|
### Response:
|
|
{output}
|
|
```
|
|
|
|
If you want to support me, you can [here](https://ko-fi.com/undiai).
|