60 lines
1.9 KiB
Markdown
60 lines
1.9 KiB
Markdown
|
This is a llama-13B based model. (sorry, I forgot to put it in the model name)
|
||
|
|
|
||
|
|
Base Model: GPT4-x-Alpaca full fine tune by Chavinlo -> https://huggingface.co/chavinlo/gpt4-x-alpaca
|
||
|
|
LORA fine tune using the Roleplay Instruct from GPT4 generated dataset -> https://github.com/teknium1/GPTeacher/tree/main/Roleplay
|
||
|
|
LORA Adapter Only: https://huggingface.co/ZeusLabs/gpt4-x-alpaca-rp-lora/tree/main/gpt-rp-instruct-1
|
||
|
|
|
||
|
|
Merged LORA to the model.
|
||
|
|
|
||
|
|
FYI Latest HF Transformers generates BROKEN generations.
|
||
|
|
Try this instead if your generations are terrible (first uninstall transformers): pip install git+https://github.com/huggingface/transformers@9eae4aa57650c1dbe1becd4e0979f6ad1e572ac0
|
||
|
|
|
||
|
|
|
||
|
|
Instruct it same way as alpaca / gpt4xalpaca:
|
||
|
|
```
|
||
|
|
### Instruction:
|
||
|
|
<prompt>
|
||
|
|
### Response:
|
||
|
|
|
||
|
|
```
|
||
|
|
|
||
|
|
or
|
||
|
|
```
|
||
|
|
### Instruction:
|
||
|
|
<prompt>
|
||
|
|
### Input:
|
||
|
|
<specific data to manipulate for the instruction
|
||
|
|
### Response:
|
||
|
|
|
||
|
|
```
|
||
|
|
|
||
|
|
For a better idea of prompting it for roleplay, check out the roleplay discord bot code I made here: https://github.com/teknium1/alpaca-roleplay-discordbot
|
||
|
|
Here is an example:
|
||
|
|
```
|
||
|
|
### Instruction:
|
||
|
|
Role play as character that is described in the following lines. You always stay in character.
|
||
|
|
{"Your name is " + name + "." if name else ""}
|
||
|
|
{"Your backstory and history are: " + background if background else ""}
|
||
|
|
{"Your personality is: " + personality if personality else ""}
|
||
|
|
{"Your current circumstances and situation are: " + circumstances if circumstances else ""}
|
||
|
|
{"Your common greetings are: " + common_greeting if common_greeting else ""}
|
||
|
|
Remember, you always stay on character. You are the character described above.
|
||
|
|
{past_dialogue_formatted}
|
||
|
|
{chat_history if chat_history else "Chatbot: Hello!"}
|
||
|
|
|
||
|
|
Always speak with new and unique messages that haven't been said in the chat history.
|
||
|
|
|
||
|
|
Respond to this message as your character would:
|
||
|
|
### Input:
|
||
|
|
{text}
|
||
|
|
### Response:
|
||
|
|
{name}:
|
||
|
|
|
||
|
|
```
|
||
|
|
|
||
|
|
---
|
||
|
|
tags:
|
||
|
|
- llama
|
||
|
|
- alpaca
|
||
|
|
- gpt4
|
||
|
|
---
|