初始化项目,由ModelHub XC社区提供模型
Model: teknium/llama-deus-7b-v3-lora-merged Source: Original Platform
This commit is contained in:
44
README.md
Normal file
44
README.md
Normal file
@@ -0,0 +1,44 @@
|
||||
---
|
||||
license: mit
|
||||
---
|
||||
---
|
||||
license: mit
|
||||
---
|
||||
|
||||
Base Mode: Llama 7B
|
||||
LoRA is fully Merged with llama7b, so you do not need to merge it to load the model.
|
||||
|
||||
Llama DEUS v3 is the largest dataset I've trained on yet, including:
|
||||
|
||||
GPTeacher - General Instruct - Code Instruct - Roleplay Instruct
|
||||
My unreleased Roleplay V2 Instruct
|
||||
GPT4-LLM Uncensored + Unnatural Instructions
|
||||
WizardLM Uncensored
|
||||
CamelAI's 20k Biology, 20k Physics, 20k Chemistry, and 50k Math GPT4 Datasets
|
||||
CodeAlpaca
|
||||
|
||||
This model was trained for 4 epochs over 1 day of training, it's a rank 128 LORA that targets attention heads, LM_Head, and MLP layers
|
||||
|
||||
Prompt format:
|
||||
|
||||
```
|
||||
### Instruction:
|
||||
<prompt>
|
||||
|
||||
### Response:
|
||||
|
||||
```
|
||||
|
||||
or
|
||||
|
||||
```
|
||||
### Instruction:
|
||||
<prompt>
|
||||
|
||||
### Input:
|
||||
<input>
|
||||
|
||||
### Response:
|
||||
|
||||
```
|
||||
|
||||
Reference in New Issue
Block a user