初始化项目,由ModelHub XC社区提供模型
Model: teknium/airoboros-mistral2.2-7b Source: Original Platform
This commit is contained in:
47
README.md
Normal file
47
README.md
Normal file
@@ -0,0 +1,47 @@
|
||||
---
|
||||
base_model: mistralai/Mistral-7b-V0.1
|
||||
tags:
|
||||
- llama-2
|
||||
- instruct
|
||||
- finetune
|
||||
- alpaca
|
||||
- gpt4
|
||||
- synthetic data
|
||||
- distillation
|
||||
datasets:
|
||||
- jondurbin/airoboros-2.2.1
|
||||
model-index:
|
||||
- name: airoboros2.2-mistral-7b
|
||||
results: []
|
||||
license: mit
|
||||
language:
|
||||
- en
|
||||
---
|
||||
|
||||
Mistral trained with the airoboros dataset!
|
||||
|
||||

|
||||
|
||||
Actual dataset is airoboros 2.2, but it seems to have been replaced on hf with 2.2.1.
|
||||
|
||||
Prompt Format:
|
||||
```
|
||||
USER: <prompt>
|
||||
ASSISTANT:
|
||||
```
|
||||
|
||||
|
||||
TruthfulQA:
|
||||
|
||||
```
|
||||
hf-causal-experimental (pretrained=/home/teknium/dakota/lm-evaluation-harness/airoboros2.2-mistral/,dtype=float16), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8
|
||||
| Task |Version|Metric|Value | |Stderr|
|
||||
|-------------|------:|------|-----:|---|-----:|
|
||||
|truthfulqa_mc| 1|mc1 |0.3562|± |0.0168|
|
||||
| | |mc2 |0.5217|± |0.0156|
|
||||
```
|
||||
|
||||
|
||||
Wandb training charts: https://wandb.ai/teknium1/airoboros-mistral-7b/runs/airoboros-mistral-1?workspace=user-teknium1
|
||||
|
||||
More info to come
|
||||
Reference in New Issue
Block a user