103 lines
3.1 KiB
Markdown
103 lines
3.1 KiB
Markdown
|
---
|
||
|
|
license: mit
|
||
|
|
datasets:
|
||
|
|
- tatsu-lab/alpaca
|
||
|
|
language:
|
||
|
|
- en
|
||
|
|
tags:
|
||
|
|
- instruct-tuning
|
||
|
|
- gpt2
|
||
|
|
- alpaca
|
||
|
|
---
|
||
|
|
|
||
|
|
# GPT2 finetuned with Alpaca
|
||
|
|
|
||
|
|
### Examples
|
||
|
|
|
||
|
|
The following samples were generated with `{"temperature" : 0.7, "top_p" : 0.92, "top_k" : 0}`:
|
||
|
|
|
||
|
|
##### **Give three tips for a good meal**
|
||
|
|
|
||
|
|
```
|
||
|
|
Below is an instruction that describes a task. Write a response that appropriately completes the request.
|
||
|
|
|
||
|
|
### Instruction:
|
||
|
|
Give three tips for a good meal.
|
||
|
|
|
||
|
|
### Response:
|
||
|
|
|
||
|
|
1. Choose a healthy alternative to traditional fast food. This can include eating a nutritious breakfast, a healthy snack, and a healthy snack option.
|
||
|
|
2. Avoid excessive salt and sugar. Avoid any processed foods, such as processed eggs and sugary drinks.
|
||
|
|
3. Try a variety of healthy snacks. Try soft drinks, fruit juices, and other sugary foods.
|
||
|
|
```
|
||
|
|
|
||
|
|
##### **Write a poem about a delicious night**
|
||
|
|
|
||
|
|
```
|
||
|
|
Below is an instruction that describes a task. Write a response that appropriately completes the request.
|
||
|
|
|
||
|
|
### Instruction:
|
||
|
|
Write a poem about a delicious night.
|
||
|
|
|
||
|
|
### Response:
|
||
|
|
|
||
|
|
The moonlight glows like a golden light,
|
||
|
|
A beautiful night sky,
|
||
|
|
A sight that will never be forgotten.
|
||
|
|
|
||
|
|
The sweet smell of freshly baked bread fills the air,
|
||
|
|
A bright and vibrant night.
|
||
|
|
|
||
|
|
The stars twinkle and twinkle,
|
||
|
|
And the birds sing sweetly,
|
||
|
|
The sun and moon alike.
|
||
|
|
|
||
|
|
The night is full of joy and joy,
|
||
|
|
The smell of the sweet and fragrant scent,
|
||
|
|
A night that is full of love and laughter,
|
||
|
|
A night that is full of joy and laughter,
|
||
|
|
A night that will never be forgotten.
|
||
|
|
```
|
||
|
|
|
||
|
|
##### **Write a tweet describing your capabilities**
|
||
|
|
|
||
|
|
```
|
||
|
|
Below is an instruction that describes a task. Write a response that appropriately completes the request.
|
||
|
|
|
||
|
|
### Instruction:
|
||
|
|
Write a tweet describing your capabilities.
|
||
|
|
|
||
|
|
### Response:
|
||
|
|
|
||
|
|
I'm a software engineer with a passion for creating amazing software solutions. I'm passionate about the power of collaboration and collaboration tools, and I'm always looking for new ways to improve the efficiency of my work. #SoftwareEngineers #softwareless
|
||
|
|
```
|
||
|
|
|
||
|
|
##### **Pretend you are an alien visiting Earth. Write three opinions you believe**
|
||
|
|
|
||
|
|
```
|
||
|
|
Below is an instruction that describes a task. Write a response that appropriately completes the request.
|
||
|
|
|
||
|
|
### Instruction:
|
||
|
|
Pretend you are an alien visiting Earth. Write three opinions you believe.
|
||
|
|
|
||
|
|
### Response:
|
||
|
|
|
||
|
|
1. I believe the Earth is an intelligent and peaceful place.
|
||
|
|
2. I believe that the human race is on the brink of extinction.
|
||
|
|
3. I believe that the Earth is a great source of prosperity and safety.
|
||
|
|
```
|
||
|
|
|
||
|
|
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
||
|
|
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_vicgalle__gpt2-alpaca)
|
||
|
|
|
||
|
|
| Metric | Value |
|
||
|
|
|-----------------------|---------------------------|
|
||
|
|
| Avg. | 24.66 |
|
||
|
|
| ARC (25-shot) | 22.87 |
|
||
|
|
| HellaSwag (10-shot) | 31.14 |
|
||
|
|
| MMLU (5-shot) | 26.26 |
|
||
|
|
| TruthfulQA (0-shot) | 36.22 |
|
||
|
|
| Winogrande (5-shot) | 50.67 |
|
||
|
|
| GSM8K (5-shot) | 0.0 |
|
||
|
|
| DROP (3-shot) | 5.46 |
|