32 lines
1.1 KiB
Markdown
32 lines
1.1 KiB
Markdown
|
---
|
||
|
|
license: llama2
|
||
|
|
language:
|
||
|
|
- en
|
||
|
|
tags:
|
||
|
|
- llama
|
||
|
|
---
|
||
|
|
|
||
|
|
Chat model with a storytelling bent.
|
||
|
|
|
||
|
|
Recipe:
|
||
|
|
* [Chronorctypus-Limarobormes](https://huggingface.co/chargoddard/Chronorctypus-Limarobormes-13b) base
|
||
|
|
* a healthy SLERPing of [ReMM-v2.2-L2-13B](https://huggingface.co/Undi95/ReMM-v2.2-L2-13B)
|
||
|
|
* [Llama-2-13B-Storywriter](https://huggingface.co/Blackroot/Llama-2-13B-Storywriter-LORA) x 0.5
|
||
|
|
* WIP storytelling LORA
|
||
|
|
|
||
|
|
|
||
|
|
Responds well to the Alpaca prompt format.
|
||
|
|
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
||
|
|
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_chargoddard__storytime-13b)
|
||
|
|
|
||
|
|
| Metric | Value |
|
||
|
|
|-----------------------|---------------------------|
|
||
|
|
| Avg. | 50.55 |
|
||
|
|
| ARC (25-shot) | 62.03 |
|
||
|
|
| HellaSwag (10-shot) | 83.96 |
|
||
|
|
| MMLU (5-shot) | 57.48 |
|
||
|
|
| TruthfulQA (0-shot) | 52.5 |
|
||
|
|
| Winogrande (5-shot) | 75.53 |
|
||
|
|
| GSM8K (5-shot) | 8.34 |
|
||
|
|
| DROP (3-shot) | 14.0 |
|