17 lines
497 B
Markdown
17 lines
497 B
Markdown
---
|
|
license: cc-by-nc-4.0
|
|
---
|
|
|
|
Just for experimental purposes, not stable.
|
|
|
|
Finetuned on dataset [LDJnr/Capybara](https://huggingface.co/datasets/LDJnr/Capybara) using model [Psyfighter2-Noromaid-ties-13B](https://huggingface.co/diffnamehard/Psyfighter2-Noromaid-ties-13B)
|
|
|
|
| Metric | Value |
|
|
| --- | --- |
|
|
| Avg. | 60.27 |
|
|
| ARC (25-shot) | 62.29 |
|
|
| HellaSwag (10-shot) | 83.87 |
|
|
| MMLU (5-shot) | 56.59 |
|
|
| TruthfulQA (0-shot) | 51.44 |
|
|
| Winogrande (5-shot) | 77.03 |
|
|
| GSM8K (5-shot) | 30.4 | |