language, license, library_name, datasets, model-index
language license library_name datasets model-index
en
apache-2.0 transformers
WizardLM/WizardLM_evol_instruct_V2_196k
name results
open-llama-3b-v2-wizard-evol-instuct-v2-196k
task dataset metrics source
type name
text-generation Text Generation
name type config split args
AI2 Reasoning Challenge (25-Shot) ai2_arc ARC-Challenge test
num_few_shot
25
type value name
acc_norm 41.81 normalized accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=harborwater/open-llama-3b-v2-wizard-evol-instuct-v2-196k Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type split args
HellaSwag (10-Shot) hellaswag validation
num_few_shot
10
type value name
acc_norm 73.01 normalized accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=harborwater/open-llama-3b-v2-wizard-evol-instuct-v2-196k Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type config split args
MMLU (5-Shot) cais/mmlu all test
num_few_shot
5
type value name
acc 26.36 accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=harborwater/open-llama-3b-v2-wizard-evol-instuct-v2-196k Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type config split args
TruthfulQA (0-shot) truthful_qa multiple_choice validation
num_few_shot
0
type value
mc2 38.99
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=harborwater/open-llama-3b-v2-wizard-evol-instuct-v2-196k Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type config split args
Winogrande (5-shot) winogrande winogrande_xl validation
num_few_shot
5
type value name
acc 66.69 accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=harborwater/open-llama-3b-v2-wizard-evol-instuct-v2-196k Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type config split args
GSM8k (5-shot) gsm8k main test
num_few_shot
5
type value name
acc 1.9 accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=harborwater/open-llama-3b-v2-wizard-evol-instuct-v2-196k Open LLM Leaderboard

Trained on 1 epoch of the WizardLM_evol_instruct_v2_196k dataset

Link to GGUF formats.

Prompt template:

### HUMAN:
{prompt}

### RESPONSE:
<leave a newline for the model to answer>

Built with Axolotl

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 41.46
AI2 Reasoning Challenge (25-Shot) 41.81
HellaSwag (10-Shot) 73.01
MMLU (5-Shot) 26.36
TruthfulQA (0-shot) 38.99
Winogrande (5-shot) 66.69
GSM8k (5-shot) 1.90
Description
Model synced from source: harborwater/open-llama-3b-v2-wizard-evol-instuct-v2-196k
Readme 26 KiB