miscii-14b-1225/README.md

language, license, library_name, tags, base_model, metrics, model-index

language	license	library_name	tags	base_model	metrics	model-index
zho eng fra spa por deu ita rus jpn kor vie tha ara	apache-2.0	transformers	mergekit merge custom-research miscii	sthenno-com/miscii-14b-1028 Qwen/Qwen2.5-14B-Instruct	accuracy	name results miscii-14b-1225 task dataset metrics source type name text-generation Text Generation name type args IFEval (0-Shot) HuggingFaceH4/ifeval num_few_shot 0 type value name inst_level_strict_acc and prompt_level_strict_acc 78.78 strict accuracy url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225 Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type args BBH (3-Shot) BBH num_few_shot 3 type value name acc_norm 50.91 normalized accuracy url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225 Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type args MATH Lvl 5 (4-Shot) hendrycks/competition_math num_few_shot 4 type value name exact_match 31.57 exact match url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225 Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type args GPQA (0-shot) Idavidrein/gpqa num_few_shot 0 type value name acc_norm 17 acc_norm url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225 Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type args MuSR (0-shot) TAUR-Lab/MuSR num_few_shot 0 type value name acc_norm 14.77 acc_norm url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225 Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type config split args MMLU-PRO (5-shot) TIGER-Lab/MMLU-Pro main test num_few_shot 5 type value name acc 47.46 accuracy url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225 Open LLM Leaderboard

miscii-14b-1225

Image source: Rrhar'il | Phigros

Prompting & Usage

See miscii-14b-1028 for more details.

Training Details

Coming soon

Merge Details

This is a merge of pre-trained language models created using mergekit.

Open LLM Leaderboard Evaluation Results

Congratulations to the miscii series models for surpassing 40 points for the first time! As of December 25, 2024, this should be the best-performing 14B model in the tests, right?

Metric	Value
Avg.	40.08
IFEval (0-Shot)	78.78
BBH (3-Shot)	50.91
MATH Lvl 5 (4-Shot)	31.57
GPQA (0-shot)	17.00
MuSR (0-shot)	14.77
MMLU-PRO (5-shot)	47.46

Refined since 2025-02-15

Metric	Value
Avg.	42.35
IFEval (0-Shot)	78.78
BBH (3-Shot)	50.91
MATH Lvl 5 (4-Shot)	45.17
GPQA (0-shot)	17.00
MuSR (0-shot)	14.77
MMLU-PRO (5-shot)	47.46