library_name, tags, base_model, model-index, license, language, pipeline_tag

library_name	tags	base_model	model-index	license	language	pipeline_tag
transformers	mergekit merge	sometimesanotion/Lamarck-14B-v0.7 sometimesanotion/Qwenvergence-14B-v12-Prose-DS	name results Lamarckvergence-14B task dataset metrics source type name text-generation Text Generation name type args IFEval (0-Shot) HuggingFaceH4/ifeval num_few_shot 0 type value name inst_level_strict_acc and prompt_level_strict_acc 76.56 strict accuracy url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=suayptalha/Lamarckvergence-14B Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type args BBH (3-Shot) BBH num_few_shot 3 type value name acc_norm 50.33 normalized accuracy url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=suayptalha/Lamarckvergence-14B Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type args MATH Lvl 5 (4-Shot) hendrycks/competition_math num_few_shot 4 type value name exact_match 54 exact match url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=suayptalha/Lamarckvergence-14B Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type args GPQA (0-shot) Idavidrein/gpqa num_few_shot 0 type value name acc_norm 15.1 acc_norm url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=suayptalha/Lamarckvergence-14B Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type args MuSR (0-shot) TAUR-Lab/MuSR num_few_shot 0 type value name acc_norm 16.34 acc_norm url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=suayptalha/Lamarckvergence-14B Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type config split args MMLU-PRO (5-shot) TIGER-Lab/MMLU-Pro main test num_few_shot 5 type value name acc 47.59 accuracy url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=suayptalha/Lamarckvergence-14B Open LLM Leaderboard	apache-2.0	en	text-generation

Merged Model

[!TIP] This model is currently ranked #1 among the models up to 15B parameters and #56 among all models on the Open LLM Leaderboard.

-15.2.2025

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the SLERP merge method.

Models Merged

The following models were included in the merge:

• sometimesanotion/Lamarck-14B-v0.7
• sometimesanotion/Qwenvergence-14B-v12-Prose-DS

Configuration

The following YAML configuration was used to produce this model:

base_model: sometimesanotion/Lamarck-14B-v0.7
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 48]
    model: sometimesanotion/Lamarck-14B-v0.7
  - layer_range: [0, 48]
    model: sometimesanotion/Qwenvergence-14B-v12-Prose-DS

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	43.32
IFEval (0-Shot)	76.56
BBH (3-Shot)	50.33
MATH Lvl 5 (4-Shot)	54.00
GPQA (0-shot)	15.10
MuSR (0-shot)	16.34
MMLU-PRO (5-shot)	47.59