license, library_name, tags, base_model, datasets, model-index

license	library_name	tags	base_model	datasets	model-index
apache-2.0	transformers	mergekit merge qwen2 qwen2.5 dpo	v000000/Qwen2.5-14B-Gutenberg-1e-Delta Qwen/Qwen2.5-14B-Instruct	jondurbin/gutenberg-dpo-v0.1	name results Qwen2.5-14B-Gutenberg-Instruct-Slerpeno task dataset metrics source type name text-generation Text Generation name type args IFEval (0-Shot) HuggingFaceH4/ifeval num_few_shot 0 type value name inst_level_strict_acc and prompt_level_strict_acc 48.55 strict accuracy url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=v000000/Qwen2.5-14B-Gutenberg-Instruct-Slerpeno Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type args BBH (3-Shot) BBH num_few_shot 3 type value name acc_norm 49.74 normalized accuracy url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=v000000/Qwen2.5-14B-Gutenberg-Instruct-Slerpeno Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type args MATH Lvl 5 (4-Shot) hendrycks/competition_math num_few_shot 4 type value name exact_match 19.71 exact match url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=v000000/Qwen2.5-14B-Gutenberg-Instruct-Slerpeno Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type args GPQA (0-shot) Idavidrein/gpqa num_few_shot 0 type value name acc_norm 15.21 acc_norm url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=v000000/Qwen2.5-14B-Gutenberg-Instruct-Slerpeno Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type args MuSR (0-shot) TAUR-Lab/MuSR num_few_shot 0 type value name acc_norm 18.43 acc_norm url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=v000000/Qwen2.5-14B-Gutenberg-Instruct-Slerpeno Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type config split args MMLU-PRO (5-shot) TIGER-Lab/MMLU-Pro main test num_few_shot 5 type value name acc 48.68 accuracy url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=v000000/Qwen2.5-14B-Gutenberg-Instruct-Slerpeno Open LLM Leaderboard

Qwen2.5-14B-Gutenberg-Instruct-Slerpeno

---

GGUF from mradermacher!

• GGUF static

• GGUF Imatrix

GGUF from QuantFactory!

• GGUF static

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the SLERP merge method. (sophosympatheia gradient)

Models Merged

The following models were included in the merge:

• v000000/Qwen2.5-14B-Gutenberg-1e-Delta
• Qwen/Qwen2.5-14B-Instruct

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: Qwen/Qwen2.5-14B-Instruct
merge_method: slerp
base_model: v000000/Qwen2.5-14B-Gutenberg-1e-Delta
parameters:
  t:
    - value: [0, 0, 0.3, 0.4, 0.5, 0.6, 0.5, 0.4, 0.3, 0, 0]
dtype: bfloat16

The idea here is that Gutenberg DPO stays in the output/input 100% while merging smoothly with the base instruct model in the deeper layers to heal loss and increase intelligence.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	33.39
IFEval (0-Shot)	48.55
BBH (3-Shot)	49.74
MATH Lvl 5 (4-Shot)	19.71
GPQA (0-shot)	15.21
MuSR (0-shot)	18.43
MMLU-PRO (5-shot)	48.68