base_model, library_name, tags, model-index

base_model	library_name	tags	model-index
Qwen/Qwen2.5-14B-Instruct prithivMLmods/Calcium-Opus-14B-Elite prithivMLmods/QwQ-LCoT-14B-Conversational	transformers	mergekit merge	name results Calcium-Opus-14B-Merge task dataset metrics source type name text-generation Text Generation name type split args IFEval (0-Shot) wis-k/instruction-following-eval train num_few_shot 0 type value name inst_level_strict_acc and prompt_level_strict_acc 49.49 averaged accuracy url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Merge Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type split args BBH (3-Shot) SaylorTwift/bbh test num_few_shot 3 type value name acc_norm 46.77 normalized accuracy url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Merge Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type split args MATH Lvl 5 (4-Shot) lighteval/MATH-Hard test num_few_shot 4 type value name exact_match 33.08 exact match url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Merge Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type split args GPQA (0-shot) Idavidrein/gpqa train num_few_shot 0 type value name acc_norm 16.11 acc_norm url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Merge Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type args MuSR (0-shot) TAUR-Lab/MuSR num_few_shot 0 type value name acc_norm 20.93 acc_norm url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Merge Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type config split args MMLU-PRO (5-shot) TIGER-Lab/MMLU-Pro main test num_few_shot 5 type value name acc 48.4 accuracy url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Merge Open LLM Leaderboard

Calcium-Opus-14B-Merge

Calcium-Opus-14B-Merge is based on the Qwen 2.5 14B modality architecture, designed to enhance the reasoning capabilities of 14B-parameter models. These models have proven effective in context understanding, reasoning, and mathematical problem-solving. It has been fine-tuned using a long chain-of-thought reasoning model and specialized datasets, with a focus on chain-of-thought (CoT) reasoning for problem-solving. This model is optimized for tasks requiring logical reasoning, detailed explanations, and multi-step problem-solving, making it ideal for applications such as instruction-following, text generation, and complex reasoning tasks.

This is a merge of pre-trained language models created using mergekit.

Merge Method

This model was merged using the Model Stock merge method using Qwen/Qwen2.5-14B-Instruct as a base.

Models Merged

The following models were included in the merge:

• prithivMLmods/Calcium-Opus-14B-Elite
• prithivMLmods/QwQ-LCoT-14B-Conversational

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: prithivMLmods/Calcium-Opus-14B-Elite
  - model: prithivMLmods/QwQ-LCoT-14B-Conversational
merge_method: model_stock
base_model: Qwen/Qwen2.5-14B-Instruct
parameters:
  normalize: false
  int8_mask: true
dtype: bfloat16
tokenizer_source: "Qwen/Qwen2.5-14B-Instruct"

Open LLM Leaderboard Evaluation Results

Detailed results can be found here! Summarized results can be found here!

Metric	Value (%)
Average	35.80
IFEval (0-Shot)	49.49
BBH (3-Shot)	46.77
MATH Lvl 5 (4-Shot)	33.08
GPQA (0-shot)	16.11
MuSR (0-shot)	20.93
MMLU-PRO (5-shot)	48.40