license, language, base_model, pipeline_tag, library_name, tags, model-index

license	language	base_model	pipeline_tag	library_name	tags	model-index
llama3.1	en	microsoft/phi-4	text-generation	transformers	text-generation-inference llama3.1 phi4 LlamaForCausalLM Corpus trl	name results Megatron-Opus-14B-2.0 task dataset metrics source type name text-generation Text Generation name type split args IFEval (0-Shot) wis-k/instruction-following-eval train num_few_shot 0 type value name inst_level_strict_acc and prompt_level_strict_acc 66.94 averaged accuracy url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FMegatron-Opus-14B-2.0 Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type split args BBH (3-Shot) SaylorTwift/bbh test num_few_shot 3 type value name acc_norm 54.7 normalized accuracy url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FMegatron-Opus-14B-2.0 Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type split args MATH Lvl 5 (4-Shot) lighteval/MATH-Hard test num_few_shot 4 type value name exact_match 27.79 exact match url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FMegatron-Opus-14B-2.0 Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type split args GPQA (0-shot) Idavidrein/gpqa train num_few_shot 0 type value name acc_norm 14.54 acc_norm url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FMegatron-Opus-14B-2.0 Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type args MuSR (0-shot) TAUR-Lab/MuSR num_few_shot 0 type value name acc_norm 10.52 acc_norm url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FMegatron-Opus-14B-2.0 Open LLM Leaderboard task dataset metrics source type name text-generation Text Generation name type config split args MMLU-PRO (5-shot) TIGER-Lab/MMLU-Pro main test num_few_shot 5 type value name acc 46.34 accuracy url name https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FMegatron-Opus-14B-2.0 Open LLM Leaderboard

Megatron-Opus-14B-2.0 [ Exp ]

[Megatron-Opus-14B-2.0 ] Exp finetuned from Microsoft's Phi-4 is a state-of-the-art open model developed with a focus on responsible problem solving and advanced reasoning capabilities. Built upon a diverse blend of synthetic datasets, carefully filtered public domain websites, and high-quality academic books and Q&A datasets, Megatron-Opus-14B-2.0 ensures that small, capable models are trained with datasets of exceptional depth and precision.

Megatron-Opus-14B-2.0 adopts a robust safety post-training approach using open-source and in-house synthetic datasets. This involves a combination of SFT (Supervised Fine-Tuning) and iterative DPO (Direct Preference Optimization) techniques, ensuring helpful and harmless outputs across various safety categories.

Dataset Info

Megatron-Opus-14B-2.0 is fine-tuned on a carefully curated synthetic dataset generated using an advanced pipeline optimized for Chain of Thought (CoT) reasoning and Responsible Problem Breakdown (RPB) methodologies. This ensures that the model excels at:

• Logical reasoning
• Step-by-step problem-solving
• Breaking down complex tasks into manageable parts

The dataset also emphasizes responsible decision-making and fairness in generating solutions.

Run with Transformers

# pip install accelerate
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch

tokenizer = AutoTokenizer.from_pretrained("prithivMLmods/Megatron-Opus-14B-2.0")
model = AutoModelForCausalLM.from_pretrained(
    "prithivMLmods/Megatron-Opus-14B-2.0",
    device_map="auto",
    torch_dtype=torch.bfloat16,
)

input_text = "Explain the concept of black holes."
input_ids = tokenizer(input_text, return_tensors="pt").to("cuda")

outputs = model.generate(**input_ids, max_new_tokens=64)
print(tokenizer.decode(outputs[0]))

For chat-style interactions, use tokenizer.apply_chat_template:

messages = [
    {"role": "user", "content": "Explain the concept of black holes."},
]
input_ids = tokenizer.apply_chat_template(messages, return_tensors="pt", return_dict=True).to("cuda")

outputs = model.generate(**input_ids, max_new_tokens=256)
print(tokenizer.decode(outputs[0]))

Intended Use

Megatron-Opus-14B-2.0 is tailored for a wide range of applications, especially those involving advanced reasoning, multilingual capabilities, and responsible problem-solving. Its primary use cases include:

1. Responsible Problem Solving

   • Breaking down complex problems into logical, actionable steps.
   • Offering ethical, well-rounded solutions in academic and professional contexts.

2. Advanced Reasoning Tasks

   • Excelling in mathematics, logic, and scientific reasoning.
   • Providing detailed explanations and systematic answers.

3. Content Generation

   • Assisting in generating high-quality content for various domains, including creative writing and technical documentation.
   • Supporting marketers, writers, and educators with detailed and well-structured outputs.

4. Educational Support

   • Acting as a virtual tutor for students by generating practice questions, answers, and detailed explanations.
   • Helping educators design learning material that promotes critical thinking and step-by-step problem-solving.

5. Customer Support & Dialogue Systems

   • Enabling chatbots and virtual assistants to provide accurate, helpful, and responsible responses.
   • Enhancing customer service with reasoning-driven automation.

Limitations

Despite its strengths, Megatron-Opus-14B-2.0 has some limitations that users should be aware of:

1. Bias and Fairness

   • While great effort has been made to minimize biases, users should critically assess the model’s output in sensitive scenarios to avoid unintended bias.

2. Contextual Interpretation

   • The model may occasionally misinterpret highly nuanced prompts or ambiguous contexts, leading to suboptimal responses.

3. Knowledge Cutoff

   • Megatron-Opus-14B-2.0’s knowledge is static and based on the data available at the time of training. It does not include real-time updates or information on recent developments.

4. Safety and Harmlessness

   • Despite post-training safety alignment, inappropriate or harmful outputs may still occur. Continuous monitoring and human oversight are advised when using the model in critical contexts.

5. Computational Requirements

   • Deploying Megatron-Opus-14B-2.0 efficiently may require substantial computational resources, particularly for large-scale deployments or real-time applications.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here! Summarized results can be found here!

Metric	Value (%)
Average	36.80
IFEval (0-Shot)	66.94
BBH (3-Shot)	54.70
MATH Lvl 5 (4-Shot)	27.79
GPQA (0-shot)	14.54
MuSR (0-shot)	10.52
MMLU-PRO (5-shot)	46.34