library_name, tags
| library_name | tags |
|---|---|
| transformers |
📊 Benchmark Results
| Benchmark | Metric | Score |
|---|---|---|
| ARC-Challenge | acc_norm | 39.25% |
| GSM8K | exact_match | 37.45% |
| MMLU | acc | 53.75% |
Evaluated using lm-evaluation-harness.
Note: v2 of this model coming soon with stronger reasoning and agentic capabilities. Will fix the "identity confusion" Users may experience with this current model.