datasets, license
| datasets |
license |
| microsoft/orca-math-word-problems-200k |
|
apache-2.0 |
Maverick-Math-7B
Model description
Maverick-Math is a Mistral Fine-tune, on top of math and code datasets and performs very well on benchmarks .
🏆 Evaluation
gsm8k
| Tasks |
Version |
Filter |
n-shot |
Metric |
Value |
|
Stderr |
| gsm8k |
3 |
strict-match |
5 |
exact_match |
0.7331 |
± |
0.0122 |
|
|
flexible-extract |
5 |
exact_match |
0.7400 |
± |
0.0121 |
mathqa
| Tasks |
Version |
Filter |
n-shot |
Metric |
Value |
|
Stderr |
| mathqa |
1 |
none |
None |
acc |
0.3591 |
± |
0.0088 |
|
|
none |
None |
acc_norm |
0.3635 |
± |
0.0088 |
