32 lines
920 B
Markdown
32 lines
920 B
Markdown
---
|
|
datasets:
|
|
- microsoft/orca-math-word-problems-200k
|
|
license: apache-2.0
|
|
---
|
|
|
|
### Maverick-Math-7B
|
|
|
|
|
|
|
|
|
|
|
|
|
|
### Model description
|
|
|
|
Maverick-Math is a Mistral Fine-tune, on top of math and code datasets and performs very well on benchmarks .
|
|
|
|
## 🏆 Evaluation
|
|
|
|
### gsm8k
|
|
|
|
|Tasks|Version| Filter |n-shot| Metric |Value | |Stderr|
|
|
|-----|------:|----------------|-----:|-----------|-----:|---|-----:|
|
|
|gsm8k| 3|strict-match | 5|exact_match|0.7331|± |0.0122|
|
|
| | |flexible-extract| 5|exact_match|0.7400|± |0.0121|
|
|
|
|
### mathqa
|
|
|
|
|Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|
|
|------|------:|------|------|--------|-----:|---|-----:|
|
|
|mathqa| 1|none |None |acc |0.3591|± |0.0088|
|
|
| | |none |None |acc_norm|0.3635|± |0.0088| |