初始化项目,由ModelHub XC社区提供模型
Model: feeltheAGI/Maverick-Math-7B Source: Original Platform
This commit is contained in:
32
README.md
Normal file
32
README.md
Normal file
@@ -0,0 +1,32 @@
|
||||
---
|
||||
datasets:
|
||||
- microsoft/orca-math-word-problems-200k
|
||||
license: apache-2.0
|
||||
---
|
||||
|
||||
### Maverick-Math-7B
|
||||
|
||||
|
||||

|
||||
|
||||
|
||||
|
||||
### Model description
|
||||
|
||||
Maverick-Math is a Mistral Fine-tune, on top of math and code datasets and performs very well on benchmarks .
|
||||
|
||||
## 🏆 Evaluation
|
||||
|
||||
### gsm8k
|
||||
|
||||
|Tasks|Version| Filter |n-shot| Metric |Value | |Stderr|
|
||||
|-----|------:|----------------|-----:|-----------|-----:|---|-----:|
|
||||
|gsm8k| 3|strict-match | 5|exact_match|0.7331|± |0.0122|
|
||||
| | |flexible-extract| 5|exact_match|0.7400|± |0.0121|
|
||||
|
||||
### mathqa
|
||||
|
||||
|Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|
||||
|------|------:|------|------|--------|-----:|---|-----:|
|
||||
|mathqa| 1|none |None |acc |0.3591|± |0.0088|
|
||||
| | |none |None |acc_norm|0.3635|± |0.0088|
|
||||
Reference in New Issue
Block a user