EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

[Test] Add accuracy test report workflow (#542)

Browse Source 
### What this PR does / why we need it?
1. Provide accuracy test report for development branch release.
2. Models and datasets for accuracy test：
    
| Model | datasets |
|---------------------------- | --------------------------- | 
| Qwen2.5-7B-Instruct        |  ceval-val, gsm8k, mmlu  |
| Qwen3-8B                        |  ceval-val, gsm8k, mmlu  |
| Llama-3.1-8B-Instruct      |  ceval-val, gsm8k, mmlu  |
| Qwen2.5-VL-7B-Instruct  |           mmmu_val             |

### Does this PR introduce _any_ user-facing change?
This PR will display the accuracy test report of the release versionin
docs/source/developer_guide/accuracy_report。
Qwen2.5-7B-Instruct.md
Qwen3-8B.md
Llama-3.1-8B-Instruct.md
Qwen2.5-VL-7B-Instruct .md

Signed-off-by: hfadzxy <starmoon_zhang@163.com>
This commit is contained in:
hfadzxy
2025-04-30 14:53:58 +08:00
committed by GitHub
parent ba9714ccee
commit affca6f348
6 changed files with 587 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/developer_guide/evaluation/index.md
View File

@@ -3,8 +3,8 @@
:::{toctree}
:caption: Accuracy
:maxdepth: 1
using_opencompass
using_lm_eval
using_opencompass
using_evalscope
:::