xc-llm-ascend/tests/e2e/models/configs/accuracy.txt

DeepSeek-V2-Lite.yaml
Qwen2.5-VL-7B-Instruct.yaml
Qwen3-30B-A3B.yaml
Qwen3-8B.yaml
Qwen2-7B.yaml
Qwen2-VL-7B-Instruct.yaml
Qwen2-Audio-7B-Instruct.yaml
Qwen3-VL-30B-A3B-Instruct.yaml
Qwen3-VL-8B-Instruct.yaml
Qwen2.5-Omni-7B.yaml
Meta-Llama-3.1-8B-Instruct.yaml
[Test] Update the format of the accuracy report (#3081) ### What this PR does / why we need it? Update the format of the accuracy report ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? - vLLM version: v0.10.2 - vLLM main: https://github.com/vllm-project/vllm/commit/c60e6137f0bf2034853919b3a9d705d7e06b93cf Signed-off-by: hfadzxy <starmoon_zhang@163.com> 2025-09-22 14:10:03 +08:00			`DeepSeek-V2-Lite.yaml`
Enable pytest and yaml style accuracy test (#2073) ### What this PR does / why we need it? This PR enabled pytest and yaml style accuracy test, users now can enable accuracy test by running: ```bash cd ~/vllm-ascend pytest -sv ./tests/e2e/singlecard/models/test_lm_eval_correctness.py \ --config ./tests/e2e/singlecard/models/configs/Qwen3-8B-Base.yaml \ --report_output ./benchmarks/accuracy/Qwen3-8B-Base.md pytest -sv ./tests/e2e/singlecard/models/test_lm_eval_correctness.py \ --config-list-file ./tests/e2e/singlecard/models/configs/accuracy.txt ``` Closes: https://github.com/vllm-project/vllm-ascend/issues/1970 ### Does this PR introduce _any_ user-facing change? no ### How was this patch tested? - vLLM version: v0.10.0 - vLLM main: https://github.com/vllm-project/vllm/commit/2836dd73f13015ee386c544760ca0d16888203f3 --------- Signed-off-by: Icey <1790571317@qq.com> 2025-07-31 21:39:13 +08:00			`Qwen2.5-VL-7B-Instruct.yaml`
Add models test and add serval new models yaml (#3394) ### What this PR does / why we need it? This PR added Add accuracy CI for servals new models - `ascend test / accuracy` is for PR triggered check popluar models accuracy - `ascedn test / models` is for accuracy report, full models test, nightly model test - Add Qwen2-Audio-7B-Instruct, Qwen2-VL-7B-Instruct, Qwen3-8B, Qwen3-VL-30B-A3B-Instruct ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? CI passed Closes: https://github.com/vllm-project/vllm-ascend/pull/2330 Closes: https://github.com/vllm-project/vllm-ascend/pull/3362 - vLLM version: v0.11.0rc3 - vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.0 --------- Signed-off-by: hfadzxy <starmoon_zhang@163.com> Signed-off-by: Yikun Jiang <yikunkero@gmail.com> Co-authored-by: hfadzxy <starmoon_zhang@163.com> 2025-10-12 17:27:50 +08:00			`Qwen3-30B-A3B.yaml`
			`Qwen3-8B.yaml`
			`Qwen2-7B.yaml`
			`Qwen2-VL-7B-Instruct.yaml`
			`Qwen2-Audio-7B-Instruct.yaml`
			`Qwen3-VL-30B-A3B-Instruct.yaml`
[Test]Add accuracy test for multiple models (#3823) ### What this PR does / why we need it? Add accuracy test for multiple models： - Meta_Llama_3.1_8B_Instruct - Qwen2.5-Omni-7B - Qwen3-VL-8B-Instruct - vLLM version: v0.11.0 - vLLM main: https://github.com/vllm-project/vllm/commit/83f478bb19489b41e9d208b47b4bb5a95ac171ac --------- Signed-off-by: MrZ20 <2609716663@qq.com> 2025-11-04 14:46:39 +08:00			`Qwen3-VL-8B-Instruct.yaml`
			`Qwen2.5-Omni-7B.yaml`
			`Meta-Llama-3.1-8B-Instruct.yaml`