zhangxinyuehfad
|
c90a6d3658
|
[Test] Update the format of the accuracy report (#3081)
### What this PR does / why we need it?
Update the format of the accuracy report
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
- vLLM version: v0.10.2
- vLLM main:
https://github.com/vllm-project/vllm/commit/c60e6137f0bf2034853919b3a9d705d7e06b93cf
Signed-off-by: hfadzxy <starmoon_zhang@163.com>
|
2025-09-22 14:10:03 +08:00 |
|
zhangxinyuehfad
|
e26fe1caf1
|
[TEST] Speed up DS V2 accuracy test and turn up accuracy baseline (#3047)
### What this PR does / why we need it?
1. update expected accuracy for DeepSeek-V2-Lite
2. add batch size
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Accuracy CI passed
- vLLM version: v0.10.2
- vLLM main:
https://github.com/vllm-project/vllm/commit/838d7116ba59db528647b29f0d000742f4af9d4b
Signed-off-by: hfadzxy <starmoon_zhang@163.com>
|
2025-09-20 00:40:33 +08:00 |
|
zhangxinyuehfad
|
0c04bf1e36
|
[Fixbug] Fix accuracy for DeepSeek-V2-Lite (#3016)
### What this PR does / why we need it?
Fix accuracy for DeepSeek-V2-Lite
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
CI passed
- vLLM version: v0.10.2
- vLLM main:
https://github.com/vllm-project/vllm/commit/66072b36dbf1707440ff43d57273d9e9974349d7
Signed-off-by: hfadzxy <starmoon_zhang@163.com>
|
2025-09-18 23:58:23 +08:00 |
|
Icey
|
891b2bfe71
|
Accuracy report formatting (#2279)
### What this PR does / why we need it?
Accuracy report formatting
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
CI passed with existing test.
- vLLM version: v0.10.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/53415653ff24be03e7c90f5b42ef9cb3f72aad71
---------
Signed-off-by: Icey <1790571317@qq.com>
|
2025-08-25 09:39:30 +08:00 |
|
Icey
|
0bd5ff5299
|
Fix accuracy test config and add DeepSeek-V2-Lite test (#2261)
### What this PR does / why we need it?
This PR fix accuracy test related to
https://github.com/vllm-project/vllm-ascend/pull/2073, users can now
perform accuracy tests on multiple models simultaneously and generate
different report files by running:
```bash
cd ~/vllm-ascend
pytest -sv ./tests/e2e/models/test_lm_eval_correctness.py \
--config-list-file ./tests/e2e/models/configs/accuracy.txt
```
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
<img width="1648" height="511" alt="image"
src="https://github.com/user-attachments/assets/1757e3b8-a6b7-44e5-b701-80940dc756cd"
/>
- vLLM version: v0.10.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/766bc8162cb37ad32605eee051d4f049ec325926
---------
Signed-off-by: Icey <1790571317@qq.com>
|
2025-08-08 11:09:16 +08:00 |
|