[Benchmarks] Add qwen2.5-7b test (#763)

### What this PR does / why we need it?
- Add qwen2.5-7b test
- Optimize the documentation to be more developer-friendly 

Signed-off-by: xuedinge233 <damow890@gmail.com>
Co-authored-by: xuedinge233 <damow890@gmail.com>
This commit is contained in:
Li Wang
2025-05-10 09:47:42 +08:00
committed by GitHub
parent 19c8e134e4
commit 218f21de21
4 changed files with 54 additions and 6 deletions

View File

@@ -8,5 +8,15 @@
"num_iters_warmup": 5,
"num_iters": 15
}
},
{
"test_name": "latency_qwen2_5_7B_tp1",
"parameters": {
"model": "Qwen/Qwen2.5-7B-Instruct",
"tensor_parallel_size": 1,
"load_format": "dummy",
"num_iters_warmup": 5,
"num_iters": 15
}
}
]