[Benchmarks] Add qwen2.5-7b test (#763)

### What this PR does / why we need it?
- Add qwen2.5-7b test
- Optimize the documentation to be more developer-friendly 

Signed-off-by: xuedinge233 <damow890@gmail.com>
Co-authored-by: xuedinge233 <damow890@gmail.com>
This commit is contained in:
Li Wang
2025-05-10 09:47:42 +08:00
committed by GitHub
parent 19c8e134e4
commit 218f21de21
4 changed files with 54 additions and 6 deletions

View File

@@ -9,6 +9,17 @@
"num_prompts": 200,
"backend": "vllm"
}
},
{
"test_name": "throughput_qwen2_5_7B_tp1",
"parameters": {
"model": "Qwen/Qwen2.5-7B-Instruct",
"tensor_parallel_size": 1,
"load_format": "dummy",
"dataset_path": "./ShareGPT_V3_unfiltered_cleaned_split.json",
"num_prompts": 200,
"backend": "vllm"
}
}
]