EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

[Benchmark] Correctly kill vllm process in performance benchamrk (#2782)

Browse Source 
### What this PR does / why we need it?
vLLM now names the process with VLLM prefix after
https://github.com/vllm-project/vllm/pull/21445, we should kill the
correct process name after one iteration benchmark to avoid OOM issue
### Does this PR introduce _any_ user-facing change?

### How was this patch tested?

- vLLM version: v0.10.1.1
- vLLM main:
e599e2c65e

---------

Signed-off-by: wangli <wangli858794774@gmail.com>
This commit is contained in:
Li Wang
2025-09-07 10:36:34 +08:00
committed by GitHub
parent a746f8274f
commit 2967e5e22a
2 changed files with 5 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
benchmarks/scripts/run-performance-benchmarks.sh
View File

@@ -78,7 +78,9 @@ kill_npu_processes() {
ps -aux ps -aux
lsof -t -i:8000 | xargs -r kill -9 lsof -t -i:8000 | xargs -r kill -9
pgrep python3 | xargs -r kill -9 pgrep python3 | xargs -r kill -9
# vLLM now names the process with VLLM prefix after https://github.com/vllm-project/vllm/pull/21445
pgrep VLLM | xargs -r kill -9
sleep 4 sleep 4
rm -rf ~/.config/vllm rm -rf ~/.config/vllm

3
benchmarks/tests/serving-tests.json
View File

@@ -23,7 +23,8 @@
"hf_split": "train", "hf_split": "train",
"endpoint": "/v1/chat/completions", "endpoint": "/v1/chat/completions",
"dataset_path": "lmarena-ai/vision-arena-bench-v0.1", "dataset_path": "lmarena-ai/vision-arena-bench-v0.1",
"num_prompts": 200 "num_prompts": 200,
"no_stream": ""
} }
}, },
{ {