[CI] Align multi-node nightly test paramter with corresponding tutorials document (#5756)
### What this PR does / why we need it?
Align multi-node nightly test paramter with tutorials documents.
### Does this PR introduce _any_ user-facing change?
NA
### How was this patch tested?
Test locally and nighly e2e multi-node test cases.
- vLLM version: v0.13.0
- vLLM main:
2f4e6548ef
---------
Signed-off-by: leo-pony <nengjunma@outlook.com>
This commit is contained in:
@@ -27,7 +27,7 @@ deployment:
|
||||
--enable-expert-parallel
|
||||
--max-num-seqs 128
|
||||
--max-model-len 40960
|
||||
--max-num-batched-tokens 256
|
||||
--max-num-batched-tokens 2048
|
||||
--trust-remote-code
|
||||
--gpu-memory-utilization 0.9
|
||||
--async-scheduling
|
||||
@@ -44,7 +44,7 @@ deployment:
|
||||
--seed 1024
|
||||
--max-num-seqs 128
|
||||
--max-model-len 40960
|
||||
--max-num-batched-tokens 256
|
||||
--max-num-batched-tokens 2048
|
||||
--enable-expert-parallel
|
||||
--trust-remote-code
|
||||
--gpu-memory-utilization 0.9
|
||||
|
||||
Reference in New Issue
Block a user