[Main2Main] Upgrade vllm commit to 1230 (#5495)
### What this PR does / why we need it?
Upgrade vllm commit to 1230
Affected by https://github.com/vllm-project/vllm/pull/27614 (and the
core PR https://github.com/vllm-project/vllm/pull/26866), we have to
make the following changes:
1. Modify `tests/e2e/multicard/test_aclgraph_capture_replay.py` to keep
compatible with both vllm version of `v0.13.0` and latest main commitID,
while vllm enables async scheduling by default
2. Skip `test_guided_decoding.py` due to xgrammar errors
(https://github.com/vllm-project/vllm-ascend/issues/5524)
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
- vLLM version: v0.13.0
- vLLM main:
45c1ca1ca1
---------
Signed-off-by: wjunLu <wjunlu217@gmail.com>
This commit is contained in:
@@ -107,6 +107,8 @@ def _run_worker_process(
|
||||
quantization="ascend" if "W8A8" in model_path else None,
|
||||
enable_expert_parallel=True if "DeepSeek" in model_path else False,
|
||||
trust_remote_code=True,
|
||||
# vllm enables async scheduling by default, remove below when vllm >= 0.14.0
|
||||
async_scheduling=False,
|
||||
)
|
||||
|
||||
# Expose model config to the main test process
|
||||
|
||||
Reference in New Issue
Block a user