[Feature] model_runner refactor (#4764)

Browse Source

### What this PR does / why we need it?
refactor npu_modelrunner， we should be close to gpu_modelrunner 

### Does this PR introduce _any_ user-facing change?
NO

- vLLM version: v0.12.0
- vLLM main:
ad32e3e19c

---------

Signed-off-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Signed-off-by: zhenwenqi2024 <155598497+zhenwenqi2024@users.noreply.github.com>

...

This commit is contained in:

zhenwenqi2024

2025-12-12 17:27:09 +08:00

committed by GitHub

parent 5b12c068f9

commit f708d919f8

10 changed files with 676 additions and 1815 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

2088

vllm_ascend/worker/model_runner_v1.py

File diff suppressed because it is too large Load Diff