weiguihua2 0dca4c6dbd refact runner model v1 (#2461) ...

refact model runner v1

### What this PR does / why we need it?
1. Separate the execute model logic from the prepare input logic
2. Disassemble the torchchair in model runner v1

- vLLM version: v0.10.0
- vLLM main:
68fcd3fa73

---------

Signed-off-by: weiguihua2 <weiguihua2@huawei.com>

2025-08-21 08:54:57 +08:00

..

attention

Fix some ci issue and refactor modelrunner (#2445)

2025-08-20 09:01:04 +08:00

compilation

Fix some ci issue and refactor modelrunner (#2445)

2025-08-20 09:01:04 +08:00

core

Disaggregate prefill for kv cache register style (#950)

2025-07-26 17:15:47 +08:00

device_allocator

[Misc]Clean up useless import from vllm (#2049)

2025-07-28 16:01:59 +08:00

distributed

[PD] Correct the ip and port env (#2450)

2025-08-20 11:39:05 +08:00

lora

Fix some ci issue and refactor modelrunner (#2445)

2025-08-20 09:01:04 +08:00

models

[improve] Remove redundant parentheses in pangu_moe.py (#2081)

2025-08-19 11:00:18 +08:00

multistream

[Quickfix] update CachedRequestState as NewRequestData changed (#2367)

2025-08-15 07:35:27 +08:00

ops

refactor allgather/mc2-related fused_experts (#2369)

2025-08-20 14:20:46 +08:00

patch

[Quickfix] update CachedRequestState as NewRequestData changed (#2367)

2025-08-15 07:35:27 +08:00

quantization

[main][quantization] Adapt to the new format of ds w4a8 weight (#2392)

2025-08-20 20:25:18 +08:00

sample

[Perf][MTP] Optimize reject sampler in greedy situation. (#2137)

2025-08-11 17:37:49 +08:00

torchair

refact runner model v1 (#2461)

2025-08-21 08:54:57 +08:00

worker

refact runner model v1 (#2461)

2025-08-21 08:54:57 +08:00

__init__.py

Bump torch version to 2.7.1 (#1562)

2025-08-05 08:43:24 +08:00

ascend_config.py

[main][bugfix] Modify the default value of the enable_shared_pert_dp to false (#2457)

2025-08-20 20:25:53 +08:00

ascend_forward_context.py

Fix some ci issue and refactor modelrunner (#2445)

2025-08-20 09:01:04 +08:00

envs.py

[PD] Correct the ip and port env (#2450)

2025-08-20 11:39:05 +08:00

meta_registration.py

Fix some ci issue and refactor modelrunner (#2445)

2025-08-20 09:01:04 +08:00

platform.py

Fix some ci issue and refactor modelrunner (#2445)

2025-08-20 09:01:04 +08:00

utils.py

[CustomOp] Register RMSNorm instead of overwrite forward_oot (#2284)

2025-08-14 17:18:30 +08:00