Ronald b69b04d3a9 implement model runner v2 basic framework (#5051) ...

### What this PR does / why we need it?
This PR aim to implement model runner v2 basic framework in vllm-ascend,
the e2e function is not guaranteed by this pr.
 
### Does this PR introduce _any_ user-facing change?
use envs.VLLM_USE_V2_MODEL_RUNNER to decide if choose model_runenr_v2.

### How was this patch tested?

- vLLM version: v0.12.0
- vLLM main:
ad32e3e19c

---------

Signed-off-by: Ronald1995 <ronaldautomobile@163.com>

2025-12-18 15:51:54 +08:00

..

_cann_ops_custom

[Kernel] add custom op GmmSwigluQuantWeightNzTensorList (#3804)

2025-11-28 18:06:39 +08:00

attention

[Refactor] 4/N Distinguish the branches based on the applicable scenarios of PA and FIA Ops. (#5081)

2025-12-17 23:14:02 +08:00

compilation

enable npugraph_ex (#5120)

2025-12-18 09:08:40 +08:00

core

[bugfix][refactor] fix recompute_scheduler break with vllm 0.12.0 & support async scheduling & refactor recompute_scheduler.py (#4895)

2025-12-11 22:24:49 +08:00

device_allocator

[Misc]Clean up useless import from vllm (#2049)

2025-07-28 16:01:59 +08:00

distributed

[BugFix] Fix mooncake bug in PCP scenario (#5055)

2025-12-17 16:32:16 +08:00

eplb

[Misc] Upgrade vllm hash to 12_14 (#5000)

2025-12-15 19:54:23 +08:00

kv_offload

upgrade vLLM to main (#4608)

2025-12-02 22:10:52 +08:00

lora

[refact] unified soc_version code (#4359)

2025-11-26 14:28:55 +08:00

model_loader

[CI] speed up ut (#4901)

2025-12-11 18:45:43 +08:00

ops

fixed fused alltoall execute all reduce (#5109)

2025-12-18 15:07:40 +08:00

patch

qwen3_next add triton ops : fused_qkvzba_split_reshape (#4788)

2025-12-18 11:31:04 +08:00

quantization

[model] Support PanguUltraMoE (#4615)

2025-12-17 16:15:29 +08:00

sample

[Feat] Refactor rejection sampler (#4975)

2025-12-16 11:32:26 +08:00

spec_decode

[Fix] Fix DeepSeek V3.2 "no attr" error (#5147)

2025-12-18 14:46:41 +08:00

worker

implement model runner v2 basic framework (#5051)

2025-12-18 15:51:54 +08:00

xlite

implement model runner v2 basic framework (#5051)

2025-12-18 15:51:54 +08:00

__init__.py

clean up model module (#4611)

2025-12-02 17:35:47 +08:00

ascend_config.py

enable npugraph_ex (#5120)

2025-12-18 09:08:40 +08:00

ascend_forward_context.py

[Bugfix][MoE] Remove All2All in w4a8_dynamic (#4977)

2025-12-17 17:39:57 +08:00

cpu_binding.py

[main] support cpu binding (#3546)

2025-10-21 09:17:03 +08:00

envs.py

[Feat] Add custom Embedding tensor model parallel (#2616)

2025-12-12 14:41:20 +08:00

flash_common3_context.py

[Perf]enable prefill flashcommon3 (#4065)

2025-12-14 09:34:13 +08:00

meta_registration.py

Fix the bugs about operator registration by PyTorch Dispatcher (#2786)

2025-09-13 11:58:52 +08:00

platform.py

implement model runner v2 basic framework (#5051)

2025-12-18 15:51:54 +08:00

profiling_config.py

Drop ascend scheduler (#4623)

2025-12-05 09:03:45 +08:00

utils.py

[main] rename device type (#5099)

2025-12-17 14:08:19 +08:00