EngineX/xc-llm-ascend

Files

History

Ronald d96440924a adapt to main2main for model runner v2 (#7578 )

### What this PR does / why we need it?
This PR aims to adapt to newest commit of vllm main branch for model
runner v2. please refer to
https://github.com/vllm-project/vllm-ascend/issues/5208
### Does this PR introduce _any_ user-facing change?
no

### How was this patch tested?

- vLLM version: v0.18.0
- vLLM main:
ed359c497a

---------

Signed-off-by: Ronald1995 <ronaldautomobile@163.com>

2026-03-25 09:08:44 +08:00

..

adapt to main2main for model runner v2 (#7578 )

2026-03-25 09:08:44 +08:00

[model_runner_v2]optimize the performance of the _topk_log_softmax_kernel (#7221 )

2026-03-16 16:49:10 +08:00

[Feature] support aclgraph for model runner v2 (#7110 )

2026-03-13 09:11:46 +08:00

__init__.py

implement model runner v2 basic framework (#5051 )

2025-12-18 15:51:54 +08:00

aclgraph_utils.py

adapt to main2main for model runner v2 (#7578 )

2026-03-25 09:08:44 +08:00

attn_utils.py

[Feature] support aclgraph for model runner v2 (#7110 )

2026-03-13 09:11:46 +08:00

block_table.py

[model_runner_v2]:optimize the performance of the _compute_slot_mappings_kernel (#7575 )

2026-03-24 17:29:14 +08:00

input_batch.py

adapt to main2main for model runner v2 (#7578 )

2026-03-25 09:08:44 +08:00

model_runner.py

adapt to main2main for model runner v2 (#7578 )

2026-03-25 09:08:44 +08:00

README.md

adapt to main2main for model runner v2 (#7578 )

2026-03-25 09:08:44 +08:00

states.py

[Feature] support aclgraph for model runner v2 (#7110 )

2026-03-13 09:11:46 +08:00

utils.py

adapt to main2main for model runner v2 (#7578 )

2026-03-25 09:08:44 +08:00

README.md

[Experimental] Model Runner V2

This directory contains the new model runner which is under active development.

please see Model Runner V2 to get specific plans.

supported vllm version: main@ed359c497a728f08b5b41456c07a688ccd510fbc related PR: https://github.com/vllm-project/vllm-ascend/pull/7598