xc-llm-ascend/vllm_ascend/worker/v2/README.md

# [Experimental] Model Runner V2

This directory contains the new model runner which is under active development.

please see [Model Runner V2](https://github.com/vllm-project/vllm-ascend/issues/5208)
to get specific plans.

supported vllm version: main@1339784
[Feature] support eager mode in model runner v2 (#5210) ### What this PR does / why we need it? #5051 only implement a basic framework for model runner v2, but there are still some bugs for e2e functionality, this PR aim to enable basic functionality. model runner v2 plans: https://github.com/vllm-project/vllm-ascend/issues/5208 - vLLM version: release/v0.13.0 - vLLM main: https://github.com/vllm-project/vllm/commit/ad32e3e19ccf0526cb6744a5fed09a138a5fb2f9 --------- Signed-off-by: Ronald1995 <ronaldautomobile@163.com> 2025-12-29 15:28:34 +08:00			`# [Experimental] Model Runner V2`

			`This directory contains the new model runner which is under active development.`

			`please see [Model Runner V2](https://github.com/vllm-project/vllm-ascend/issues/5208)`
			`to get specific plans.`
[Feature] adapt to uva buffer and main2main (#6657) ### What this PR does / why we need it? vllm model runner v2 use uva buffer to prepare input data, but npu doesn't support uva yet, this pr implement a uvawrapper class to mimic gpu's uva backend. what's more, this pr make some modifications to adapt to the newer main branch. ### Does this PR introduce _any_ user-facing change? no ### How was this patch tested? - vLLM main: https://github.com/vllm-project/vllm/commit/13397841ab469cecf1ed425c3f52a9ffc38139b5 --------- Signed-off-by: Ronald1995 <ronaldautomobile@163.com> 2026-02-12 10:36:31 +08:00
			`supported vllm version: main@1339784`