We'll release 0.13.0 soon. The main branch is freeze. Let's revert the newest change and redo it once 0.13.0 is released. - vLLM version: release/v0.13.0 - vLLM main: 81786c8774 Signed-off-by: realliujiaxu <realliujiaxu@163.com>
81786c8774
with_prefill
set_ascend_forward_context