### What this PR does / why we need it? Optimize the performance of the triton operator _topk_log_softmax_kernel in model_runner_v2 to 1.04xH100,which is 7% of its original value.(issue https://github.com/vllm-project/vllm-ascend/issues/5208) - vLLM version: v0.16.0 - vLLM main: https://github.com/vllm-project/vllm/commit/4034c3d32e30d01639459edd3ab486f56993876d --------- Signed-off-by: wangx700 <wangxin700@huawei.com>
[Experimental] Model Runner V2
This directory contains the new model runner which is under active development.
please see Model Runner V2 to get specific plans.
supported vllm version: main@4034c3d32e30d01639459edd3ab486f56993876d related PR: https://github.com/vllm-project/vllm-ascend/pull/7110