Drop VLLM_USE_V1 usage. This env has been removed from vLLM already. - vLLM version: v0.11.0 - vLLM main: https://github.com/vllm-project/vllm/commit/83f478bb19489b41e9d208b47b4bb5a95ac171ac Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
This PR puts the calculation of shared experts into a separate stream, overlaping with routing experts. - vLLM version: v0.10.2 - vLLM main: https://github.com/vllm-project/vllm/commit/fbd6523ac00082c398dc8126434cede595169609 --------- Signed-off-by: whx-sjtu <2952154980@qq.com>
This PR re-implements external-dp starter based on vllm's support for external dp. - vLLM version: v0.10.1.1 - vLLM main: https://github.com/vllm-project/vllm/commit/f38035c123b32f239f746585e197e7250694a1ca --------- Signed-off-by: whx-sjtu <2952154980@qq.com>