From 007aeaa48b57c6cde09025c67cf4ce9aab4e0712 Mon Sep 17 00:00:00 2001 From: Yikun Jiang Date: Mon, 10 Mar 2025 11:27:26 +0800 Subject: [PATCH] [Doc] Change distributed_executor_backend to mp (#287) ### What this PR does / why we need it? Fix `ValueError: Unrecognized distributed executor backend tp. Supported values are 'ray', 'mp' 'uni', 'external_launcher' or custom ExecutorBase subclass.` ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Test on my local node Signed-off-by: Yikun Jiang --- docs/source/tutorials/multi_npu.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/tutorials/multi_npu.md b/docs/source/tutorials/multi_npu.md index 9fcd267..c1e5680 100644 --- a/docs/source/tutorials/multi_npu.md +++ b/docs/source/tutorials/multi_npu.md @@ -86,7 +86,7 @@ prompts = [ sampling_params = SamplingParams(temperature=0.6, top_p=0.95, top_k=40) llm = LLM(model="Qwen/QwQ-32B", tensor_parallel_size=4, - distributed_executor_backend="tp", + distributed_executor_backend="mp", max_model_len=4096) outputs = llm.generate(prompts, sampling_params)