EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

[Doc] Change distributed_executor_backend to mp (#287)

Browse Source 
### What this PR does / why we need it?
Fix `ValueError: Unrecognized distributed executor backend tp. Supported
values are 'ray', 'mp' 'uni', 'external_launcher' or custom ExecutorBase
subclass.`

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
Test on my local node

Signed-off-by: Yikun Jiang <yikunkero@gmail.com>
This commit is contained in:
Yikun Jiang
2025-03-10 11:27:26 +08:00
committed by GitHub
parent 38334f5daa
commit 007aeaa48b
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/tutorials/multi_npu.md
View File

@@ -86,7 +86,7 @@ prompts = [
sampling_params = SamplingParams(temperature=0.6, top_p=0.95, top_k=40) sampling_params = SamplingParams(temperature=0.6, top_p=0.95, top_k=40)
llm = LLM(model="Qwen/QwQ-32B", llm = LLM(model="Qwen/QwQ-32B",
tensor_parallel_size=4, tensor_parallel_size=4,
distributed_executor_backend="tp", distributed_executor_backend="mp",
max_model_len=4096) max_model_len=4096)
outputs = llm.generate(prompts, sampling_params) outputs = llm.generate(prompts, sampling_params)