ab51fcea4c
### What this PR does / why we need it?
add single node PD disaggregation instructions for Qwen 2.5VL model.
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
- vLLM version: v0.11.0
- vLLM main:
2918c1b49c
---------
Signed-off-by: mazhixin <mazhixin7@huawei.com>
Signed-off-by: mazhixin000 <mazhixinkorea@163.com>
Co-authored-by: mazhixin <mazhixin7@huawei.com>
27 lines
508 B
Markdown
27 lines
508 B
Markdown
# Tutorials
|
|
|
|
:::{toctree}
|
|
:caption: Deployment
|
|
:maxdepth: 1
|
|
single_npu
|
|
single_npu_qwen2.5_vl
|
|
single_npu_qwen2_audio
|
|
single_npu_qwen3_embedding
|
|
single_npu_qwen3_quantization
|
|
single_npu_qwen3_w4a4
|
|
single_node_pd_disaggregation_llmdatadist
|
|
multi_npu_qwen3_next
|
|
multi_npu
|
|
multi_npu_moge
|
|
multi_npu_qwen3_moe
|
|
multi_npu_quantization
|
|
single_node_300i
|
|
DeepSeek-V3.2-Exp.md
|
|
multi_node
|
|
multi_node_kimi
|
|
multi_node_qwen3vl
|
|
multi_node_pd_disaggregation_llmdatadist
|
|
multi_node_pd_disaggregation_mooncake
|
|
multi_node_ray
|
|
:::
|