e6625bb582
### What this PR does / why we need it?
v0.11.0rc1 will introduce w4a4 quantization feature, so add this
tutorial.
### Does this PR introduce _any_ user-facing change?
No
- vLLM version: v0.11.0
- vLLM main:
83f478bb19
Signed-off-by: 22dimensions <waitingwind@foxmail.com>
466 B
466 B
Tutorials
:::{toctree} :caption: Deployment :maxdepth: 1 single_npu single_npu_qwen2.5_vl single_npu_qwen2_audio single_npu_qwen3_embedding single_npu_qwen3_quantization single_npu_qwen3_w4a4 multi_npu_qwen3_next multi_npu multi_npu_moge multi_npu_qwen3_moe multi_npu_quantization single_node_300i DeepSeek-V3.2-Exp.md multi_node multi_node_kimi multi_node_qwen3vl multi_node_pd_disaggregation_llmdatadist multi_node_pd_disaggregation_mooncake multi_node_ray :::