From 0a7c4bded7e5ac9b118180ec49da47a3ef26fb54 Mon Sep 17 00:00:00 2001 From: Shangming Cai Date: Wed, 8 Oct 2025 15:59:29 +0800 Subject: [PATCH] [Doc] Update mooncake nvlink transport doc for PD disaggregation (#11321) Signed-off-by: Shangming Cai --- docs/advanced_features/pd_disaggregation.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/docs/advanced_features/pd_disaggregation.md b/docs/advanced_features/pd_disaggregation.md index d33744713..11afe24aa 100644 --- a/docs/advanced_features/pd_disaggregation.md +++ b/docs/advanced_features/pd_disaggregation.md @@ -121,6 +121,14 @@ python -m sglang.launch_server \ PD Disaggregation with Mooncake supports the following environment variables for fine-grained control over system behavior. +#### NVLink Transport Configuration +To enable NVLink transport for KV cache transfers with the mooncake backend (recommended for NVL72 deployments), set the following environment variables. Note that auxiliary data transfer will still use TCP as a temporary workaround. + +```bash +export SGLANG_MOONCAKE_CUSTOM_MEM_POOL=True +export MC_FORCE_MNNVL=True +``` + #### Prefill Server Configuration | Variable | Description | Default | |:--------:|:-----------:|:--------: