Files
enginex-mthreads-vllm/examples/online_serving/disaggregated_serving/README.md
2026-01-19 10:38:50 +08:00

9 lines
274 B
Markdown

# Disaggregated Serving
This example contains scripts that demonstrate the disaggregated serving features of vLLM.
## Files
- `disagg_proxy_demo.py` - Demonstrates XpYd (X prefill instances, Y decode instances).
- `kv_events.sh` - Demonstrates KV cache event publishing.