EngineX-Mthreads/enginex-mthreads-vllm
4
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
5aef6c175a8d269aca60083adaa5a565eb911c72
enginex-mthreads-vllm/examples/online_serving/disaggregated_serving/README.md
xiezhongtao 5aef6c175a Sync from v0.13
2026-01-19 10:38:50 +08:00

274 B
Raw Blame History

Disaggregated Serving

This example contains scripts that demonstrate the disaggregated serving features of vLLM.

Files

  • disagg_proxy_demo.py - Demonstrates XpYd (X prefill instances, Y decode instances).
  • kv_events.sh - Demonstrates KV cache event publishing.