From 642fa966f28278a9f5ee7f83cb9d9f4a0729ed5e Mon Sep 17 00:00:00 2001 From: Wenyi Xu Date: Tue, 14 Oct 2025 17:18:14 +0800 Subject: [PATCH] [Docs] [Router]: Update sg-router doc on circuit breaker (#11449) --- docs/advanced_features/router.md | 19 +++++++++++++++++++ 1 file changed, 19 insertions(+) diff --git a/docs/advanced_features/router.md b/docs/advanced_features/router.md index f2bb68942..2f4496104 100644 --- a/docs/advanced_features/router.md +++ b/docs/advanced_features/router.md @@ -225,6 +225,25 @@ python -m sglang_router.launch_router \ --cb-window-duration-secs 60 ``` +```mermaid +flowchart TD + Closed(["Closed"]) + Open(["Open"]) + HalfOpen(["HalfOpen"]) + + Closed -- "Consecutive Failures >=
cb-failure-threshold" --> Open; + Closed --> HalfOpen; + linkStyle 1 stroke:transparent; + Open -- "After cb-timeout-duration-secs" --> HalfOpen; + HalfOpen -- "Fail any test request" --> Open; + HalfOpen -- "After cb-success-threshold
test requests" --> Closed; + Closed -- "Failures < cb-failure-threshold" --> Closed; + style Closed fill:#00C853,color:#000000 + style Open fill:#D50000,color:#000000 + style HalfOpen fill:#FFD600,color:#000000 + linkStyle 1 stroke:transparent,fill:none +``` + **Behavior**: - Worker is marked unhealthy after `cb-failure-threshold` consecutive failures - Returns to service after `cb-success-threshold` successful health checks