[Docs] [Router]: Update sg-router doc on circuit breaker (#11449)
This commit is contained in:
@@ -225,6 +225,25 @@ python -m sglang_router.launch_router \
|
|||||||
--cb-window-duration-secs 60
|
--cb-window-duration-secs 60
|
||||||
```
|
```
|
||||||
|
|
||||||
|
```mermaid
|
||||||
|
flowchart TD
|
||||||
|
Closed(["Closed"])
|
||||||
|
Open(["Open"])
|
||||||
|
HalfOpen(["HalfOpen"])
|
||||||
|
|
||||||
|
Closed -- "Consecutive Failures >=<br/>cb-failure-threshold" --> Open;
|
||||||
|
Closed --> HalfOpen;
|
||||||
|
linkStyle 1 stroke:transparent;
|
||||||
|
Open -- "After cb-timeout-duration-secs" --> HalfOpen;
|
||||||
|
HalfOpen -- "Fail any test request" --> Open;
|
||||||
|
HalfOpen -- "After cb-success-threshold<br/>test requests" --> Closed;
|
||||||
|
Closed -- "Failures < cb-failure-threshold" --> Closed;
|
||||||
|
style Closed fill:#00C853,color:#000000
|
||||||
|
style Open fill:#D50000,color:#000000
|
||||||
|
style HalfOpen fill:#FFD600,color:#000000
|
||||||
|
linkStyle 1 stroke:transparent,fill:none
|
||||||
|
```
|
||||||
|
|
||||||
**Behavior**:
|
**Behavior**:
|
||||||
- Worker is marked unhealthy after `cb-failure-threshold` consecutive failures
|
- Worker is marked unhealthy after `cb-failure-threshold` consecutive failures
|
||||||
- Returns to service after `cb-success-threshold` successful health checks
|
- Returns to service after `cb-success-threshold` successful health checks
|
||||||
|
|||||||
Reference in New Issue
Block a user