Commit Graph

14 Commits

Author SHA1 Message Date
Chang Su
9a0cac1be0 [router] add grpc pd and regular router init (#9893) 2025-09-01 20:06:15 -07:00
Chang Su
90313fb09a [router] add token bucket rate limiter (#9656) 2025-08-26 10:36:26 -07:00
Keyang Ru
3828db4309 [router] Add IGW (Inference Gateway) Feature Flag (#9371)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
2025-08-20 17:38:57 -07:00
Jeff Nettleton
ce3ca9b02f [router] add cargo clippy in CI and fix-up linting errors (#9242) 2025-08-17 11:03:56 -07:00
Simo Lin
21b8846066 [router] allow more health check configuration (#9198) 2025-08-15 08:07:45 -07:00
Simo Lin
9d68bdb240 [router] Add Rust Binary Entrypoint for SGLang Router (#9089) 2025-08-11 21:37:36 -07:00
Simo Lin
067068f271 [router] regular router circuit breaker (#8997) 2025-08-10 21:19:30 -07:00
Simo Lin
61a4680494 [router] router circuit breaker core (#8941) 2025-08-08 09:20:22 -07:00
Simo Lin
354ac43555 [pd-router] Add Configurable Retry Logic for reduce backend pressure (#8744) 2025-08-04 20:42:07 -07:00
Simo Lin
828a4fe944 [router] Implement HTTP Dependency Injection Pattern for Router System (#8714) 2025-08-02 19:16:47 -07:00
Simo Lin
66a398f49d [router] migrate router from actix to axum (#8479) 2025-07-30 17:47:19 -07:00
Rui Chen
a730ce8162 [feature] [sgl-router] Add a dp-aware routing strategy (#6869) 2025-07-30 05:58:48 -07:00
Simo Lin
fe6a445d1e [router] improve router logs and request id header (#8415) 2025-07-27 19:30:19 -07:00
Simo Lin
2f86f3ad62 [router] add endpoint unit test (#8298) 2025-07-23 23:26:44 -07:00