Commit Graph

15 Commits

Author SHA1 Message Date
Chao Yang
1a39979993 Sgl-router Prometheus metrics endpoint and usage track metrics (#6537) 2025-05-24 22:28:15 -07:00
Zilin Zhu
669caa0a3f [router] support http2 in router (#6487) 2025-05-21 01:42:45 -07:00
Zilin Zhu
e3bed74afb [router] Add /list_workers endpoint to router (#6366) 2025-05-17 09:49:02 -07:00
applesaucethebun
2ce8793519 Add typo checker in pre-commit (#6179)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
2025-05-11 12:55:00 +08:00
Simo Lin
771669cbe0 [fix]: PyO3 macOS linking and consolidate on tracing for logging 2025-04-29 11:26:38 -07:00
Simo Lin
1468769bde [Misc] add service discovery for sgl router 2025-04-29 10:21:19 -07:00
Simo Lin
f0365820e8 [Misc] add structure logging, write to file and log tracing for SGL Router 2025-04-27 16:54:10 -07:00
Yinghai Lu
f4d7ab7a63 [sgl-router] improvement to avoid hang (#4482)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
2025-03-17 10:37:50 -07:00
Byron Hsu
8cc300f536 Fix router test (#4483) 2025-03-16 22:49:47 -07:00
Michael Feil
37373ef2bb sgl-router - issues on routing and project build. (#3870) (#3948) 2025-03-04 04:06:30 -08:00
Byron Hsu
9a0cc2e90e [router] Forward all request headers from router to workers (#3070) 2025-01-23 20:30:31 -08:00
Byron Hsu
5de50653cd [router] make error actionable (#3063) 2025-01-22 17:56:21 -08:00
Byron Hsu
3a8428ecaa [router] Expose worker startup interval (#3019) 2025-01-20 14:36:54 -08:00
Byron Hsu
0311ce8e1c [router] Expose worker startup secs & Return error instead of panic for router init (#3016) 2025-01-20 12:45:13 -08:00
Ata Fatahi
e3b3acfa6f Rename rust folder to sgl-router (#2464)
Signed-off-by: Ata Fatahi <immrata@gmail.com>
2024-12-12 09:40:41 -08:00