Commit Graph

10 Commits

Author SHA1 Message Date
Arthur Cheng
ff91474825 [Router] Fix k8s Service Discovery (#6766)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
2025-06-02 16:57:23 -07:00
Chao Yang
1a39979993 Sgl-router Prometheus metrics endpoint and usage track metrics (#6537) 2025-05-24 22:28:15 -07:00
Zilin Zhu
669caa0a3f [router] support http2 in router (#6487) 2025-05-21 01:42:45 -07:00
Zilin Zhu
e3bed74afb [router] Add /list_workers endpoint to router (#6366) 2025-05-17 09:49:02 -07:00
Simo Lin
1468769bde [Misc] add service discovery for sgl router 2025-04-29 10:21:19 -07:00
Simo Lin
f0365820e8 [Misc] add structure logging, write to file and log tracing for SGL Router 2025-04-27 16:54:10 -07:00
Yinghai Lu
f4d7ab7a63 [sgl-router] improvement to avoid hang (#4482)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
2025-03-17 10:37:50 -07:00
Byron Hsu
9a0cc2e90e [router] Forward all request headers from router to workers (#3070) 2025-01-23 20:30:31 -08:00
Byron Hsu
0311ce8e1c [router] Expose worker startup secs & Return error instead of panic for router init (#3016) 2025-01-20 12:45:13 -08:00
Ata Fatahi
e3b3acfa6f Rename rust folder to sgl-router (#2464)
Signed-off-by: Ata Fatahi <immrata@gmail.com>
2024-12-12 09:40:41 -08:00