Commit Graph

15 Commits

Author SHA1 Message Date
Yinghai Lu
f4d7ab7a63 [sgl-router] improvement to avoid hang (#4482)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
2025-03-17 10:37:50 -07:00
Byron Hsu
8cc300f536 Fix router test (#4483) 2025-03-16 22:49:47 -07:00
Michael Feil
37373ef2bb sgl-router - issues on routing and project build. (#3870) (#3948) 2025-03-04 04:06:30 -08:00
Byron Hsu
3ed0a547b2 [router] Fix twine uploading (#3095) 2025-01-23 21:01:01 -08:00
Byron Hsu
8d8ef8497e bump router to 0.1.4 (#3094) 2025-01-23 20:32:43 -08:00
Byron Hsu
9a0cc2e90e [router] Forward all request headers from router to workers (#3070) 2025-01-23 20:30:31 -08:00
Byron Hsu
5de50653cd [router] make error actionable (#3063) 2025-01-22 17:56:21 -08:00
Byron Hsu
3ad4cd4915 bump router to 0.1.3 (#3020) 2025-01-20 14:38:06 -08:00
Byron Hsu
3a8428ecaa [router] Expose worker startup interval (#3019) 2025-01-20 14:36:54 -08:00
Byron Hsu
0311ce8e1c [router] Expose worker startup secs & Return error instead of panic for router init (#3016) 2025-01-20 12:45:13 -08:00
Lianmin Zheng
03464890e0 Separate two entry points: Engine and HTTP server (#2996)
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
2025-01-19 22:09:24 -08:00
Lianmin Zheng
cd493b5afc Improve metrics, logging, and importing orders (#2992) 2025-01-19 18:36:59 -08:00
Byron Hsu
ef18b0eda2 [router] Allow empty worker list for sglang.launch_router (#2979) 2025-01-19 01:05:23 -08:00
Yineng Zhang
41d7e5b7e6 docs: update link (#2857) 2025-01-13 18:40:48 +08:00
Ata Fatahi
e3b3acfa6f Rename rust folder to sgl-router (#2464)
Signed-off-by: Ata Fatahi <immrata@gmail.com>
2024-12-12 09:40:41 -08:00