Commit Graph

7 Commits

Author SHA1 Message Date
Simo Lin
a69b637014 [router] fix req handling order, improve serialization, remove retry (#8888) 2025-08-06 23:24:39 -07:00
Simo Lin
8c7bb39dfb [router] PD Router Simplification and Reorganization (#8838) 2025-08-05 21:20:38 -07:00
Simo Lin
5d62b56f7e [router] complete router oai spec (#8828) 2025-08-05 18:30:19 -07:00
Simo Lin
f6e07f2796 [router] fix pd model completion request (#8303) 2025-07-23 23:18:29 -07:00
Simo Lin
c8f31042a8 [router] Refactor router and policy traits with dependency injection (#7987)
Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Keru Yang <rukeyang@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Philip Zhu <phlipzhux@gmail.com>
2025-07-18 14:24:24 -07:00
Shuaiyi Zhang
51ae40306a [router] forward stream_options in request (#7860) 2025-07-08 08:03:38 -07:00
Simo Lin
3abc30364d [ci] add router benchmark script and CI (#7498) 2025-06-25 01:28:25 -07:00