Commit Graph

11 Commits

Author SHA1 Message Date
Simo Lin
5343058875 [router] grpc router bootstraps (#9759) 2025-08-28 12:07:06 -07:00
Keyang Ru
5ef545e678 [router] Move all protocols to spec.rs file (#9519) 2025-08-22 14:18:47 -07:00
Keyang Ru
ce67b2d586 [router]restructure protocol modules for better organization (#9321) 2025-08-19 01:07:58 +00:00
Jeff Nettleton
ce3ca9b02f [router] add cargo clippy in CI and fix-up linting errors (#9242) 2025-08-17 11:03:56 -07:00
Simo Lin
a69b637014 [router] fix req handling order, improve serialization, remove retry (#8888) 2025-08-06 23:24:39 -07:00
Simo Lin
8c7bb39dfb [router] PD Router Simplification and Reorganization (#8838) 2025-08-05 21:20:38 -07:00
Simo Lin
5d62b56f7e [router] complete router oai spec (#8828) 2025-08-05 18:30:19 -07:00
Simo Lin
f6e07f2796 [router] fix pd model completion request (#8303) 2025-07-23 23:18:29 -07:00
Simo Lin
c8f31042a8 [router] Refactor router and policy traits with dependency injection (#7987)
Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Keru Yang <rukeyang@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Philip Zhu <phlipzhux@gmail.com>
2025-07-18 14:24:24 -07:00
Shuaiyi Zhang
51ae40306a [router] forward stream_options in request (#7860) 2025-07-08 08:03:38 -07:00
Simo Lin
3abc30364d [ci] add router benchmark script and CI (#7498) 2025-06-25 01:28:25 -07:00