Commit Graph

4 Commits

Author SHA1 Message Date
Simo Lin
f6e07f2796 [router] fix pd model completion request (#8303) 2025-07-23 23:18:29 -07:00
Simo Lin
c8f31042a8 [router] Refactor router and policy traits with dependency injection (#7987)
Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Keru Yang <rukeyang@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Philip Zhu <phlipzhux@gmail.com>
2025-07-18 14:24:24 -07:00
Shuaiyi Zhang
51ae40306a [router] forward stream_options in request (#7860) 2025-07-08 08:03:38 -07:00
Simo Lin
3abc30364d [ci] add router benchmark script and CI (#7498) 2025-06-25 01:28:25 -07:00