Simo Lin
|
39fe1e880d
|
[router] add request format unit test (#8300)
|
2025-07-24 14:30:37 -07:00 |
|
Simo Lin
|
33c4b4d04e
|
[router] add streaming unit test (#8299)
|
2025-07-24 14:30:27 -07:00 |
|
Simo Lin
|
2f86f3ad62
|
[router] add endpoint unit test (#8298)
|
2025-07-23 23:26:44 -07:00 |
|
Simo Lin
|
f6e07f2796
|
[router] fix pd model completion request (#8303)
|
2025-07-23 23:18:29 -07:00 |
|
Simo Lin
|
6f8f4aeea4
|
[router] add common ut infra to mock worker and app (#8295)
|
2025-07-23 10:07:51 -07:00 |
|
Simo Lin
|
5c8365a051
|
[router] add ut for pd router (#8208)
|
2025-07-20 23:12:52 -07:00 |
|
Simo Lin
|
c8f31042a8
|
[router] Refactor router and policy traits with dependency injection (#7987)
Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Keru Yang <rukeyang@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Philip Zhu <phlipzhux@gmail.com>
|
2025-07-18 14:24:24 -07:00 |
|
Simo Lin
|
f2d5c4920e
|
[router] add worker abstraction (#7960)
|
2025-07-11 20:17:48 -07:00 |
|
Shuaiyi Zhang
|
51ae40306a
|
[router] forward stream_options in request (#7860)
|
2025-07-08 08:03:38 -07:00 |
|
Simo Lin
|
3abc30364d
|
[ci] add router benchmark script and CI (#7498)
|
2025-06-25 01:28:25 -07:00 |
|
Simo Lin
|
30f2a44a96
|
[misc] Add PD service discovery support in router (#7361)
|
2025-06-22 17:54:14 -07:00 |
|
Simo Lin
|
09ae5b20f3
|
Merge PDLB (Prefill-Decode Load Balancer) into SGLang Router (#7096)
|
2025-06-19 02:28:15 +08:00 |
|