Commit Graph

18 Commits

Author SHA1 Message Date
Simo Lin
97c3823931 [router] refactor router and worker management 3/n (#10727) 2025-09-22 12:17:50 -07:00
Chang Su
5fe39e85a2 [router] fix router manager and router init in server (#10499) 2025-09-15 22:23:26 -07:00
Keyang Ru
366043db8e [router] Add get and cancel method for response api (#10387) 2025-09-12 16:19:38 -07:00
Frank Fang
4634fd5953 [router] Add Rerank Routing Logic in Regular Router (#10219) 2025-09-12 09:10:18 -07:00
Keyang Ru
a23bdeaf04 [router] Basic OAI Response api (#10346) 2025-09-11 20:56:17 -07:00
Keyang Ru
dee197e11b [router] Add OpenAI backend support - core function (#10254) 2025-09-11 14:13:51 -07:00
Simo Lin
db37422c92 [router] move to mcp sdk instead (#10057) 2025-09-05 18:03:46 -07:00
Simo Lin
d966b902af [router] move tokenizer, reasoning, tool initialization to server (#9996) 2025-09-03 19:35:13 -07:00
Keyang Ru
3f2d0cefcd [router] Add MCP Tool Handler (#9615) 2025-08-27 19:12:39 -07:00
Chang Su
90313fb09a [router] add token bucket rate limiter (#9656) 2025-08-26 10:36:26 -07:00
Simo Lin
78ae175866 [router] add tokenizer benchmark (#9427) 2025-08-21 11:09:39 -07:00
Jeff Nettleton
ce3ca9b02f [router] add cargo clippy in CI and fix-up linting errors (#9242) 2025-08-17 11:03:56 -07:00
Simo Lin
828a4fe944 [router] Implement HTTP Dependency Injection Pattern for Router System (#8714) 2025-08-02 19:16:47 -07:00
Simo Lin
66a398f49d [router] migrate router from actix to axum (#8479) 2025-07-30 17:47:19 -07:00
Rui Chen
a730ce8162 [feature] [sgl-router] Add a dp-aware routing strategy (#6869) 2025-07-30 05:58:48 -07:00
Simo Lin
fe6a445d1e [router] improve router logs and request id header (#8415) 2025-07-27 19:30:19 -07:00
Simo Lin
2f86f3ad62 [router] add endpoint unit test (#8298) 2025-07-23 23:26:44 -07:00
Simo Lin
6f8f4aeea4 [router] add common ut infra to mock worker and app (#8295) 2025-07-23 10:07:51 -07:00