Commit Graph

14 Commits

Author SHA1 Message Date
Simo Lin
c495833186 [router] leverage RAII to actively cancel request during client disconnect (#11399) 2025-10-10 20:43:38 -04:00
Simo Lin
88bb627d0d [router] change grpc client from mutable to clone (#11394) 2025-10-09 11:00:24 -07:00
Simo Lin
368fd20622 [router][grpc] disable health check generation and increase timeout (#11353) 2025-10-08 19:23:08 -07:00
Simo Lin
f4affd4df5 [router] fix grpc connection conversion and add optimization (#11305) 2025-10-07 10:39:33 -07:00
Simo Lin
2fcd56eaf6 [router] add get server info and get model info in grpc server (#11303) 2025-10-07 08:36:52 -07:00
Chang Su
a578d300ba [router][grpc] Fix proto3 default value mismatches and cleanup unused fields (#11283) 2025-10-06 18:54:51 -07:00
Simo Lin
5ee777c98f [router] add ipv6 support across all components (#11219) 2025-10-06 08:16:59 -07:00
Simo Lin
d736e0b65e [router] add grpc router pd mode for chat and generate (#11140) 2025-10-04 06:58:28 -07:00
Simo Lin
33b3c0f85f [router] grpc router generate endpoint support (#11070)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-09-29 22:07:53 -07:00
Chang Su
0c3db88978 [router][grpc] Add helpfer functions for decoder in router.rs and fix specs (#10971) 2025-09-26 20:10:45 -04:00
Simo Lin
aae7ead2d0 [router] remove old/oudated/useless comments across code base (#10968) 2025-09-26 10:48:50 -07:00
Simo Lin
1e57b9472d [router] add grpc client get and set (#10955) 2025-09-26 03:07:05 -07:00
Chang Su
37158f2018 router: Support parallel sampling num > 1 in grpc_server and non-stream handling (#10929) 2025-09-25 20:03:35 -07:00
Chang Su
5e21d6aec0 refactor: Move grpc/client.rs to grpc_client/sglang_scheduler.rs (#10924) 2025-09-25 17:21:22 -04:00