Commit Graph

9 Commits

Author SHA1 Message Date
Byron Hsu
a4cca7fc53 [router] Add retries based fault tolerance (#2452) 2024-12-11 12:13:08 -08:00
Byron Hsu
a1e697b25b [router] Improve cleanup logic (#2411) 2024-12-08 15:24:02 -08:00
Byron Hsu
ef995dae1e [router] Health check on worker before adding to the router (#2392) 2024-12-07 15:39:54 -08:00
Byron Hsu
c36736c841 [router] Add remove worker api (#2380) 2024-12-06 17:16:03 -08:00
Byron Hsu
499c85f131 [Router] remove duplicate char count (#2378) 2024-12-06 11:26:07 -08:00
Byron Hsu
67b657945a [router] support /add_worker api (#2369) 2024-12-06 01:17:04 -08:00
Byron Hsu
64fceab8af [router] use 2-gpu-runner (#2368) 2024-12-06 14:13:57 +08:00
Lianmin Zheng
d4fc1a70e3 Crash the server correctly during error (#2231) 2024-11-28 00:22:39 -08:00
Byron Hsu
1f76fc6e3f [router] Rust e2e test (#2184) 2024-11-25 16:02:03 -08:00