Commit Graph

14 Commits

Author SHA1 Message Date
Tzu Gwo
df246e699d chore: open lto and optimization in release profile (#2028) 2024-11-14 15:02:39 +08:00
Byron Hsu
602ebc661d remove sglang folder in rust (#2010) 2024-11-11 20:45:52 -08:00
Byron Hsu
86c37d010a fix sglang_router not found (#2005) 2024-11-11 15:20:14 -08:00
Byron Hsu
3e33574374 run rust test on ubuntu instead of 1-gpu-runner (#2003) 2024-11-11 14:46:08 -08:00
Byron Hsu
0d94f1dd03 Bump router to 0.0.3 (#2004) 2024-11-11 14:42:22 -08:00
Byron Hsu
239eafbd2e Fix rust unit test and pypi token (#2001) 2024-11-11 14:18:21 -08:00
Byron Hsu
00ffde206f setup router python binding ci (#1999) 2024-11-11 12:19:32 -08:00
Byron Hsu
f9633fa9b9 [rust] cache-aware DP - approx tree (#1934) 2024-11-10 21:57:32 -08:00
Chayenne
c77c1e05ba fix black in pre-commit (#1940) 2024-11-08 07:42:47 +08:00
Austin Liu
4b1d7a2583 Add Rust Router Python Binding (#1891)
Signed-off-by: Austin Liu <austin362667@gmail.com>
Co-authored-by: ByronHsu <byronhsu1230@gmail.com>
2024-11-06 18:08:30 -08:00
Xuehai Pan
a5e0defb5a minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926) 2024-11-06 13:46:04 +00:00
Byron Hsu
96766101b4 [rust] refactor server and router (#1922) 2024-11-06 00:02:02 -08:00
Byron Hsu
530ff541cf [router] Impl radix tree and set up CI (#1893)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2024-11-04 10:56:52 -08:00
Byron Hsu
3839be2913 [Router] Add a rust-based router (#1790) 2024-10-28 09:49:48 -07:00