Bruce-x-1997
|
9e169ea8b5
|
[router] add right rustls dependency in sgl-router cargo.toml (#9498)
Co-authored-by: bruce.xu <bruce.xu@gmicloud.ai>
|
2025-08-24 09:03:15 -07:00 |
|
Chang Su
|
816c4c8572
|
[router] add tool parser base structure and partial json parser (#9482)
|
2025-08-21 22:08:56 -07:00 |
|
Simo Lin
|
78ae175866
|
[router] add tokenizer benchmark (#9427)
|
2025-08-21 11:09:39 -07:00 |
|
Simo Lin
|
5fbad308cd
|
[router] add tokenizer chat template support (#9370)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-08-19 20:14:02 -07:00 |
|
Chang Su
|
7638f5e44e
|
[router] Implement gRPC SGLangSchedulerClient (#9364)
|
2025-08-19 16:44:11 -07:00 |
|
Simo Lin
|
0b95a01a8f
|
[router] add tiktokenizer and sequence in router (#9354)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-08-19 10:46:28 -07:00 |
|
Simo Lin
|
d08663eec1
|
[router] tokenizer factory, hf tokenizer, and stop sequence detector (#9293)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-08-17 22:38:38 -07:00 |
|
Simo Lin
|
ff0cf51c8e
|
[router] introducing tokenizer trait (#9287)
|
2025-08-17 16:30:01 -07:00 |
|
Simo Lin
|
6337d9057c
|
[router] optimize Rust compilation and development workflow (#9133)
|
2025-08-13 05:14:25 -07:00 |
|
Simo Lin
|
9d68bdb240
|
[router] Add Rust Binary Entrypoint for SGLang Router (#9089)
|
2025-08-11 21:37:36 -07:00 |
|
Simo Lin
|
ce9cf35327
|
[router] update pyo3 version to 0.25.1 (#9022)
|
2025-08-10 06:45:51 -07:00 |
|
Simo Lin
|
473400e452
|
[router] upgrade kube version to latest (#9018)
|
2025-08-09 22:49:45 -07:00 |
|
Simo Lin
|
dd665f967f
|
[router] upgrade rand to latest version (#9017)
|
2025-08-09 22:49:30 -07:00 |
|
Tien Nguyen
|
fd05b56750
|
refactor(sgl-router): Replace once_cell with LazyLock in worker.rs and remove once_cell dependency from Cargo.toml (#8698)
|
2025-08-07 06:14:03 -07:00 |
|
Simo Lin
|
66a398f49d
|
[router] migrate router from actix to axum (#8479)
|
2025-07-30 17:47:19 -07:00 |
|
Simo Lin
|
6f8f4aeea4
|
[router] add common ut infra to mock worker and app (#8295)
|
2025-07-23 10:07:51 -07:00 |
|
Simo Lin
|
f2d5c4920e
|
[router] add worker abstraction (#7960)
|
2025-07-11 20:17:48 -07:00 |
|
Simo Lin
|
c071198c1d
|
[router] add centralized configuration module for sgl-router (#7588)
|
2025-06-27 15:42:02 -07:00 |
|
Simo Lin
|
3abc30364d
|
[ci] add router benchmark script and CI (#7498)
|
2025-06-25 01:28:25 -07:00 |
|
Simo Lin
|
30f2a44a96
|
[misc] Add PD service discovery support in router (#7361)
|
2025-06-22 17:54:14 -07:00 |
|
Simo Lin
|
09ae5b20f3
|
Merge PDLB (Prefill-Decode Load Balancer) into SGLang Router (#7096)
|
2025-06-19 02:28:15 +08:00 |
|
Arthur Cheng
|
ff91474825
|
[Router] Fix k8s Service Discovery (#6766)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2025-06-02 16:57:23 -07:00 |
|
Chao Yang
|
1a39979993
|
Sgl-router Prometheus metrics endpoint and usage track metrics (#6537)
|
2025-05-24 22:28:15 -07:00 |
|
Simo Lin
|
771669cbe0
|
[fix]: PyO3 macOS linking and consolidate on tracing for logging
|
2025-04-29 11:26:38 -07:00 |
|
Simo Lin
|
1468769bde
|
[Misc] add service discovery for sgl router
|
2025-04-29 10:21:19 -07:00 |
|
Simo Lin
|
f0365820e8
|
[Misc] add structure logging, write to file and log tracing for SGL Router
|
2025-04-27 16:54:10 -07:00 |
|
Michael Feil
|
37373ef2bb
|
sgl-router - issues on routing and project build. (#3870) (#3948)
|
2025-03-04 04:06:30 -08:00 |
|
Ata Fatahi
|
e3b3acfa6f
|
Rename rust folder to sgl-router (#2464)
Signed-off-by: Ata Fatahi <immrata@gmail.com>
|
2024-12-12 09:40:41 -08:00 |
|