Lianmin Zheng
|
d314bf6010
|
Update install.md (#11631)
|
2025-10-14 14:34:46 -07:00 |
|
DarkSharpness
|
e28c9e526f
|
[Minor] Update xgrammar dependency (#11622)
|
2025-10-14 13:46:50 -07:00 |
|
Lianmin Zheng
|
b98cf39866
|
[Auto Sync] Update collector.py (20251014) (#11625)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
|
2025-10-14 13:34:33 -07:00 |
|
Lianmin Zheng
|
27d710457c
|
[Auto Sync] Update scheduler.py, server_args.py (20251014) (#11623)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-10-14 13:20:03 -07:00 |
|
Baizhou Zhang
|
c224a4c6cc
|
Fix log for chunked prefix cache (#11624)
|
2025-10-14 11:49:33 -07:00 |
|
Simo Lin
|
49345a68cf
|
[router] update router readme to latest features (#11619)
|
2025-10-14 11:47:38 -07:00 |
|
strgrb
|
94d26d850d
|
use non_blocking h2d in ForwardBatch.prepare_mlp_sync_batch. (#11605)
|
2025-10-14 11:30:59 -07:00 |
|
Simo Lin
|
9e8a15a74c
|
[router] add chang and keyang to sgl router author (#11620)
|
2025-10-14 11:10:49 -07:00 |
|
Simo Lin
|
3962e39d7c
|
[router] cleanup app context and move to startup (#11617)
|
2025-10-14 10:19:28 -07:00 |
|
Keyang Ru
|
eb8cac6fe2
|
[router] add py binding and readme for openai router and history backend (#11453)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-10-14 09:42:34 -07:00 |
|
Liangsheng Yin
|
5ea96ac7cc
|
Reduce one step decode for draft model. (#11561)
|
2025-10-14 23:52:04 +08:00 |
|
yinghui
|
56222658ec
|
move eagle draft post process to cuda graph (#11434)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2025-10-14 22:50:53 +08:00 |
|
Alex Chi Z
|
dc965db0e0
|
make radix cache deterministic (#10721)
Signed-off-by: Alex Chi Z <iskyzh@gmail.com>
|
2025-10-14 21:01:52 +08:00 |
|
Scott Lee
|
817e46f412
|
Refactor spec decoding metrics calculation into separate TokenizerManager utility function (#11586)
|
2025-10-14 20:45:49 +08:00 |
|
Liangsheng Yin
|
5a33c3aae7
|
Optimize Triton Draft Backend (#11556)
|
2025-10-14 20:08:32 +08:00 |
|
sglang-bot
|
9767a1e41b
|
Update release-docker-dev.yml (#11603)
|
2025-10-14 03:06:48 -07:00 |
|
Sai Enduri
|
1d08653972
|
[AMD CI] Add image and weights caching. (#11593)
|
2025-10-14 02:51:35 -07:00 |
|
Simo Lin
|
a04efc4933
|
[router] when given both local tokenizer and chat template, log all (#11601)
|
2025-10-14 02:22:58 -07:00 |
|
Wenyi Xu
|
642fa966f2
|
[Docs] [Router]: Update sg-router doc on circuit breaker (#11449)
|
2025-10-14 02:18:14 -07:00 |
|
Simo Lin
|
da7fac1b75
|
[router] allow router launch server to use grpc mode (#11600)
|
2025-10-14 01:42:43 -07:00 |
|
Simo Lin
|
28ad2297a0
|
[router] delete useless table content comment in spec (#11597)
|
2025-10-14 01:08:18 -07:00 |
|
Lianmin Zheng
|
f7f9f8eceb
|
Update news section in README.md (#11598)
|
2025-10-14 00:49:39 -07:00 |
|
Simo Lin
|
4b62af92ef
|
[router] change worker api to async instead of sync (#11566)
|
2025-10-14 00:32:21 -07:00 |
|
Simo Lin
|
0b9915c132
|
[router] update generate spec to align with sgl io struct (#11591)
|
2025-10-14 02:51:33 -04:00 |
|
Chang Su
|
27ef1459e6
|
[router][protocols] Add Axum validate extractor and use it for /v1/chat/completions endpoint (#11588)
|
2025-10-13 22:51:15 -07:00 |
|
Qiaolin Yu
|
e4358a4585
|
Add fused_moe_triton config: triton_3_4_0/E=256,N=256,device_name=NVIDIA_B200.json (#11587)
|
2025-10-14 13:24:43 +08:00 |
|
Lianmin Zheng
|
ba2ce28fe9
|
[Auto Sync] Update model_config.py (20251014) (#11580)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
|
2025-10-13 22:16:34 -07:00 |
|
sglang-bot
|
98923880bc
|
chore: bump sgl-kernel version to 0.3.16.post2 (#11583)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2025-10-13 20:52:38 -07:00 |
|
Yineng Zhang
|
f792e3c561
|
Revert "[NVIDIA] BUMP FA3 (#11444)" (#11582)
|
2025-10-13 20:51:45 -07:00 |
|
Chenxi Li
|
28f80b1244
|
Implement LRU eviction policy for LoRA adapters (#11041)
|
2025-10-13 20:18:25 -07:00 |
|
Xiaoyu Zhang
|
88a6f9dab5
|
bench_serving support PD Disaggregation (#11542)
|
2025-10-13 19:43:26 -07:00 |
|
fzyzcjy
|
cb8ed2c09a
|
Make DeepEP combine recv do not overlap (#11535)
|
2025-10-13 18:40:42 -07:00 |
|
Trevor Morris
|
384733639a
|
[DSv32] Use torch.compile for _get_logits_head_gate (#11565)
|
2025-10-13 18:38:39 -07:00 |
|
Neelabh Sinha
|
aaf7af1b17
|
[FEATURE] Add Profile Trace Merger for Distributed Traces (#11413)
|
2025-10-14 09:20:17 +08:00 |
|
Yuwei An
|
932e263725
|
Compilation Folder Reset (#11539)
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
|
2025-10-14 09:19:12 +08:00 |
|
Qiaolin Yu
|
43f80884c5
|
Fix accept rate in speculative decoding metrics (#11572)
|
2025-10-13 16:35:50 -07:00 |
|
sglang-bot
|
60b0503227
|
chore: bump sgl-kernel version to 0.3.16.post1 (#11573)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2025-10-13 16:26:18 -07:00 |
|
Qi Yuhang
|
dc48c4c0e3
|
[sgl-kernel][2/N]Support Expert Specialization Grouped GEMM (#11534)
|
2025-10-13 16:24:48 -07:00 |
|
Arthur Cheng
|
6dc9ca8c85
|
[router] Add BRANCH_TYPE=local support to Dockerfile.router for local builds (#11571)
|
2025-10-13 16:10:51 -07:00 |
|
Chang Su
|
887c2b4575
|
[router][grpc] Add serve_grpc to launch_server and log id for HealthCheck (#11564)
|
2025-10-13 16:07:19 -07:00 |
|
fzyzcjy
|
065ce81574
|
Tiny cleanup fp4 gemm calls (#11537)
|
2025-10-13 14:48:22 -07:00 |
|
Xiaoyu Zhang
|
8e51049f56
|
[CI Monitor] Ci monitor only deal with main branch in default (#11538)
|
2025-10-13 13:50:04 -07:00 |
|
Johnny
|
cb8f3d90d3
|
[NVIDIA] update pyproject.toml to support cu130 option (#11521)
|
2025-10-13 13:03:31 -07:00 |
|
Chang Su
|
4b694e7d5a
|
[router][grpc] Add error handling to generate_tool_constraints (#11562)
|
2025-10-13 12:26:09 -07:00 |
|
Baizhou Zhang
|
9f1f699a7a
|
[CI] Add Basic Test for DeepSeek V3.2 (#11308)
|
2025-10-13 11:41:02 -07:00 |
|
Trevor Morris
|
c9cff2b984
|
Fix DeepSeek-v3.2 default config (ValueError: not enough values to unpack (expected 4, got 3)) (#11557)
|
2025-10-13 11:27:40 -07:00 |
|
Scott Lee
|
b6fb5d7666
|
Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11441)
|
2025-10-13 11:24:27 -07:00 |
|
Jonah Bernard
|
f4aa78801e
|
[router] Add Rust CLI flags for queue size, timeout, and rate limit for token bucket rate limiter (#11483)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2025-10-13 11:08:48 -07:00 |
|
Lianmin Zheng
|
5e3f7e7fa9
|
Minor: improve sampler & remove unused fields from model_config.py (#11531)
|
2025-10-13 11:04:44 -07:00 |
|
Simo Lin
|
728af88781
|
[router] allow user to specify chat template path (#11549)
|
2025-10-13 10:47:57 -07:00 |
|