Liangsheng Yin
|
4a762041d7
|
move environ into sglang.srt to avoid break SRT auto sync. (#10791)
|
2025-09-23 02:04:20 -07:00 |
|
Lianmin Zheng
|
ea338676b5
|
Clean up server args (#10770)
|
2025-09-23 00:22:32 -07:00 |
|
ishandhanani
|
b06db198ba
|
followup: clean up dockerfiles and release yamls (#10783)
|
2025-09-23 00:19:46 -07:00 |
|
Yineng Zhang
|
8c1ef0f914
|
chore: upgrade sgl-kernel 0.3.12 (#10782)
|
2025-09-23 00:18:54 -07:00 |
|
Liangsheng Yin
|
f5a2faf2b8
|
Introduce FutureMap (#10715)
|
2025-09-22 23:27:30 -07:00 |
|
ishandhanani
|
1c82d9db28
|
feat: unify dockerfiles (#10705)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
|
2025-09-22 23:23:48 -07:00 |
|
Lifu Huang
|
9241f4fd20
|
Move cached kernel to srt.utils (#10776)
|
2025-09-22 23:00:36 -07:00 |
|
fzyzcjy
|
063c3791fe
|
Fix trtllm_mla slow concat kernel in MTP (#10777)
|
2025-09-22 22:47:49 -07:00 |
|
Liangsheng Yin
|
632b7d8cc9
|
Use simulate acc len from sglang.environ (#10771)
|
2025-09-23 12:59:50 +08:00 |
|
Chang Su
|
16adf3dcab
|
[router] fix logger type mismatch (#10774)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2025-09-22 21:02:28 -07:00 |
|
Simo Lin
|
c3a1d7759f
|
[router] remove pd router draining channel (#10767)
|
2025-09-22 20:49:33 -07:00 |
|
Simo Lin
|
89971c4c3c
|
[router] refactor router and worker management 4/n (#10756)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-09-22 18:35:10 -07:00 |
|
Lianmin Zheng
|
113f8f65a2
|
[Auto Sync] Update configurer.py (20250923) (#10765)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2025-09-22 17:34:34 -07:00 |
|
ronnie_zheng
|
e22f3a5ec9
|
[Ascend]optimize Qwen3 on Ascend (#10574)
Co-authored-by: c30031083 <chenxu140@huawei.com>
|
2025-09-22 17:18:36 -07:00 |
|
ronnie_zheng
|
095093ee5a
|
[Ascend] optimize Qwen-vl on Ascend (#10556)
Co-authored-by: wangqihui01 <wangqh10@163.com>
|
2025-09-22 17:18:16 -07:00 |
|
Even Zhou
|
d27a6f7092
|
[Feature] Add MLAProcess for DeepSeek MLA on NPU (#10130)
|
2025-09-22 17:17:48 -07:00 |
|
Yineng Zhang
|
0753ef831e
|
[Auto Sync] Update flashattention_backend.py (20250922) (#10762)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Gordon Gustafson <ggustafson@together.ai>
|
2025-09-22 16:41:42 -07:00 |
|
ishandhanani
|
662393f27d
|
fix: kv events with tp > 1 (#10541)
|
2025-09-22 15:55:44 -07:00 |
|
pranavm-nvidia
|
b1bb8e7490
|
Enables TRT-LLM backend to be used for target_verify (#10281)
Co-authored-by: Pranav Marathe <pranavm@ipp1-3309.ipp1a1.colossus.nvidia.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
|
2025-09-22 15:54:00 -07:00 |
|
Lianmin Zheng
|
38c00ed7a1
|
Fix multimodal registry and code sync scripts (#10759)
Co-authored-by: cctry <shiyang@x.ai>
|
2025-09-22 15:36:01 -07:00 |
|
pansicheng
|
d4041a5eeb
|
refactor zero copy (#10300)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2025-09-22 15:17:31 -07:00 |
|
Vedant Jhaveri
|
2f555c4cee
|
[Generative Score API] Added test_scores_api.py to github CICD to run per commit (#10755)
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Sundara Raman Ramachandran <sundar24295@gmail.com>
|
2025-09-22 14:41:57 -07:00 |
|
Yineng Zhang
|
e53df7c009
|
chore: bump sgl-kernel v0.3.12 (#10732)
|
2025-09-22 14:39:25 -07:00 |
|
Jue WANG
|
9c53dad809
|
Fix MTP MoE weight loading with NVFP4 target model. (#10758)
|
2025-09-22 14:21:57 -07:00 |
|
Simo Lin
|
7ca1bea63d
|
[router] update ci so only execute benchmarks when labels are added (#10757)
|
2025-09-22 13:23:07 -07:00 |
|
Simo Lin
|
97c3823931
|
[router] refactor router and worker management 3/n (#10727)
|
2025-09-22 12:17:50 -07:00 |
|
Chang Su
|
60dbbd086a
|
bugfix: Fix get_worker_urls_for_model in http/router.rs (#10754)
|
2025-09-22 14:10:31 -04:00 |
|
Baizhou Zhang
|
aa1c5cf5bd
|
Add warnings and remove dependency for deterministic inference (#10724)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
|
2025-09-22 10:56:02 -07:00 |
|
Adarsh Shirawalmath
|
592caab66a
|
[Docs, minor] Fix LLM doc matrix (#10753)
|
2025-09-23 01:29:55 +08:00 |
|
Lifu Huang
|
2101d93b4f
|
Fix CI TestChunkedSGMV (#10737)
|
2025-09-22 16:09:58 +08:00 |
|
Shangming Cai
|
70e4b21853
|
Fix flaky logprobs test (#10728)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-22 00:46:26 -07:00 |
|
feng397
|
944f1ea0ec
|
fix capture_bs when speculative decoding enabled (#10730)
|
2025-09-22 00:43:12 -07:00 |
|
Yingchun Lai
|
9d7e82a0ab
|
EPLB: prefer to use physical experts in the same node (#9849)
|
2025-09-22 00:34:30 -07:00 |
|
Yang Yu
|
f05805515b
|
Convert FLASHINFER_WORKSPACE_SIZE to integer (#10731)
|
2025-09-22 00:26:42 -07:00 |
|
Lifu Huang
|
635ccda673
|
[4/4] Introduce CachedKernel to reduce CSGMV kernel launch overheads by 60% (#10709)
|
2025-09-21 22:26:42 -07:00 |
|
ronnie_zheng
|
1c3dbad8fe
|
[Ascend] codeowner updates for ascend related files (#10699)
|
2025-09-21 19:47:01 -07:00 |
|
Qiaolin Yu
|
e2ac7888b8
|
[2/2] Support deterministic inference for temperature > 0 (#10678)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
|
2025-09-21 19:36:08 -07:00 |
|
Stefan He
|
86527a4799
|
[deterministic inference] Move batch invariant pkg to sglang (#10695)
|
2025-09-21 19:35:14 -07:00 |
|
Ethan (Yusheng) Su
|
134b4f7ec2
|
Support deterministic inference with triton backend (#10694)
|
2025-09-22 09:20:40 +08:00 |
|
Yineng Zhang
|
f67d1f45bc
|
[Auto Sync] Update deepseek_v2.py (20250922) (#10717)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Michael Granado <mgranado@together.ai>
|
2025-09-21 17:43:50 -07:00 |
|
Qi Yuhang
|
0f04a5f428
|
Optimize cutlass int8 gemm kernel for large M on SM89 Ada GPU (#10714)
|
2025-09-21 17:04:27 -07:00 |
|
Yineng Zhang
|
2f18602f13
|
fix: disable gpt-oss b200 ut (#10716)
|
2025-09-21 17:02:25 -07:00 |
|
Jimmy
|
56321e9fc2
|
[Router]fix: fix get_load missing api_key (#10385)
|
2025-09-21 15:28:38 -04:00 |
|
Xinyuan Tong
|
12d6cf18f0
|
Refactors radix cache for extra key support (#10317)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-09-22 02:16:16 +08:00 |
|
sglang-bot
|
fc3e542009
|
Update release-docs.yml (#10706)
|
2025-09-21 00:22:21 -07:00 |
|
Lifu Huang
|
08ecd0aa2a
|
[3/4] Speed up CSGMV backend perf by 10% through dynamic chunking + kernel optimization (#10592)
|
2025-09-20 22:47:48 -07:00 |
|
fzyzcjy
|
720c1c8ca3
|
Super tiny fix extra logs (#10697)
|
2025-09-20 21:30:54 -07:00 |
|
Yineng Zhang
|
d403c143e3
|
feat: update server args (#10696)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-09-20 18:52:19 -07:00 |
|
Stefan He
|
cba0d8c309
|
[Feature] Support deterministic inference with FA3 backend (#10651)
|
2025-09-20 17:50:21 -07:00 |
|
Yineng Zhang
|
f1d7892318
|
[Auto Sync] Update modelopt_quant.py (20250920) (#10688)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2025-09-20 02:37:49 -07:00 |
|