EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity
5,747 Commits 8 Branches 0 Tags
2fcd56eaf6d71c8d73af0ae385956599d363cd34
Commit Graph

5747 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Simo Lin
2fcd56eaf6 [router] add get server info and get model info in grpc server (#11303) 2025-10-07 08:36:52 -07:00
Wenyi Xu
0958a39704 [Docs] [Router] Update Observability and Common Issues Section (#11302) 2025-10-07 08:03:09 -07:00
Yuan Luo
4f42c8cd3e [sgl-kernel] Support float64 moe_sum_reduce cuda kernel (#11068) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-10-07 14:31:11 +00:00
Liangsheng Yin
3ddd7dc9f8 Introduce future indices (#11301) 2025-10-07 22:24:02 +08:00
Liangsheng Yin
501dfa6b42 Remove sampling info events and overlap thread file (#11300) 2025-10-07 21:34:25 +08:00
Simo Lin
79d3495177 [router] add reasoning and tool parser argument in router (#11290) 2025-10-07 09:08:32 -04:00
Liangsheng Yin
1519a89cfd Remove overlap thread (#11210) 
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
 2025-10-07 20:12:12 +08:00
Ke Bao
24bc3fb0f9 EAGLE cache fix for SWARadixCache (#11231) 
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
 2025-10-07 18:21:37 +08:00
Liangsheng Yin
8a8a608af9 [ci] fix pp test (#11294) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-10-07 14:20:04 +08:00
Al-Ekram Elahee Hridoy
533e58a15d Feature/longbench v2 evaluation utils (#10949) 2025-10-07 14:17:31 +08:00
Alex Chi Z
9b4c449735 convert test_deterministic into unit tests (#11095) 
Signed-off-by: Alex Chi Z <iskyzh@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2025-10-06 20:33:11 -07:00
Chang Su
a578d300ba [router][grpc] Fix proto3 default value mismatches and cleanup unused fields (#11283) 2025-10-06 18:54:51 -07:00
sglang-bot
8c9670375f chore: bump sgl-kernel version to 0.3.15 (#11281) 2025-10-06 18:17:51 -07:00
Yineng Zhang
fb27d38305 docs: update sgl-kernel README (#11286) 2025-10-06 17:55:22 -07:00
Xinyuan Tong
fd8a0b29c0 fix: correct scale parameter remapping logic in Llama4ForConditionalGeneration (#11282) 2025-10-06 17:28:23 -07:00
Chenxi Li
afc35ccc5e Fix LoRA support for multimodal models (VLMs) by implementing a consistent pattern for skipping vision components (#11261) 2025-10-06 17:23:00 -07:00
sunxxuns
a57f0e3d56 reverse the amd ci test back to 1200s and split the 8-gpu deepseek job into two. (#11238) 
Co-authored-by: root <root@smci350-zts-gtu-e17-15.zts-gtu.dcgpu>
 2025-10-06 19:27:57 -04:00
Lianmin Zheng
708f4ff490 Rename max_micro_batch_size -> pp_max_micro_batch_size (#11279) 2025-10-06 15:50:56 -07:00
Lianmin Zheng
e2daeb351c [Auto Sync] Update test_utils.py (20251006) (#11280) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>
 2025-10-06 15:49:57 -07:00
Lianmin Zheng
0e7b353009 Fix code sync scripts (#11276) 2025-10-06 15:35:01 -07:00
Chang Su
b07c9c76c5 [router][grpc] Refine streaming processes (#11277) 2025-10-06 15:15:01 -07:00
Lifu Huang
748f86f3de [Bug] Fix incorrect assertion in FA4 and add UT. (#11182) 2025-10-06 14:58:39 -07:00
ishandhanani
73ea484af1 docker: add manifest to versioned docker releases (#11268) 2025-10-06 14:53:40 -07:00
gongwei-130
4aeb193fbd disable sm100 for FlashMLA and fast-hadamard-transform in cuda12.6.1 (#11274) 2025-10-06 14:48:31 -07:00
Chang Su
466992b2d0 [router][tool call] Clean up redundant detect_format and has_tool_markers (#11270) 2025-10-06 14:04:02 -07:00
Zhiyu
155cbb51f0 Enable native ModelOpt quantization support (1/3) (#7149) 
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
 2025-10-06 13:24:15 -07:00
Lianmin Zheng
eb30b888db Remove env var warnings for release (#11262) 2025-10-06 10:09:17 -07:00
Simo Lin
5ee777c98f [router] add ipv6 support across all components (#11219) 2025-10-06 08:16:59 -07:00
sglang-bot
a4a3d82393 chore: bump SGLang version to 0.5.3 (#11263) 2025-10-06 20:07:02 +08:00
sglang-bot
0b13cbb7c9 chore: bump SGLang version to 0.5.3rc2 (#11259) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2025-10-06 01:12:10 -07:00
fzyzcjy
efbc687c28 Support DeepSeek V3.2 Exp (#11061) 
Co-authored-by: Stefan He <11166516+hebiao064@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <95566987+hnyls2002@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <56809903+fridge003@users.noreply.github.com>
Co-authored-by: DarkSharpness <76582120+darksharpness@users.noreply.github.com>
Co-authored-by: ZhengdQin <46387172+zhengdqin@users.noreply.github.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Zhengda Qin <zhengdqin@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2025-10-06 00:24:15 -07:00
Baizhou Zhang
292a867ad9 Add flashmla and fast hadamard transform to Dockerfile (#11235) 2025-10-05 21:31:28 -07:00
Kangyan-Zhou
8fd41eae93 Improve bot release workflow (#11240) 2025-10-05 21:28:27 -07:00
Xinyuan Tong
0cd1996eae feat: add shortcut detection for multimodal templates in Jinja format (#11209) 2025-10-06 04:13:17 +00:00
Lianmin Zheng
b6b4b56395 Update condition for sgl-kernel-benchmark-test (#11254) 2025-10-05 20:55:02 -07:00
Lianmin Zheng
f8924ad74b update sgl kernel version to 0.3.14.post1 (#11242) 2025-10-05 20:30:40 -07:00
fzyzcjy
2f80bd9f0e Bump torch_memory_saver 0.0.9rc2 (#11252) 2025-10-05 20:26:20 -07:00
Lianmin Zheng
366a603e95 Use cu128 for torch audio to fix some CI tests (#11251) 2025-10-05 19:52:32 -07:00
Bowen Bao
baee08601b [quantization] Enable aiter mxfp4 fused_moe for Quark (#10048) 
Co-authored-by: HaiShaw <hixiao@gmail.com>
 2025-10-05 19:51:34 -07:00
Bowen Bao
c7a104c12b [quantization] Fix scale remapping for mllama4 (#10042) 
Co-authored-by: HAI <hixiao@gmail.com>
 2025-10-05 19:51:15 -07:00
Mick
97d966a7f8 ci: make find_local_hf_snapshot_dir more robust (#11248) 2025-10-05 19:50:11 -07:00
sglang-bot
8e66d87f0a Fix spec_utils.py (#11247) 2025-10-05 19:01:11 -07:00
Kangyan-Zhou
a20fc7b7dc Create two new GH workflows to automatically bump SGLang and Kernel version (#10996) 2025-10-05 18:14:05 -07:00
Lianmin Zheng
6b30e097ab [Auto Sync] Update io_struct.py (20251004) (#11206) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: jzhou-xai <jzhou@x.ai>
 2025-10-05 18:06:07 -07:00
Lianmin Zheng
d645ae90a3 Rename runner labels (#11228) 2025-10-05 18:05:41 -07:00
Cheng Wan
41763ba079 Remove gdrcopy check in ci_install_deepep.sh (#11237) 2025-10-05 17:35:22 -07:00
Xinyuan Tong
652c24a653 Update transformers package version to 4.57.0 (#11222) 
Co-authored-by: yhyang201 <yhyang201@gmail.com>
 2025-10-05 23:45:14 +00:00
sunxxuns
5e142484e2 [Fix AMD CI] VRAM cleanup (#11174) 
Co-authored-by: root <root@smci350-zts-gtu-e17-15.zts-gtu.dcgpu>
 2025-10-05 19:03:53 -04:00
Shangming Cai
c560410da7 Refactor and optimize mooncake CI (#11162) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2025-10-05 14:08:52 -07:00
Yuan Luo
590f2da052 [Feat] Support Torch Symm Mem AllReduce (#10571) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-10-05 13:55:19 -07:00