Commit Graph

225 Commits

Author SHA1 Message Date
sogalin
4b7034ddb0 ROCm 7.0 update (#9757) 2025-08-28 22:24:34 -07:00
Yineng Zhang
bc80dc4ce0 chore: bump v0.5.1.post3 (#9716) 2025-08-27 15:42:42 -07:00
fzyzcjy
44ffe2cb72 Install py-spy by default for containers for easier debugging (#9649) 2025-08-26 10:40:52 -07:00
Yineng Zhang
bf863e3bbf fix: use sgl-kernel 0.3.5 (#9565) 2025-08-24 15:46:47 -07:00
gongwei-130
fb107cfd75 feat: allow use local branch to build image (#9546) 2025-08-23 16:38:30 -07:00
kk
988accbc1e Update docker file for supporting PD-Disaggregation on MI300x (#9494)
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Colin Wang <kangwang@amd.com>
2025-08-21 23:48:40 -07:00
Yineng Zhang
b6b2287e4b chore: bump sgl-kernel v0.3.6.post2 (#9475) 2025-08-21 23:02:08 -07:00
Chang Su
7638f5e44e [router] Implement gRPC SGLangSchedulerClient (#9364) 2025-08-19 16:44:11 -07:00
Yineng Zhang
a1c7f742f9 chore: bump sgl-kernel v0.3.6.post1 (#9286) 2025-08-17 16:26:17 -07:00
Even Zhou
fda762a27d [Bugfix] Change vLLM install order & Add A2 support (#9232) 2025-08-16 22:36:14 -07:00
Yineng Zhang
87dab54824 Revert "chore: bump sgl-kernel v0.3.6 (#9220)" (#9247) 2025-08-15 17:24:36 -07:00
Yineng Zhang
5121af4627 Revert "chore(docker): update sgl_kernel version to 0.3.6 in Dockerfi… (#9246) 2025-08-15 17:19:38 -07:00
ishandhanani
e52c3866eb chore(docker): update sgl_kernel version to 0.3.6 in Dockerfile.gb200 (#9243) 2025-08-15 12:06:52 -07:00
Yineng Zhang
c186feed7f chore: bump sgl-kernel v0.3.6 (#9220) 2025-08-15 02:50:50 -07:00
fzyzcjy
f8644a5632 Tiny update tmux history limit on dev container (#9218) 2025-08-15 00:22:08 -07:00
fzyzcjy
392de007cb Minor fix docker container DeepEP on multi platforms (#9205) 2025-08-14 17:41:49 -07:00
Yineng Zhang
1fea998a45 chore: bump sgl-kernel v0.3.5 (#9185) 2025-08-14 03:20:48 -07:00
fzyzcjy
b3363cc1aa Fix docker container DeepEP error on Blackwell (#9171) 2025-08-13 21:06:48 -07:00
Yineng Zhang
71fb8c9527 feat: update fa3 (#9126) 2025-08-13 20:07:08 +08:00
kk
35e6bc92e3 Update docker file for MI35x base image update to support gpt-oss mxfp4 model (#9111)
Co-authored-by: wunhuang <wunhuang@amd.com>
2025-08-13 00:55:31 -07:00
Yineng Zhang
924827c3de chore: use cp310 (#9130) 2025-08-12 15:33:22 -07:00
Yineng Zhang
c81daf838d fix: update Dockerfile (#9129) 2025-08-12 15:01:29 -07:00
li chaoran
2ecbd8b8bf [feat] add ascend readme and docker release (#8700)
Signed-off-by: mywaaagh_admin <pkwarcraft@gmail.com>
Signed-off-by: lichaoran <pkwarcraft@gmail.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2025-08-12 13:25:42 -07:00
Yineng Zhang
305b27c124 fix: update Dockerfile (#9125) 2025-08-12 13:23:10 -07:00
ishandhanani
1f9ec65374 fix(docker): update sgl_kernel version to 0.3.4 in Dockerfile.gb200 (#9118) 2025-08-12 13:12:33 -07:00
Yineng Zhang
3a9afe2a42 chore: bump sgl-kernel v0.3.4 (#9103) 2025-08-12 01:48:47 -07:00
ishandhanani
9f24dfefd1 chore(gb200): remove ToT flashinfer installation (#9079) 2025-08-11 11:02:15 -07:00
Yi Zhang
89f1d4f536 update deepep commit to support qwen3-coder (#9066) 2025-08-11 10:42:33 -07:00
Yineng Zhang
48b8b4c124 fix nvshmem cu126 (#9001) 2025-08-09 03:34:54 -07:00
ishandhanani
4e7f025219 chore(gb200): update to CUDA 12.9 and improve build process (#8772) 2025-08-08 13:42:47 -07:00
Yineng Zhang
41357e511b chore: update flashinfer (#8958) 2025-08-08 02:15:22 -07:00
Yineng Zhang
54ea57f245 chore: bump sgl-kernel v0.3.3 (#8957) 2025-08-08 01:35:37 -07:00
Yineng Zhang
cbbd685a46 chore: use torch 2.8 stable (#8880) 2025-08-06 15:51:40 -07:00
Mick
01c99a9959 chore: update Dockerfile (#8872)
Co-authored-by: zhyncs <me@zhyncs.com>
2025-08-06 09:30:33 -07:00
Yineng Zhang
4ef47839ae feat: use py312 (#8832) 2025-08-05 13:38:22 -07:00
Yineng Zhang
0a56b721d5 chore: bump sgl-kernel v0.2.9 (#8713) 2025-08-02 16:21:56 -07:00
ishandhanani
b27b11919c chore(gb200): update dockerfile to handle fp4 disaggregation (#8694) 2025-08-01 18:58:00 -07:00
Cheng Wan
6c88f6c8d9 [5/N] MoE Refactor: Update MoE parallelism arguments (#8658) 2025-08-01 01:20:03 -07:00
Yineng Zhang
43118f5f2a chore: bump sgl-kernel v0.2.8 (#8599) 2025-07-30 22:23:52 -07:00
Charles Chen
659bfd1023 Add GKE's default CUDA runtime lib location to PATH and LD_LIBRARY_PATH. (#8544) 2025-07-30 20:28:07 -07:00
TimWang
2e1d2d7e66 Add PVC and update resource limits in k8s config (#8489) 2025-07-28 23:15:31 -07:00
kyleliang-nv
bb81daefb8 Fix docker buildx push error (#8425) 2025-07-27 17:59:38 -07:00
kyleliang-nv
e6312d271d Uodate Dockerfile.gb200 to latest sglang (#8356) 2025-07-26 00:22:06 -07:00
Yineng Zhang
7181ec8cfc fix: upgrade nccl version (#8359) 2025-07-25 14:59:02 -07:00
Shangming Cai
70e37b97bf chore: upgrade mooncake 0.3.5 (#8341)
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
2025-07-25 01:17:26 -07:00
Yineng Zhang
4c605235aa fix: workaround for deepgemm warmup issue (#8302) 2025-07-23 12:01:51 -07:00
Yineng Zhang
429bb0efa2 chore: bump sgl-kernel v0.2.6.post1 (#8200) 2025-07-20 19:50:28 -07:00
Yineng Zhang
2db6719cc5 feat: update nccl 2.27.6 (#8182) 2025-07-19 22:55:45 -07:00
kyleliang-nv
bfdd226f35 Fix Dockerfile.gb200 (#8169) 2025-07-19 14:37:53 -07:00
Yineng Zhang
f98e88b9fb chore: bump sgl-kernel v0.2.6 (#8165) 2025-07-19 00:56:18 -07:00