Commit Graph

223 Commits

Author SHA1 Message Date
Yineng Zhang
f983213a1f update pr-test (#3663) 2025-02-18 17:23:43 +08:00
Yineng Zhang
07ab4d4a2d fix #3654 2025-02-18 15:16:16 +08:00
saienduri
522e18eaeb Update amd docker image. (#3654) 2025-02-17 20:12:55 -08:00
Yineng Zhang
e319153be8 update unit test (#3636) 2025-02-17 21:06:10 +08:00
saienduri
7474bed883 Update to latest amd image. (#3597) 2025-02-17 00:29:47 +08:00
Shi Shuai
7443197a63 [CI] Improve Docs CI Efficiency (#3587)
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
2025-02-14 19:57:00 -08:00
Yineng Zhang
70f894b810 feat: support flashinfer mla attention for deepseek v3 (#3550) 2025-02-14 08:50:14 +08:00
Jackmin801
5f0e7de339 [Feat] Return hidden states (experimental) (#3364)
Co-authored-by: Chayenne <zhaochen20@outlook.com>
2025-02-10 15:54:37 -08:00
Yineng Zhang
4fe92bfca5 fix mla test (#3469) 2025-02-10 21:12:00 +08:00
Yineng Zhang
d87272750b fix ci (#3441) 2025-02-10 04:22:28 +08:00
Yineng Zhang
4cfd3add6d support version in sgl-kernel (#3439) 2025-02-10 03:49:52 +08:00
Yineng Zhang
5da3d21c8b update pr-test ci (#3376) 2025-02-07 21:08:35 +08:00
Yineng Zhang
2b1808cec4 update unit test in AMD CI (#3366) 2025-02-07 17:25:16 +08:00
Chayenne
76ca91dff2 Docs/CI: Enable Fake Finish for Docs Only PR (#3350) 2025-02-06 19:33:31 -08:00
saienduri
200d3b1608 Add sgl-kernel to MI300 CI paths tested. (#3335)
Co-authored-by: HAI <hixiao@gmail.com>
2025-02-06 00:45:38 -08:00
saienduri
2d9c319594 Docker switch (#3327)
Co-authored-by: HAI <hixiao@gmail.com>
2025-02-05 18:06:50 -08:00
saienduri
04d8cd2088 Initial Enablement of CI on MI300 (#3168) 2025-02-05 10:45:12 -08:00
Yineng Zhang
d39899e85c upgrade flashinfer v0.2.0.post2 (#3288)
Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>
2025-02-04 21:41:40 +08:00
HAI
566d61d90f ROCm: bump 6.3.0 (#3259) 2025-02-03 04:13:40 +08:00
Yineng Zhang
b49d6d0fee support 12.5 CUDA runtime (#3231) 2025-01-31 20:31:38 +08:00
Jhin
7b9b4f4426 Docs fix about EAGLE and streaming output (#3166)
Co-authored-by: Chayenne <zhaochenyang@ucla.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Jhin <jhinpan@umich.edu>
2025-01-27 18:10:45 -08:00
Yineng Zhang
827aa8730b cleanup sgl-kernel kernels (#3175) 2025-01-27 19:11:01 +08:00
Yineng Zhang
f265d15b96 use self-hosted to build sgl-kernel (#3154) 2025-01-26 23:02:57 +08:00
Lianmin Zheng
4a61253123 Do not load OPENAI_KEY from secrets (#3147) 2025-01-26 01:54:03 -08:00
Lianmin Zheng
4f118a39d7 Fix repetition penalty (#3139) 2025-01-25 21:48:58 -08:00
Yineng Zhang
822bae8c00 feat: cross python wheel for sgl-kernel (#3138) 2025-01-26 13:21:34 +08:00
Lianmin Zheng
da6f8081f6 Fix CI tests (#3132) 2025-01-25 17:43:39 -08:00
Yineng Zhang
896c07441e update installation doc for sgl-kernel (#3129) 2025-01-26 00:00:13 +08:00
Ke Bao
67ad4338e1 Update tag name for whl release (#3127) 2025-01-25 23:14:35 +08:00
Yineng Zhang
3cab5f71ea speedup pr test for sgl-kernel (#3126) 2025-01-25 21:37:48 +08:00
Ke Bao
665e5e85f6 Add step to update sgl-kernel whl index (#3110) 2025-01-25 02:03:01 +08:00
Ke Bao
a22f60a313 Add workflow for sgl-kernel cu118 release (#3109) 2025-01-24 22:30:30 +08:00
Byron Hsu
3ed0a547b2 [router] Fix twine uploading (#3095) 2025-01-23 21:01:01 -08:00
Yineng Zhang
0da0989ad4 sync flashinfer and update sgl-kernel tests (#3081) 2025-01-23 21:13:55 +08:00
Yineng Zhang
3d0bfa3e17 update version setup for sgl-kernel (#3079) 2025-01-23 19:45:25 +08:00
Yineng Zhang
1f6cf0d4b9 fix build error for sgl-kernel (#3078) 2025-01-23 19:16:35 +08:00
Yineng Zhang
3e032c07cc use v0.6.4.post1 for sgl-kernel ci (#3071) 2025-01-23 14:19:38 +08:00
Yineng Zhang
bcda0c9ee6 sync the upstream updates of flashinfer (#3051) 2025-01-22 20:33:13 +08:00
Yineng Zhang
a42213dbd4 fix pr-test-sgl-kernel (#3036) 2025-01-22 00:56:42 +08:00
Yineng Zhang
5a0d680a14 feat: add flashinfer as 3rdparty and use rmsnorm as example (#3033) 2025-01-21 20:44:49 +08:00
Lianmin Zheng
a4331cd260 Add accuracy and latency tests of eagle into CI (#3027) 2025-01-21 02:55:14 -08:00
Yineng Zhang
ec1c21cdc4 upgrade torch version for sgl-kernel (#3026) 2025-01-21 14:32:08 +08:00
Yineng Zhang
6c856b4f3a minor: update Makefile for sgl-kernel (#3025) 2025-01-21 13:08:15 +08:00
Ke Bao
41a0ccd4f1 Add clang-format check to sgl-kernel ci (#3012) 2025-01-20 23:22:19 +08:00
Lianmin Zheng
09bcbe0123 Update TypeBasedDispatcher and balance CI tests (#3001) 2025-01-19 23:37:27 -08:00
Lianmin Zheng
cd493b5afc Improve metrics, logging, and importing orders (#2992) 2025-01-19 18:36:59 -08:00
Byron Hsu
4719c1d04a [router] Fix sgl router path for release (#2980) 2025-01-19 01:11:06 -08:00
Byron Hsu
ef18b0eda2 [router] Allow empty worker list for sglang.launch_router (#2979) 2025-01-19 01:05:23 -08:00
Ke Bao
f3e9b4894b Fix sgl-kernel ci (#2938) 2025-01-17 17:26:21 +08:00
Lianmin Zheng
6a7973add8 Update release-docs.yml (#2937) 2025-01-17 00:36:40 -08:00