Commit Graph

1985 Commits

Author SHA1 Message Date
Yineng Zhang
fa82dfccdd fix EagleVerifyInput (#3378) 2025-02-07 22:30:43 +08:00
Yineng Zhang
5da3d21c8b update pr-test ci (#3376) 2025-02-07 21:08:35 +08:00
Yineng Zhang
f287037673 update sgl-kernel version (#3374) 2025-02-07 20:51:06 +08:00
Yineng Zhang
f9905d59a8 support speculative decoding kernel in sgl-kernel (#3373)
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
2025-02-07 20:29:51 +08:00
Yineng Zhang
45c87e083f fix undefined symbol cudaGetDriverEntryPointByVersion (#3372) 2025-02-07 19:32:45 +08:00
Yineng Zhang
2b1808cec4 update unit test in AMD CI (#3366) 2025-02-07 17:25:16 +08:00
lizamd
e868d0b60e update waves_per_eu to 1 (#3356) 2025-02-07 13:08:06 +08:00
Shi Shuai
591e751e07 Fix: Runtime error for function calling (#3300) 2025-02-06 20:52:01 -08:00
Chayenne
40022d075a Feature: Fix the binding error in Llama (#3355) 2025-02-06 20:19:24 -08:00
Liangjun Song
823148e7f0 Docs: Add deepseek usage and add multi-node, credit to lycanlancelot (#3314)
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
2025-02-06 19:45:00 -08:00
Chayenne
76ca91dff2 Docs/CI: Enable Fake Finish for Docs Only PR (#3350) 2025-02-06 19:33:31 -08:00
Xiaoyu Zhang
cdae77b03d optimize moe_align_kernel cuda (#3347) 2025-02-07 00:53:46 +08:00
Yineng Zhang
adeee15204 fix sgl-kernel build failure on AMD (#3352) 2025-02-07 00:35:59 +08:00
Ke Bao
6792411e7f [Doc] Add optimization option guide for deepseek v3 (#3349) 2025-02-06 23:28:09 +08:00
Yineng Zhang
7348d9627e add AMD guide for DeepSeek-R1 (#3338) 2025-02-06 16:54:40 +08:00
Yineng Zhang
25ed22b685 update pull request template (#3337) 2025-02-06 16:48:02 +08:00
saienduri
200d3b1608 Add sgl-kernel to MI300 CI paths tested. (#3335)
Co-authored-by: HAI <hixiao@gmail.com>
2025-02-06 00:45:38 -08:00
Xiaoyu Zhang
ad3499858e clean moe align block kernel code and add acc test (#3332) 2025-02-06 16:42:36 +08:00
Wen-Heng (Jack) Chung
32de54ed1a [ROCm] Fix fp8 unrolledx4 matmul kernel. (#3325)
Co-authored-by: HAI <hixiao@gmail.com>
2025-02-05 18:44:15 -08:00
saienduri
2d9c319594 Docker switch (#3327)
Co-authored-by: HAI <hixiao@gmail.com>
2025-02-05 18:06:50 -08:00
Yineng Zhang
07e58a2dcb update README (#3324) 2025-02-06 07:13:05 +08:00
saienduri
04d8cd2088 Initial Enablement of CI on MI300 (#3168) 2025-02-05 10:45:12 -08:00
Ke Bao
a322051e31 Support custom mask for Triton attention (#3317) 2025-02-06 01:16:02 +08:00
Ke Bao
de5533341e Update Triton extend backend interface (#3309) 2025-02-05 18:12:22 +08:00
Yineng Zhang
7aad8d1854 chore: bump v0.4.2.post2 (#3313) 2025-02-05 17:35:02 +08:00
Baizhou Zhang
76fa2d152c Fix lora flashinfer import bug on ROCM (#3312) 2025-02-05 16:36:49 +08:00
Wen-Heng (Jack) Chung
7ab84948d8 [ROCm] Logic to decide whether to used manually unrolled kernel. (#3306) 2025-02-04 19:12:20 -08:00
kk
4885b90802 Use forward_cuda to execute custom op for hip platform (#3305)
Co-authored-by: wunhuang <wunhuang@amd.com>
2025-02-05 02:58:17 +00:00
Wen-Heng (Jack) Chung
c2723a42a5 [ROCm] Manually unroll _w8a8_block_fp8_matmul kernel on AMD GPU. (#3299) 2025-02-05 07:15:40 +08:00
Wen-Heng (Jack) Chung
c7256ca836 [ROCm] Add tuning configs for AMD Radeon Graphics. (#3294) 2025-02-04 10:34:57 -08:00
Yineng Zhang
6186a8f889 update flashinfer install index url (#3293) 2025-02-05 00:44:35 +08:00
Ke Bao
a07364ccc5 Update Triton decode backend interface (#3292) 2025-02-04 23:26:04 +08:00
HAI
2c1a695ff1 ROCm: sgl-kernel enablement starting with sgl_moe_align_block (#3287) 2025-02-04 21:44:44 +08:00
Yineng Zhang
d39899e85c upgrade flashinfer v0.2.0.post2 (#3288)
Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>
2025-02-04 21:41:40 +08:00
Baizhou Zhang
70817a7eae [Feature] Define backends and add Triton backend for Lora (#3161)
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
2025-02-03 22:09:13 -08:00
simveit
7b5a374114 Update server args doc (#3273)
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
2025-02-03 23:39:41 +00:00
Yineng Zhang
4b6f62e2bc add Atlas Cloud for Adoption and Sponsorship (#3276) 2025-02-04 05:31:30 +08:00
Yineng Zhang
897e2e253a add Nebius for Adoption and Sponsorship (#3274) 2025-02-04 04:41:26 +08:00
kushanam
d54cee1441 adding Triton configs for DeepSeekV3 on Blackwell (#3272) 2025-02-04 04:12:09 +08:00
Yineng Zhang
00fa7d0417 add copyright for sgl-kernel (#3270) 2025-02-03 21:34:44 +08:00
Yineng Zhang
013021b6a1 refactor EAGLE 2 (#3269)
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: merrymercy <lianminzheng@gmail.com>
Co-authored-by: Ying1123 <sqy1415@gmail.com>
2025-02-03 20:52:30 +08:00
Xiaoyu Zhang
3c8ac78dc1 optimize test_fused_moe style (#3268) 2025-02-03 18:56:18 +08:00
Liangjun Song
455bfe8dd3 Add a Doc about guide on nvidia jetson #3182 (#3205)
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
2025-02-02 20:29:10 -08:00
zifeitong
28b0a62bb3 Bug: Fix min_p sampling crash when using flashinfer backend (#3207)
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
2025-02-02 15:36:07 -08:00
HAI
566d61d90f ROCm: bump 6.3.0 (#3259) 2025-02-03 04:13:40 +08:00
Chayenne
55f5fc68ac Docs: Update accuracy evaluation (#3261) 2025-02-02 11:14:59 -08:00
simveit
c27c378a19 docs/accuracy evaluation (#3114)
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
2025-02-02 11:01:39 -08:00
Wen-Heng (Jack) Chung
d9eb9358cc Tune paged attention parameters for AMD GPU. (#3255) 2025-02-01 17:29:45 -08:00
Yineng Zhang
959dca4fc7 use srt VocabParallelEmbedding (#3252) 2025-02-01 22:23:09 +08:00
Yineng Zhang
f2b3a3188e Update README 2025-02-01 21:19:15 +08:00