EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Add deepseek style fused moe group gate selection kernel (#4530)

Browse Source
This commit is contained in:
Qingquan Song
2025-03-29 11:51:45 -07:00
committed by GitHub
parent ddf8981d91
commit 45dcfc2e76
9 changed files with 616 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
sgl-kernel/CMakeLists.txt
View File

@@ -151,6 +151,7 @@ set(SOURCES
"csrc/gemm/per_token_group_quant_8bit.cu"
"csrc/gemm/per_token_quant_fp8.cu"
"csrc/moe/moe_align_kernel.cu"
"csrc/moe/moe_fused_gate.cu"
"csrc/moe/moe_topk_softmax_kernels.cu"
"csrc/speculative/eagle_utils.cu"
"csrc/speculative/speculative_sampling.cu"