EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

feat: integrate sampling kernels into sgl-kernel (#3086)

Browse Source 
Co-authored-by: Zihao Ye <expye@outlook.com>
This commit is contained in:
Yineng Zhang
2025-01-24 01:54:47 +08:00
committed by GitHub
parent e0cd65c2b6
commit 5de4051bcf
6 changed files with 419 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
sgl-kernel/setup.py
View File

@@ -128,6 +128,7 @@ ext_modules = [
"3rdparty/flashinfer/csrc/group_gemm_sm90.cu",
"3rdparty/flashinfer/csrc/norm.cu",
"3rdparty/flashinfer/csrc/sampling.cu",
"3rdparty/flashinfer/csrc/renorm.cu",
],
include_dirs=include_dirs,
extra_compile_args={