Files

yinfan98 9286740eff feat: refactor sgl-kernel and use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#3130 )

Co-authored-by: yinfan.1024 <yinfan.1024@bytedance.com>
Co-authored-by: yinfan98 <1106110035@qq.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>

2025-01-26 02:55:08 +08:00

3rdparty

chore: bump v0.0.2.post17 for sgl-kernel (#3125 )

2025-01-25 20:43:02 +08:00

benchmark

Add shapes for int8 gemm benchmark (#3093 )

2025-01-24 12:27:30 +08:00

src/sgl-kernel

feat: refactor sgl-kernel and use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#3130 )

2025-01-26 02:55:08 +08:00

tests

support fp32 in sampling_scaling_penalties kernel (#3121 )

2025-01-25 16:52:17 +08:00

.clang-format

format: add clang-format for sgl-kernel (#2483 )

2024-12-14 22:36:04 +08:00

build.sh

Add workflow for sgl-kernel cu118 release (#3109 )

2025-01-24 22:30:30 +08:00

developer_guide.md

feat: refactor sgl-kernel and use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#3130 )

2025-01-26 02:55:08 +08:00

LICENSE

feat: support sgl-kernel pypi (#2302 )

2024-12-01 20:11:21 +08:00

Makefile

chore: bump v0.0.2.post17 for sgl-kernel (#3125 )

2025-01-25 20:43:02 +08:00

pyproject.toml

update installation doc for sgl-kernel (#3129 )

2025-01-26 00:00:13 +08:00

README.md

update installation doc for sgl-kernel (#3129 )

2025-01-26 00:00:13 +08:00

setup.py

feat: refactor sgl-kernel and use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#3130 )

2025-01-26 02:55:08 +08:00

THIRDPARTYNOTICES.txt

feat: add flashinfer as 3rdparty and use rmsnorm as example (#3033 )

2025-01-21 20:44:49 +08:00

version.py

chore: bump v0.0.2.post17 for sgl-kernel (#3125 )

2025-01-25 20:43:02 +08:00

README.md

SGL Kernel

Kernel Library for SGLang

Installation

For CUDA 11.8:

pip3 install sgl-kernel -i https://docs.sglang.ai/whl/cu118

For CUDA 12.1 or CUDA 12.4:

pip3 install sgl-kernel