2024-11-29 16:37:52 -08:00
|
|
|
# SGL Kernel
|
2024-11-30 02:27:35 +08:00
|
|
|
|
2025-01-26 00:00:13 +08:00
|
|
|
[Kernel Library](https://github.com/sgl-project/sglang/tree/main/sgl-kernel) for SGLang
|
2024-12-01 20:11:21 +08:00
|
|
|
|
|
|
|
|
[](https://pypi.org/project/sgl-kernel)
|
2025-01-26 00:00:13 +08:00
|
|
|
|
|
|
|
|
## Installation
|
|
|
|
|
|
|
|
|
|
For CUDA 11.8:
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
pip3 install sgl-kernel -i https://docs.sglang.ai/whl/cu118
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
For CUDA 12.1 or CUDA 12.4:
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
pip3 install sgl-kernel
|
|
|
|
|
```
|
