EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Add a note about triton version for older GPUs (#72)

Browse Source
This commit is contained in:
Lianmin Zheng
2024-01-21 16:51:45 -08:00
committed by GitHub
parent 3f5c2f4c4a
commit cd3ccb2ed7
1 changed files with 3 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
README.md
View File

@@ -34,7 +34,9 @@ pip install -e "python[all]"
``` ```
### Notes ### Notes
- If you are using older GPUs (NVIDIA T4, V100), please use `pip install "triton>=2.2.0"` to avoid some bugs in the triton compiler - If you are using older GPUs (NVIDIA V100, T4), please pick the correct triton compiler version to avoid some known bugs.
- For NVIDIA T4, please use `pip install "triton>=2.2.0"`.
- For NVIDIA V100, please install the [nightly](https://triton-lang.org/main/getting-started/installation.html) version.
- If you only need to use the OpenAI backend, you can avoid installing other dependencies by using `pip install sglang[openai]` - If you only need to use the OpenAI backend, you can avoid installing other dependencies by using `pip install sglang[openai]`
## Quick Start ## Quick Start