From cd3ccb2ed7aaeaa8f56acd467af9ad8fb482f465 Mon Sep 17 00:00:00 2001 From: Lianmin Zheng Date: Sun, 21 Jan 2024 16:51:45 -0800 Subject: [PATCH] Add a note about triton version for older GPUs (#72) --- README.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 1fe4eace1..17720f2a0 100644 --- a/README.md +++ b/README.md @@ -34,7 +34,9 @@ pip install -e "python[all]" ``` ### Notes -- If you are using older GPUs (NVIDIA T4, V100), please use `pip install "triton>=2.2.0"` to avoid some bugs in the triton compiler +- If you are using older GPUs (NVIDIA V100, T4), please pick the correct triton compiler version to avoid some known bugs. + - For NVIDIA T4, please use `pip install "triton>=2.2.0"`. + - For NVIDIA V100, please install the [nightly](https://triton-lang.org/main/getting-started/installation.html) version. - If you only need to use the OpenAI backend, you can avoid installing other dependencies by using `pip install sglang[openai]` ## Quick Start