From 368de3661e260da43d80d3e3769758a7dd4115d6 Mon Sep 17 00:00:00 2001 From: simveit <69345428+simveit@users.noreply.github.com> Date: Thu, 13 Feb 2025 22:42:51 +0100 Subject: [PATCH] Update install docs (#3553) Co-authored-by: Chayenne --- docs/start/install.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/docs/start/install.md b/docs/start/install.md index a14ca213e..cac99e421 100644 --- a/docs/start/install.md +++ b/docs/start/install.md @@ -11,6 +11,11 @@ pip install "sglang[all]>=0.4.2.post4" --find-links https://flashinfer.ai/whl/cu Note: SGLang currently uses torch 2.5, so you need to install the flashinfer version for torch 2.5. If you want to install flashinfer separately, please refer to [FlashInfer installation doc](https://docs.flashinfer.ai/installation.html). +If you experience an error like `OSError: CUDA_HOME environment variable is not set. Please set it to your CUDA install root`， please try either of the following solutions: + +- Use `export CUDA_HOME=/usr/local/cuda-` to set the `CUDA_HOME` environment variable. +- Follow the procedure described in [FlashInfer installation doc](https://docs.flashinfer.ai/installation.html) first, then install SGLang as described above. + ## Method 2: From source ``` # Use the last release branch