From 97a38ee85ba62e268bde6388f1bf8edfe2ca9d76 Mon Sep 17 00:00:00 2001 From: Lianmin Zheng Date: Sat, 23 Aug 2025 07:09:26 -0700 Subject: [PATCH] Release 0.5.1 (#9533) --- benchmark/deepseek_v3/README.md | 2 +- docs/get_started/install.md | 6 ++---- docs/platforms/amd_gpu.md | 2 +- docs/platforms/ascend_npu.md | 2 +- python/pyproject.toml | 2 +- python/sglang/version.py | 2 +- 6 files changed, 7 insertions(+), 9 deletions(-) diff --git a/benchmark/deepseek_v3/README.md b/benchmark/deepseek_v3/README.md index 44d691cdb..be22cfda2 100644 --- a/benchmark/deepseek_v3/README.md +++ b/benchmark/deepseek_v3/README.md @@ -33,7 +33,7 @@ Add [performance optimization options](#performance-optimization-options) as nee ```bash # Installation -pip install "sglang[all]>=0.5.0rc2" +pip install "sglang[all]>=0.5.1" # Launch python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-V3 --tp 8 --trust-remote-code diff --git a/docs/get_started/install.md b/docs/get_started/install.md index 0517ba30a..cf730bae0 100644 --- a/docs/get_started/install.md +++ b/docs/get_started/install.md @@ -12,20 +12,19 @@ It is recommended to use uv for faster installation: ```bash pip install --upgrade pip pip install uv -uv pip install "sglang[all]>=0.5.0rc2" +uv pip install "sglang[all]>=0.5.1" ``` **Quick fixes to common problems** - If you encounter `OSError: CUDA_HOME environment variable is not set`. Please set it to your CUDA install root with either of the following solutions: 1. Use `export CUDA_HOME=/usr/local/cuda-` to set the `CUDA_HOME` environment variable. 2. Install FlashInfer first following [FlashInfer installation doc](https://docs.flashinfer.ai/installation.html), then install SGLang as described above. -- SGLang currently uses torch 2.8 and flashinfer for torch 2.8. If you want to install flashinfer separately, please refer to [FlashInfer installation doc](https://docs.flashinfer.ai/installation.html). Please note that the FlashInfer pypi package is called `flashinfer-python` instead of `flashinfer`. ## Method 2: From source ```bash # Use the last release branch -git clone -b v0.5.0rc2 https://github.com/sgl-project/sglang.git +git clone -b v0.5.1 https://github.com/sgl-project/sglang.git cd sglang # Install the python packages @@ -35,7 +34,6 @@ pip install -e "python[all]" **Quick fixes to common problems** - If you want to develop SGLang, it is recommended to use docker. Please refer to [setup docker container](../developer_guide/development_guide_using_docker.md#setup-docker-container). The docker image is `lmsysorg/sglang:dev`. -- SGLang currently uses torch 2.8 and flashinfer for torch 2.8. If you want to install flashinfer separately, please refer to [FlashInfer installation doc](https://docs.flashinfer.ai/installation.html). Please note that the FlashInfer pypi package is called `flashinfer-python` instead of `flashinfer`. ## Method 3: Using docker diff --git a/docs/platforms/amd_gpu.md b/docs/platforms/amd_gpu.md index ff8fbd341..a9df54446 100644 --- a/docs/platforms/amd_gpu.md +++ b/docs/platforms/amd_gpu.md @@ -44,7 +44,7 @@ You can install SGLang using one of the methods below. ```bash # Use the last release branch -git clone -b v0.5.0rc2 https://github.com/sgl-project/sglang.git +git clone -b v0.5.1 https://github.com/sgl-project/sglang.git cd sglang # Compile sgl-kernel diff --git a/docs/platforms/ascend_npu.md b/docs/platforms/ascend_npu.md index a21a95b60..210b71483 100644 --- a/docs/platforms/ascend_npu.md +++ b/docs/platforms/ascend_npu.md @@ -99,7 +99,7 @@ We are also providing a DeepEP-compatible Library as a drop-in replacement of de ```shell # Use the last release branch -git clone -b v0.5.0rc2 https://github.com/sgl-project/sglang.git +git clone -b v0.5.1 https://github.com/sgl-project/sglang.git cd sglang pip install --upgrade pip diff --git a/python/pyproject.toml b/python/pyproject.toml index 2543e7c1a..2fdcd14cf 100644 --- a/python/pyproject.toml +++ b/python/pyproject.toml @@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta" [project] name = "sglang" -version = "0.5.0rc2" +version = "0.5.1" description = "SGLang is yet another fast serving framework for large language models and vision language models." readme = "README.md" requires-python = ">=3.10" diff --git a/python/sglang/version.py b/python/sglang/version.py index bdc1cd947..dd9b22ccc 100644 --- a/python/sglang/version.py +++ b/python/sglang/version.py @@ -1 +1 @@ -__version__ = "0.5.0rc2" +__version__ = "0.5.1"