From 9d8b4c8d9de081965765eb1b3688adc64d96a42e Mon Sep 17 00:00:00 2001 From: huqi Date: Mon, 5 Jan 2026 19:40:26 +0800 Subject: [PATCH] [Doc] Add NNAL installation guide and requirements (#5235) Fixes #2727 - Add NNAL to the software requirements table with version information - Add note explaining that prebuilt Docker images include NNAL - Add warning message for manual installation when encountering libatb.so errors - Improve visibility of NNAL installation instructions to prevent runtime errors This addresses the issue where users encounter 'libatb.so not found' errors due to missing NNAL installation in their environment. ### What this PR does / why we need it? ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? - vLLM version: release/v0.13.0 - vLLM main: https://github.com/vllm-project/vllm/commit/ad32e3e19ccf0526cb6744a5fed09a138a5fb2f9 --------- Signed-off-by: menogrey <1299267905@qq.com> Signed-off-by: hu-qi Co-authored-by: zhangyiming <34808445+menogrey@users.noreply.github.com> --- docs/source/installation.md | 9 +++++++++ 1 file changed, 9 insertions(+) diff --git a/docs/source/installation.md b/docs/source/installation.md index 8499e234..0e2133b1 100644 --- a/docs/source/installation.md +++ b/docs/source/installation.md @@ -15,6 +15,7 @@ This document describes how to install vllm-ascend manually. | CANN | == 8.3.RC2 | Required for vllm-ascend and torch-npu | | torch-npu | == 2.8.0 | Required for vllm-ascend, No need to install manually, it will be auto installed in below steps | | torch | == 2.8.0 | Required for torch-npu and vllm | + | NNAL | == 8.3.RC2 | Required for libatb.so, enables advanced tensor operations | There are two installation methods: - **Using pip**: first prepare env manually or via CANN image, then install `vllm-ascend` using pip. @@ -45,6 +46,10 @@ Refer to [Ascend Environment Setup Guide](https://ascend.github.io/docs/sources/ The easiest way to prepare your software environment is using CANN image directly: +```{note} +The CANN prebuilt image includes NNAL (Ascend Neural Network Acceleration Library) which provides libatb.so for advanced tensor operations. No additional installation is required when using the prebuilt image. +``` + ```{code-block} bash :substitutions: # Update DEVICE according to your device (/dev/davinci[0-7]) @@ -71,6 +76,10 @@ docker run --rm \ :animate: fade-in-slide-down You can also install CANN manually: +```{warning} +If you encounter "libatb.so not found" errors during runtime, please ensure NNAL is properly installed as shown in the manual installation steps below. +``` + ```bash # Create a virtual environment. python -m venv vllm-ascend-env