[CI] Upgrade CANN to 8.5.1 (#6897)
### What this PR does / why we need it?
[CI] Upgrade CANN to 8.5.1
### Does this PR introduce _any_ user-facing change?
N/A
### How was this patch tested?
CI passed with existing test.
- vLLM version: v0.16.0
- vLLM main:
15d76f74e2
Signed-off-by: wxsIcey <1790571317@qq.com>
This commit is contained in:
@@ -12,10 +12,10 @@ This document describes how to install vllm-ascend manually.
|
||||
| Software | Supported version | Note |
|
||||
|---------------|----------------------------------|-------------------------------------------|
|
||||
| Ascend HDK | Refer to the documentation [here](https://www.hiascend.com/document/detail/zh/canncommercial/83RC1/releasenote/releasenote_0000.html) | Required for CANN |
|
||||
| CANN | == 8.5.0 | Required for vllm-ascend and torch-npu |
|
||||
| CANN | == 8.5.1 | Required for vllm-ascend and torch-npu |
|
||||
| torch-npu | == 2.9.0 | Required for vllm-ascend, No need to install manually, it will be auto installed in below steps |
|
||||
| torch | == 2.9.0 | Required for torch-npu and vllm |
|
||||
| NNAL | == 8.5.0 | Required for libatb.so, enables advanced tensor operations |
|
||||
| NNAL | == 8.5.1 | Required for libatb.so, enables advanced tensor operations |
|
||||
|
||||
There are two installation methods:
|
||||
|
||||
@@ -90,18 +90,18 @@ source vllm-ascend-env/bin/activate
|
||||
pip3 install -i https://pypi.tuna.tsinghua.edu.cn/simple attrs 'numpy<2.0.0' decorator sympy cffi pyyaml pathlib2 psutil protobuf scipy requests absl-py wheel typing_extensions
|
||||
|
||||
# Download and install the CANN package.
|
||||
wget --header="Referer: https://www.hiascend.com/" https://ascend-repo.obs.cn-east-2.myhuaweicloud.com/CANN/CANN%208.5.0/Ascend-cann-toolkit_8.5.0_linux-"$(uname -i)".run
|
||||
chmod +x ./Ascend-cann-toolkit_8.5.0_linux-"$(uname -i)".run
|
||||
./Ascend-cann-toolkit_8.5.0_linux-"$(uname -i)".run --full
|
||||
wget --header="Referer: https://www.hiascend.com/" https://ascend-repo.obs.cn-east-2.myhuaweicloud.com/CANN/CANN%208.5.1/Ascend-cann-toolkit_8.5.1_linux-"$(uname -i)".run
|
||||
chmod +x ./Ascend-cann-toolkit_8.5.1_linux-"$(uname -i)".run
|
||||
./Ascend-cann-toolkit_8.5.1_linux-"$(uname -i)".run --full
|
||||
source /usr/local/Ascend/ascend-toolkit/set_env.sh
|
||||
|
||||
wget --header="Referer: https://www.hiascend.com/" https://ascend-repo.obs.cn-east-2.myhuaweicloud.com/CANN/CANN%208.5.0/Ascend-cann-910b-ops_8.5.0_linux-"$(uname -i)".run
|
||||
chmod +x ./Ascend-cann-910b-ops_8.5.0_linux-"$(uname -i)".run
|
||||
./Ascend-cann-910b-ops_8.5.0_linux-"$(uname -i)".run --install
|
||||
wget --header="Referer: https://www.hiascend.com/" https://ascend-repo.obs.cn-east-2.myhuaweicloud.com/CANN/CANN%208.5.1/Ascend-cann-910b-ops_8.5.1_linux-"$(uname -i)".run
|
||||
chmod +x ./Ascend-cann-910b-ops_8.5.1_linux-"$(uname -i)".run
|
||||
./Ascend-cann-910b-ops_8.5.1_linux-"$(uname -i)".run --install
|
||||
|
||||
wget --header="Referer: https://www.hiascend.com/" https://ascend-repo.obs.cn-east-2.myhuaweicloud.com/CANN/CANN%208.5.0/Ascend-cann-nnal_8.5.0_linux-"$(uname -i)".run
|
||||
chmod +x ./Ascend-cann-nnal_8.5.0_linux-"$(uname -i)".run
|
||||
./Ascend-cann-nnal_8.5.0_linux-"$(uname -i)".run --install
|
||||
wget --header="Referer: https://www.hiascend.com/" https://ascend-repo.obs.cn-east-2.myhuaweicloud.com/CANN/CANN%208.5.1/Ascend-cann-nnal_8.5.1_linux-"$(uname -i)".run
|
||||
chmod +x ./Ascend-cann-nnal_8.5.1_linux-"$(uname -i)".run
|
||||
./Ascend-cann-nnal_8.5.1_linux-"$(uname -i)".run --install
|
||||
|
||||
source /usr/local/Ascend/nnal/atb/set_env.sh
|
||||
```
|
||||
|
||||
Reference in New Issue
Block a user