[CI/Build] Bump torch_npu to dev20250307.3 (#265)
Update torch-npu version to fix torch npu exponential_ accuracy With this update, the percision issue when setting `temperature > 0` is fixed. --------- Signed-off-by: Mengqing Cao <cmq0113@163.com>
This commit is contained in:
@@ -212,7 +212,9 @@ Prompt: 'The future of AI is', Generated text: ' following you. As the technolog
|
||||
|
||||
Run docker container on each machine:
|
||||
|
||||
```shell
|
||||
```{code-block} bash
|
||||
:substitutions:
|
||||
|
||||
docker run \
|
||||
--name vllm-ascend \
|
||||
--device /dev/davinci0 \
|
||||
@@ -233,7 +235,7 @@ docker run \
|
||||
-v /etc/ascend_install.info:/etc/ascend_install.info \
|
||||
-v /root/.cache:/root/.cache \
|
||||
-p 8000:8000 \
|
||||
-it quay.io/ascend/vllm-ascend:v0.7.1rc1 bash
|
||||
-it quay.io/ascend/vllm-ascend:|vllm_ascend_version| bash
|
||||
```
|
||||
|
||||
Choose one machine as head node, the other are worker nodes, then start ray on each machine:
|
||||
|
||||
Reference in New Issue
Block a user