[Doc] Add container image save/load FAQ for offline environments (#2347)
### What this PR does / why we need it?
Add Docker export/import guide for air-gapped environments
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
NA
- vLLM version: v0.10.0
- vLLM main:
d16aa3dae4
Signed-off-by: QwertyJack <7554089+QwertyJack@users.noreply.github.com>
This commit is contained in:
@@ -36,6 +36,33 @@ TAG=v0.7.3rc2
|
|||||||
docker pull m.daocloud.io/quay.io/ascend/vllm-ascend:$TAG
|
docker pull m.daocloud.io/quay.io/ascend/vllm-ascend:$TAG
|
||||||
```
|
```
|
||||||
|
|
||||||
|
#### Load Docker Images for offline environment
|
||||||
|
If you want to use container image for offline environments (no internet connection), you need to download container image in a environment with internet access:
|
||||||
|
|
||||||
|
**Exporting Docker images:**
|
||||||
|
|
||||||
|
```{code-block} bash
|
||||||
|
:substitutions:
|
||||||
|
# Pull the image on a machine with internet access
|
||||||
|
TAG=|vllm_ascend_version|
|
||||||
|
docker pull quay.io/ascend/vllm-ascend:$TAG
|
||||||
|
|
||||||
|
# Export the image to a tar file and compress to tar.gz
|
||||||
|
docker save quay.io/ascend/vllm-ascend:$TAG | gzip > vllm-ascend-$TAG.tar.gz
|
||||||
|
```
|
||||||
|
|
||||||
|
**Importing Docker images in environment without internet access:**
|
||||||
|
|
||||||
|
```{code-block} bash
|
||||||
|
:substitutions:
|
||||||
|
# Transfer the tar/tar.gz file to the offline environment and load it
|
||||||
|
TAG=|vllm_ascend_version|
|
||||||
|
docker load -i vllm-ascend-$TAG.tar.gz
|
||||||
|
|
||||||
|
# Verify the image is loaded
|
||||||
|
docker images | grep vllm-ascend
|
||||||
|
```
|
||||||
|
|
||||||
### 3. What models does vllm-ascend supports?
|
### 3. What models does vllm-ascend supports?
|
||||||
|
|
||||||
Find more details [<u>here</u>](https://vllm-ascend.readthedocs.io/en/latest/user_guide/support_matrix/supported_models.html).
|
Find more details [<u>here</u>](https://vllm-ascend.readthedocs.io/en/latest/user_guide/support_matrix/supported_models.html).
|
||||||
|
|||||||
Reference in New Issue
Block a user