From 8bfd16a145ae715ac1633d6b3aae6474559869a5 Mon Sep 17 00:00:00 2001 From: jack Date: Wed, 13 Aug 2025 16:00:43 +0800 Subject: [PATCH] [Doc] Add container image save/load FAQ for offline environments (#2347) ### What this PR does / why we need it? Add Docker export/import guide for air-gapped environments ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? NA - vLLM version: v0.10.0 - vLLM main: https://github.com/vllm-project/vllm/commit/d16aa3dae446d93f870a2e51b240e18a01cac294 Signed-off-by: QwertyJack <7554089+QwertyJack@users.noreply.github.com> --- docs/source/faqs.md | 27 +++++++++++++++++++++++++++ 1 file changed, 27 insertions(+) diff --git a/docs/source/faqs.md b/docs/source/faqs.md index 26384f8..4250fd0 100644 --- a/docs/source/faqs.md +++ b/docs/source/faqs.md @@ -36,6 +36,33 @@ TAG=v0.7.3rc2 docker pull m.daocloud.io/quay.io/ascend/vllm-ascend:$TAG ``` +#### Load Docker Images for offline environment +If you want to use container image for offline environments (no internet connection), you need to download container image in a environment with internet access: + +**Exporting Docker images:** + +```{code-block} bash + :substitutions: +# Pull the image on a machine with internet access +TAG=|vllm_ascend_version| +docker pull quay.io/ascend/vllm-ascend:$TAG + +# Export the image to a tar file and compress to tar.gz +docker save quay.io/ascend/vllm-ascend:$TAG | gzip > vllm-ascend-$TAG.tar.gz +``` + +**Importing Docker images in environment without internet access:** + +```{code-block} bash + :substitutions: +# Transfer the tar/tar.gz file to the offline environment and load it +TAG=|vllm_ascend_version| +docker load -i vllm-ascend-$TAG.tar.gz + +# Verify the image is loaded +docker images | grep vllm-ascend +``` + ### 3. What models does vllm-ascend supports? Find more details [here](https://vllm-ascend.readthedocs.io/en/latest/user_guide/support_matrix/supported_models.html).