From 11ecbfdb314501409aae9561747d12d2469da0f5 Mon Sep 17 00:00:00 2001 From: Shanshan Shen <467638484@qq.com> Date: Mon, 14 Apr 2025 11:11:40 +0800 Subject: [PATCH] [Doc] Update FAQ doc (#504) ### What this PR does / why we need it? Update FAQ doc. --------- Signed-off-by: shen-shanshan <467638484@qq.com> --- docs/source/faqs.md | 48 +++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 48 insertions(+) diff --git a/docs/source/faqs.md b/docs/source/faqs.md index 50067c4..f1ae80f 100644 --- a/docs/source/faqs.md +++ b/docs/source/faqs.md @@ -21,3 +21,51 @@ Below series are NOT supported yet: - Ascend 910, Ascend 910 Pro B (Ascend-cann-kernels-910) unplanned yet From a technical view, vllm-ascend support would be possible if the torch-npu is supported. Otherwise, we have to implement it by using custom ops. We are also welcome to join us to improve together. + +### 2. How to get our docker containers? + +You can get our containers at `Quay.io`, e.g., [vllm-ascend](https://quay.io/repository/ascend/vllm-ascend?tab=tags) and [cann](https://quay.io/repository/ascend/cann?tab=tags). + +If you are in China, you can use `daocloud` to accelerate your downloading: + +1) Open `daemon.json`: + +```bash +vi /etc/docker/daemon.json +``` + +2) Add `https://docker.m.daocloud.io` to `registry-mirrors`: + +```json +{ + "registry-mirrors": [ + "https://docker.m.daocloud.io" + ] +} +``` + +3) Restart your docker service: + +```bash +sudo systemctl daemon-reload +sudo systemctl restart docker +``` + +After configuration, you can download our container from `m.daocloud.io/quay.io/ascend/vllm-ascend:v0.7.3rc2`. + +### 3. What models does vllm-ascend supports? + +Currently, we have already fully tested and supported `Qwen` / `Deepseek` (V0 only) / `Llama` models, other models we have tested are shown [here](https://vllm-ascend.readthedocs.io/en/latest/user_guide/supported_models.html). Plus, accoding to users' feedback, `gemma3` and `glm4` are not supported yet. Besides, more models need test. + +### 4. How to get in touch with our community? + +There are many channels that you can communicate with our community developers / users: + +- Submit a GitHub [issue](https://github.com/vllm-project/vllm-ascend/issues?page=1). +- Join our [weekly meeting](https://docs.google.com/document/d/1hCSzRTMZhIB8vRq1_qOOjx4c9uYUxvdQvDsMV2JcSrw/edit?tab=t.0#heading=h.911qu8j8h35z) and share your ideas. +- Join our [WeChat](https://github.com/vllm-project/vllm-ascend/issues/227) group and ask your quenstions. +- Join our ascend channel in [vLLM forums](https://discuss.vllm.ai/c/hardware-support/vllm-ascend-support/6) and publish your topics. + +### 5. What features does vllm-ascend V1 supports? + +Find more details [here](https://github.com/vllm-project/vllm-ascend/issues/414).