1. Update CANN image name 2. Add pta install step 3. update vllm-ascend docker image name to ghcr 4. update quick_start to use vllm-ascend image directly. 5. fix `note` style Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
644 B
644 B
Supported Models
| Model | Supported | Note |
|---|---|---|
| Qwen 2.5 | ✅ | |
| Mistral | Need test | |
| DeepSeek v2.5 | Need test | |
| DeepSeek v3 | ✅ | |
| DeepSeek Distill (Qwen/llama) | ✅ | |
| LLama3.1/3.2 | ✅ | |
| Gemma-2 | Need test | |
| baichuan | Need test | |
| minicpm | Need test | |
| internlm | ✅ | |
| ChatGLM | ✅ | |
| InternVL 2.5 | ✅ | |
| Qwen2-VL | ✅ | |
| GLM-4v | Need test | |
| Molomo | ✅ | |
| LLaVA 1.5 | ✅ | |
| Mllama | Need test | |
| LLaVA-Next | Need test | |
| LLaVA-Next-Video | Need test | |
| Phi-3-Vison/Phi-3.5-Vison | Need test | |
| Ultravox | Need test | |
| Qwen2-Audio | ✅ |