EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

[main]update release note & support matrix (#6759)

Browse Source 
### What this PR does / why we need it?

Update release note & support matrix to add experimental tag for
features and models.

### Does this PR introduce _any_ user-facing change?

### How was this patch tested?

- vLLM version: v0.15.0
- vLLM main:
9562912cea

0.13.0 branch: https://github.com/vllm-project/vllm-ascend/pull/6751

Signed-off-by: zzzzwwjj <1183291235@qq.com>
This commit is contained in:
zzzzwwjj
2026-02-24 17:39:35 +08:00
committed by GitHub
parent a8e951e6f5
commit 5c8ab7af39
3 changed files with 74 additions and 77 deletions
Download Patch File Download Diff File Expand all files Collapse all files

42
docs/source/user_guide/support_matrix/supported_features.md
View File

@@ -8,27 +8,27 @@ You can check the [support status of vLLM V1 Engine][v1_user_guide]. Below is th
| Feature | Status | Next Step |
|-------------------------------|----------------|------------------------------------------------------------------------|
| Chunked Prefill | 🟢 Functional | Functional, see detailed note: [Chunked Prefill][cp] |
| Automatic Prefix Caching | 🟢 Functional | Functional, see detailed note: [vllm-ascend#732][apc] |
| LoRA | 🟢 Functional | Functional, see detailed note: [LoRA][LoRA] |
| Speculative decoding | 🟢 Functional | Basic support |
| Pooling | 🟢 Functional | CI needed to adapt to more models; V1 support relies on vLLM support. |
| Enc-dec | 🟡 Planned | vLLM should support this feature first. |
| Multi Modality | 🟢 Functional | [Multi Modality][multimodal], optimizing and adapting more models |
| LogProbs | 🟢 Functional | CI needed |
| Prompt logProbs | 🟢 Functional | CI needed |
| Async output | 🟢 Functional | CI needed |
| Beam search | 🟢 Functional | CI needed |
| Guided Decoding | 🟢 Functional | [vllm-ascend#177][guided_decoding] |
| Tensor Parallel | 🟢 Functional | Make TP >4 work with graph mode. |
| Pipeline Parallel | 🟢 Functional | Write official guide and tutorial. |
| Expert Parallel | 🟢 Functional | Support dynamic EPLB. |
| Data Parallel | 🟢 Functional | Data Parallel support for Qwen3 MoE. |
| Prefill Decode Disaggregation | 🟢 Functional | Functional, xPyD is supported. |
| Quantization | 🟢 Functional | W8A8 available; working on more quantization method support (W4A8, etc) |
| Graph Mode | 🟢 Functional | Functional, see detailed note: [Graph Mode][graph_mode] |
| Sleep Mode | 🟢 Functional | Functional, see detailed note: [Sleep Mode][sleep_mode] |
| Context Parallel | 🟢 Functional | Functional, see detailed note: [Context Parallel][context_parallel] |
| Chunked Prefill | 🟢 Functional | Functional, see detailed note: [Chunked Prefill][cp] |
| Automatic Prefix Caching | 🟢 Functional | Functional, see detailed note: [vllm-ascend#732][apc] |
| LoRA | 🔵 Experimental | Functional, see detailed note: [LoRA][LoRA] |
| Speculative decoding | 🟢 Functional | Basic support |
| Pooling | 🔵 Experimental | CI needed to adapt to more models; V1 support relies on vLLM support. |
| Enc-dec | 🟡 Planned | vLLM should support this feature first. |
| Multi Modality | 🟢 Functional | [Multi Modality][multimodal], optimizing and adapting more models |
| LogProbs | 🟢 Functional | CI needed |
| Prompt logProbs | 🟢 Functional | CI needed |
| Async output | 🟢 Functional | CI needed |
| Beam search | 🔵 Experimental | CI needed |
| Guided Decoding | 🟢 Functional | [vllm-ascend#177][guided_decoding] |
| Tensor Parallel | 🟢 Functional | Make TP >4 work with graph mode. |
| Pipeline Parallel | 🟢 Functional | Write official guide and tutorial. |
| Expert Parallel | 🟢 Functional | Support dynamic EPLB. |
| Data Parallel | 🟢 Functional | Data Parallel support for Qwen3 MoE. |
| Prefill Decode Disaggregation | 🟢 Functional | Functional, xPyD is supported. |
| Quantization | 🟢 Functional | W8A8 available; working on more quantization method support (W4A8, etc) |
| Graph Mode | 🟢 Functional | Functional, see detailed note: [Graph Mode][graph_mode] |
| Sleep Mode | 🟢 Functional | Functional, see detailed note: [Sleep Mode][sleep_mode] |
| Context Parallel | 🟢 Functional | Functional, see detailed note: [Context Parallel][context_parallel] |
- 🟢 Functional: Fully operational, with ongoing optimizations.
- 🔵 Experimental: Experimental support, interfaces and functions may change.

77
docs/source/user_guide/support_matrix/supported_models.md
View File

@@ -17,15 +17,15 @@ Get the latest info here: <https://github.com/vllm-project/vllm-ascend/issues/16
| Model | Support | Note | BF16 | Supported Hardware | W8A8 | Chunked Prefill | Automatic Prefix Cache | LoRA | Speculative Decoding | Async Scheduling | Tensor Parallel | Pipeline Parallel | Expert Parallel | Data Parallel | Prefill-decode Disaggregation | Piecewise AclGraph | Fullgraph AclGraph | max-model-len | MLP Weight Prefetch | Doc |
|-------------------------------|-----------|----------------------------------------------------------------------|------|--------------------|------|-----------------|------------------------|------|----------------------|------------------|-----------------|-------------------|-----------------|---------------|-------------------------------|--------------------|--------------------|---------------|---------------------|-----|
| DeepSeek V3/3.1 | ✅ | | ✅ | A2/A3 | ✅ | ✅ | ✅ || ✅ || ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 240k || [DeepSeek-V3.1](../../tutorials/models/DeepSeek-V3.1.md) |
| DeepSeek V3.2 | ✅ | | ✅ | A2/A3 | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 160k | ✅ | [DeepSeek-V3.2](../../tutorials/models/DeepSeek-V3.2.md) |
| DeepSeek V3.2 | 🔵 | | ✅ | A2/A3 | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 160k | ✅ | [DeepSeek-V3.2](../../tutorials/models/DeepSeek-V3.2.md) |
| DeepSeek R1 | ✅ | | ✅ | A2/A3 | ✅ | ✅ | ✅ || ✅ || ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 128k || [DeepSeek-R1](../../tutorials/models/DeepSeek-R1.md) |
| Qwen3 | ✅ | | ✅ | A2/A3 | ✅ | ✅ | ✅ ||| ✅ | ✅ ||| ✅ || ✅ | ✅ | 128k | ✅ | [Qwen3-Dense](../../tutorials/models/Qwen3-Dense.md) |
| Qwen3-Coder | ✅ | | ✅ | A2/A3 ||✅|✅|✅|||✅|✅|✅|✅||||||[Qwen3-Coder-30B-A3B tutorial](../../tutorials/models/Qwen3-Coder-30B-A3B.md)|
| Qwen3-Moe | ✅ | | ✅ | A2/A3 | ✅ | ✅ | ✅ ||| ✅ | ✅ || ✅ | ✅ | ✅ | ✅ | ✅ | 256k || [Qwen3-235B-A22B](../../tutorials/models/Qwen3-235B-A22B.md) |
| Qwen3-Next | ✅ | | ✅ | A2/A3 | ✅ |||||| ✅ ||| ✅ || ✅ | ✅ ||| [Qwen3-Next](../../tutorials/models/Qwen3-Next.md) |
| Qwen3-Next | 🔵 | | ✅ | A2/A3 | ✅ |||||| ✅ ||| ✅ || ✅ | ✅ ||| [Qwen3-Next](../../tutorials/models/Qwen3-Next.md) |
| Qwen2.5 | ✅ | | ✅ | A2/A3 | ✅ | ✅ | ✅ |||| ✅ ||| ✅ |||||| [Qwen2.5-7B](../../tutorials/models/Qwen2.5-7B.md) |
| GLM-4.x | ✅ | || A2/A3 |✅|✅|✅||✅|✅|✅|||✅||✅|✅|128k||[GLM-4.x](../../tutorials/models/GLM4.x.md)|
| Kimi-K2-Thinking | ✅ | || A2/A3 |||||||||||||||| [Kimi-K2-Thinking](../../tutorials/models/Kimi-K2-Thinking.md) |
| GLM-4.x | 🔵 | || A2/A3 |✅|✅|✅||✅|✅|✅|||✅||✅|✅|128k||[GLM-4.x](../../tutorials/models/GLM4.x.md)|
| Kimi-K2-Thinking | 🔵 | || A2/A3 |||||||||||||||| [Kimi-K2-Thinking](../../tutorials/models/Kimi-K2-Thinking.md) |
#### Extended Compatible Models
@@ -37,21 +37,18 @@ Get the latest info here: <https://github.com/vllm-project/vllm-ascend/issues/16
| Qwen2-based | ✅ | | A2/A3 |
| QwQ-32B | ✅ | | A2/A3 |
| Llama2/3/3.1/3.2 | ✅ | | A2/A3 |
| Internlm | ✅ | [#1962](https://github.com/vllm-project/vllm-ascend/issues/1962) | A2/A3 |
| Baichuan | ✅ | | A2/A3 |
| Baichuan2 | ✅ | | A2/A3 |
| Phi-4-mini | ✅ | | A2/A3 |
| MiniCPM | ✅ | | A2/A3 |
| MiniCPM3 | ✅ | | A2/A3 |
| Ernie4.5 | ✅ | | A2/A3 |
| Ernie4.5-Moe | ✅ | | A2/A3 |
| Gemma-2 | ✅ | | A2/A3 |
| Gemma-3 | ✅ | | A2/A3 |
| Phi-3/4 | ✅ | | A2/A3 |
| Mistral/Mistral-Instruct | ✅ | | A2/A3 |
| GLM-4 | ❌ | [#2255](https://github.com/vllm-project/vllm-ascend/issues/2255) | |
| GLM-4-0414 | ❌ | [#2258](https://github.com/vllm-project/vllm-ascend/issues/2258) | |
| ChatGLM | ❌ | [#554](https://github.com/vllm-project/vllm-ascend/issues/554) | |
| Internlm | 🔵 | [#1962](https://github.com/vllm-project/vllm-ascend/issues/1962) | A2/A3 |
| Baichuan | 🔵 | | A2/A3 |
| Baichuan2 | 🔵 | | A2/A3 |
| Phi-4-mini | 🔵 | | A2/A3 |
| MiniCPM | 🔵 | | A2/A3 |
| MiniCPM3 | 🔵 | | A2/A3 |
| Ernie4.5 | 🔵 | | A2/A3 |
| Ernie4.5-Moe | 🔵 | | A2/A3 |
| Gemma-2 | 🔵 | | A2/A3 |
| Gemma-3 | 🔵 | | A2/A3 |
| Phi-3/4 | 🔵 | | A2/A3 |
| Mistral/Mistral-Instruct | 🔵 | | A2/A3 |
| DeepSeek V2.5 | 🟡 | Need test | |
| Mllama | 🟡 | Need test | |
| MiniMax-Text | 🟡 | Need test | |
@@ -60,13 +57,13 @@ Get the latest info here: <https://github.com/vllm-project/vllm-ascend/issues/16
| Model | Support | Note | Supported Hardware | Doc |
|-------------------------------|-----------|----------------------------------------------------------------------|--------------------------|------|
| Qwen3-Embedding | ✅ | | A2/A3 | [Qwen3_embedding](../../tutorials/models/Qwen3_embedding.md)|
| Qwen3-VL-Embedding | ✅ | | A2/A3 | [Qwen3-VL-Embedding](../../tutorials/models/Qwen3-VL-Embedding.md)|
| Qwen3-Reranker | ✅ | | A2/A3 | [Qwen3_reranker](../../tutorials/models/Qwen3_reranker.md)|
| Qwen3-VL-Reranker | ✅ | | A2/A3 | [Qwen3-VL-Reranker](../../tutorials/models/Qwen3-VL-Reranker.md)|
| Molmo | ✅ | [1942](https://github.com/vllm-project/vllm-ascend/issues/1942) | A2/A3 | |
| XLM-RoBERTa-based | ✅ | | A2/A3 | |
| Bert | ✅ | | A2/A3 | |
| Qwen3-Embedding | 🔵 | | A2/A3 | [Qwen3_embedding](../../tutorials/models/Qwen3_embedding.md)|
| Qwen3-VL-Embedding | 🔵 | | A2/A3 | [Qwen3-VL-Embedding](../../tutorials/models/Qwen3-VL-Embedding.md)|
| Qwen3-Reranker | 🔵 | | A2/A3 | [Qwen3_reranker](../../tutorials/models/Qwen3_reranker.md)|
| Qwen3-VL-Reranker | 🔵 | | A2/A3 | [Qwen3-VL-Reranker](../../tutorials/models/Qwen3-VL-Reranker.md)|
| Molmo | 🔵 | [1942](https://github.com/vllm-project/vllm-ascend/issues/1942) | A2/A3 | |
| XLM-RoBERTa-based | 🔵 | | A2/A3 | |
| Bert | 🔵 | | A2/A3 | |
## Multimodal Language Models
@@ -79,26 +76,26 @@ Get the latest info here: <https://github.com/vllm-project/vllm-ascend/issues/16
| Qwen2.5-VL | ✅ | | ✅ | A2/A3 | ✅ | ✅ | ✅ ||| ✅ | ✅ |||| ✅ | ✅ | ✅ | 30k || [Qwen-VL-Dense](../../tutorials/models/Qwen-VL-Dense.md) |
| Qwen3-VL | ✅ | ||A2/A3|||||||✅|||||✅|✅||| [Qwen-VL-Dense](../../tutorials/models/Qwen-VL-Dense.md) |
| Qwen3-VL-MOE | ✅ | | ✅ | A2/A3||✅|✅|||✅|✅|✅|✅|✅|✅|✅|✅|256k||[Qwen3-VL-MOE](../../tutorials/models/Qwen3-VL-235B-A22B-Instruct.md)|
| Qwen3-Omni-30B-A3B-Thinking | ✅ | ||A2/A3|||||||✅||✅|||||||[Qwen3-Omni-30B-A3B-Thinking](../../tutorials/models/Qwen3-Omni-30B-A3B-Thinking.md)|
| Qwen2.5-Omni | ✅ | || A2/A3 |||||||||||||||| [Qwen2.5-Omni](../../tutorials/models/Qwen2.5-Omni.md) |
| Qwen3-Omni-30B-A3B-Thinking | 🔵 | ||A2/A3|||||||✅||✅|||||||[Qwen3-Omni-30B-A3B-Thinking](../../tutorials/models/Qwen3-Omni-30B-A3B-Thinking.md)|
| Qwen2.5-Omni | 🔵 | || A2/A3 |||||||||||||||| [Qwen2.5-Omni](../../tutorials/models/Qwen2.5-Omni.md) |
#### Extended Compatible Models
| Model | Support | Note | Supported Hardware |
|--------------------------------|---------------|----------------------------------------------------------------------|--------------------|
| Qwen2-VL | ✅ | | A2/A3 |
| Qwen3-Omni | ✅ | | A2/A3 |
| QVQ | ✅ | | A2/A3 |
| Qwen2-Audio | ✅ | | A2/A3 |
| Aria | ✅ | | A2/A3 |
| LLaVA-Next | ✅ | | A2/A3 |
| LLaVA-Next-Video | ✅ | | A2/A3 |
| MiniCPM-V | ✅ | | A2/A3 |
| Mistral3 | ✅ | | A2/A3 |
| Phi-3-Vision/Phi-3.5-Vision | ✅ | | A2/A3 |
| Gemma3 | ✅ | | A2/A3 |
| Llama3.2 | ✅ | | A2/A3 |
| PaddleOCR-VL | ✅ | | A2/A3 |
| Qwen3-Omni | 🔵 | | A2/A3 |
| QVQ | 🔵 | | A2/A3 |
| Qwen2-Audio | 🔵 | | A2/A3 |
| Aria | 🔵 | | A2/A3 |
| LLaVA-Next | 🔵 | | A2/A3 |
| LLaVA-Next-Video | 🔵 | | A2/A3 |
| MiniCPM-V | 🔵 | | A2/A3 |
| Mistral3 | 🔵 | | A2/A3 |
| Phi-3-Vision/Phi-3.5-Vision | 🔵 | | A2/A3 |
| Gemma3 | 🔵 | | A2/A3 |
| Llama3.2 | 🔵 | | A2/A3 |
| PaddleOCR-VL | 🔵 | | A2/A3 |
| Llama4 | ❌ | [1972](https://github.com/vllm-project/vllm-ascend/issues/1972) | |
| Keye-VL-8B-Preview | ❌ | [1963](https://github.com/vllm-project/vllm-ascend/issues/1963) | |
| Florence-2 | ❌ | [2259](https://github.com/vllm-project/vllm-ascend/issues/2259) | |