Files
Sun Ruoxi 7f8a1b1f7a init v0.23.0
Signed-off-by: Sun Ruoxi <sunruoxi@4paradigm.com>
2026-08-27 15:11:51 +08:00

7.3 KiB

Feature Matrix

The table below shows mutually exclusive features and the support on Ascend hardware, extended from the vLLM table.

The symbols used have the following meanings:

  • ✅ = Full compatibility
  • 🟠 = Partial compatibility
  • ❌ = No compatibility
  • ❔ = Unknown or TBD
Feature ACLGraph Full_Decode_Only ACLGraph Piecewise Async Scheduling APC Chunked Prefill Context Parallel Cpu Binding DP Disaggregated Prefill Eagle3 Eplb EP Flashcomm1 KV Cache Pool Layer Sharding Lmhead TP Mlapo mm Multistream Moe Shared Expert DP Quantization W4A4 Quantization W4A8 Quantization W8A8 TP Weight nz
ACLGraph Full_Decode_Only ✅
ACLGraph Piecewise ❌ ✅
Async Scheduling ✅ ✅ ✅
APC ✅ ✅ ✅ ✅
Chunked Prefill ✅ ✅ ✅ ✅ ✅
Context Parallel ✅ ✅ ✅ ✅ ✅ ✅
Cpu Binding ✅ ✅ ✅ ✅ ✅ ✅ ✅
DP ✅ ✅ ✅ ✅ ✅ 🟠1 ✅ ✅
Disaggregated Prefill ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Eagle3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Eplb ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
EP ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Flashcomm1 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 🟠2 ✅ ✅ ✅ ✅
KV Cache Pool ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Layer Sharding ✅ ✅ ✅ ✅ ✅ 🟠 ✅ ✅ 🟠3 ✅ ✅ ✅ ✅ ❔ ✅
Lmhead TP ✅ ✅ ✅ ✅ ✅ ❔ ✅ 🟠4 ✅ ✅ ✅ ✅ ❌ ❔ ✅ ✅
Mlapo ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 🟠5 ✅ ✅ ✅ ❌ ❔ ❌ ✅ ✅
mm ✅ ✅ ✅ ✅ ✅ 🟠 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❌ ✅ ✅ ✅ ✅
Multistream Moe ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ✅ ✅
Shared Expert DP ✅ ✅ ✅ ✅ ✅ 🟠1 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ❔ ✅
Quantization W4A4 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❌ ❔ ❔ ✅ ❔ ✅ ❔ ❌ ❔ ❔ ✅
Quantization W4A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❌ ✅ ✅ ✅ ❔ ✅ ❔ ❌ ✅ ✅ ❔ ✅
Quantization W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅
TP ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Weight nz ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❌ 🟠 ✅ ✅ ✅
  • 1 Only dcp supports dp while pcp does not support dp.
  • 2 Flashcomm is only enabled on the prefill stage.
  • 3 Layer sharding is only enabled on the prefill stage.
  • 4 Lmhead TP is only enabled in the pure dp scenarios.
  • 5 MLAPO is only supported on the decode stage.