Files
enginex-ascend-910-vllm/tests/e2e/coverage.md
Sun Ruoxi 7f8a1b1f7a init v0.23.0
Signed-off-by: Sun Ruoxi <sunruoxi@4paradigm.com>
2026-08-27 15:11:51 +08:00

116 KiB

The coverage of e2e is as follows:

1-Card Tests

Test file Test method Model 310P Dense MoE Embedding Classification Reranker Mamba/SSM Multimodal Reasoning TP PP EP PCP DCP Context Parallel EPLB Dynamic EPLB Multistream MoE Full Graph Full Decode Only Graph Default FULL_AND_PIECEWISE Graph Piecewise Graph Eager Mode PD disaggregation W8A8 W4A8 FP16 LoRA Multi-LoRA Runtime LoRA updating Fully sharded LoRA parameterization Spec Decode MTP Eagle-3 SFA/DSA DSA CP Pooling runner Score API Classification API Distributed executor mp Flash Attention 3 FIA comparison Chunked Prefill Prefix Caching CPU/KV offloading KV transfer/events Sleep/Wake memory Xlite Graph CP KV Interleave Long Sequence FlashComm1 env Skipped Conditional skip Logprobs Batch inference Mixed lengths
_310p/test_classification_310p.py test_qwen_pooling_classify_correctness Howeee/Qwen2.5-1.5B-apeach ✅ ✅ ✅ ✅ ✅ ✅ ✅
_310p/test_dense_model_310p.py test_qwen3_5_dense_tp1_fp16 Qwen/Qwen3.5-4B ✅ ✅ ✅ ✅ ✅
_310p/test_dense_model_310p.py test_qwen3_5_dense_tp1_fp16_aclgraph Qwen/Qwen3.5-4B ✅ ✅ ✅ ✅ ✅ ✅
_310p/test_dense_model_310p.py test_qwen3_dense_tp1_fp16 Qwen/Qwen3-8B ✅ ✅ ✅ ✅ ✅
_310p/test_dense_model_310p.py test_qwen3_dense_tp1_fp16_aclgraph Qwen/Qwen3-8B ✅ ✅ ✅ ✅ ✅ ✅
_310p/test_dense_model_310p.py test_qwen3_dense_tp1_w8a8 vllm-ascend/Qwen3-8B-W8A8 ✅ ✅ ✅ ✅ ✅ ✅
_310p/test_embedding_310p.py test_bge_m3_correctness BAAI/bge-m3 ✅ ✅ ✅ ✅ ✅ ✅
_310p/test_embedding_310p.py test_embed_models_correctness Qwen/Qwen3-Embedding-0.6B
intfloat/multilingual-e5-small
✅ ✅ ✅ ✅ ✅ ✅
_310p/test_scoring_310p.py test_cross_encoder_score_1_to_1 BAAI/bge-reranker-v2-m3 ✅ ✅ ✅ ✅ ✅ ✅
_310p/test_scoring_310p.py test_cross_encoder_score_1_to_N BAAI/bge-reranker-v2-m3 ✅ ✅ ✅ ✅ ✅ ✅
_310p/test_scoring_310p.py test_cross_encoder_score_N_to_N BAAI/bge-reranker-v2-m3 ✅ ✅ ✅ ✅ ✅ ✅
_310p/test_vl_model_310p.py test_qwen3_vl_8b_tp1_fp16 Qwen/Qwen3-VL-8B-Instruct ✅ ✅ ✅ ✅
aclgraph/test_aclgraph_accuracy.py test_default_full_and_piecewise_res_consistency - ✅
aclgraph/test_aclgraph_accuracy.py test_full_decode_only_res_consistency - ✅
aclgraph/test_aclgraph_accuracy.py test_full_res_consistency - ✅
aclgraph/test_aclgraph_accuracy.py test_npugraph_ex_res_consistency - ✅
aclgraph/test_aclgraph_accuracy.py test_npugraph_ex_with_static_kernel - ✅
aclgraph/test_aclgraph_batch_invariant.py test_aclgraph_logprobs_bitwise_batch_invariance_bs1_vs_bsN - ✅ ✅ ✅ ✅ ✅
aclgraph/test_aclgraph_batch_invariant.py test_aclgraph_logprobs_without_batch_invariance_should_fail - ✅ ✅ ✅ ✅ ✅
aclgraph/test_aclgraph_batch_invariant.py test_aclgraph_simple_generation - ✅ ✅ ✅ ✅
aclgraph/test_aclgraph_batch_invariant.py test_aclgraph_v1_generation_is_deterministic_across_batch_sizes_with_needle - ✅ ✅ ✅ ✅
aclgraph/test_aclgraph_mem.py test_aclgraph_mem_use vllm-ascend/DeepSeek-V2-Lite-W8A8 ✅ ✅ ✅ ✅
compile/test_graphex_norm_quant_fusion.py test_rmsnorm_quant_fusion - ✅
compile/test_graphex_qknorm_rope_fusion.py test_rmsnorm_quant_fusion - ✅
compile/test_norm_quant_fusion.py test_rmsnorm_quant_fusion - ✅
lora/test_ilama_lora.py test_ilama_lora - ✅ ✅ ✅ ✅
lora/test_llama32_lora.py test_llama_lora - ✅ ✅ ✅
lora/test_lora_with_spec_decode.py test_batch_inference_correctness - ✅ ✅ ✅ ✅
lora/test_qwen35_densemodel_lora.py test_qwen35_text_lora - ✅
lora/test_qwen3_multi_loras.py test_multi_loras_with_tp_sync - ✅ ✅ ✅ ✅
lora/test_qwen3_reranker_lora.py test_reranker_models_lora - ✅ ✅ ✅
model_runner_v2/test_basic.py test_egale_spec_decoding Qwen/Qwen3-0.6B
vllm-ascend/DeepSeek-V2-Lite-W8A8
✅ ✅ ✅ ✅ ✅ ✅ ✅
model_runner_v2/test_basic.py test_qwen3_dense_eager_mode Qwen/Qwen3-0.6B
vllm-ascend/DeepSeek-V2-Lite-W8A8
✅ ✅ ✅ ✅ ✅ ✅ ✅
model_runner_v2/test_basic.py test_qwen3_dense_graph_mode Qwen/Qwen3-0.6B ✅ ✅ ✅ ✅
pooling/test_classification.py test_qwen_pooling_classify_correctness Howeee/Qwen2.5-1.5B-apeach ✅ ✅ ✅ ✅ ✅
pooling/test_embedding.py test_bge_m3_correctness BAAI/bge-m3 ✅ ✅ ✅ ✅
pooling/test_embedding.py test_causal_embed_models_using_prefix_caching_correctness Qwen/Qwen3-Embedding-0.6B ✅ ✅ ✅ ✅ ✅
pooling/test_embedding.py test_embed_models_correctness Qwen/Qwen3-Embedding-0.6B
intfloat/multilingual-e5-small
✅ ✅ ✅ ✅
pooling/test_scoring.py test_cross_encoder_score_1_to_1 BAAI/bge-reranker-v2-m3
dengcao/ms-marco-MiniLM-L6-v2
sentence-transformers/all-MiniLM-L12-v2
✅ ✅ ✅ ✅ ✅
pooling/test_scoring.py test_cross_encoder_score_1_to_N BAAI/bge-reranker-v2-m3
dengcao/ms-marco-MiniLM-L6-v2
sentence-transformers/all-MiniLM-L12-v2
✅ ✅ ✅ ✅ ✅
pooling/test_scoring.py test_cross_encoder_score_N_to_N BAAI/bge-reranker-v2-m3
dengcao/ms-marco-MiniLM-L6-v2
sentence-transformers/all-MiniLM-L12-v2
✅ ✅ ✅ ✅ ✅
pooling/test_scoring.py test_embedding_score_1_to_1 BAAI/bge-reranker-v2-m3
dengcao/ms-marco-MiniLM-L6-v2
sentence-transformers/all-MiniLM-L12-v2
✅ ✅ ✅ ✅ ✅
pooling/test_scoring.py test_embedding_score_1_to_N BAAI/bge-reranker-v2-m3
dengcao/ms-marco-MiniLM-L6-v2
sentence-transformers/all-MiniLM-L12-v2
✅ ✅ ✅ ✅ ✅
pooling/test_scoring.py test_embedding_score_N_to_N BAAI/bge-reranker-v2-m3
dengcao/ms-marco-MiniLM-L6-v2
sentence-transformers/all-MiniLM-L12-v2
✅ ✅ ✅ ✅ ✅
spec_decode/test_dflash.py test_dflash_acceptance - ✅ ✅ ✅ ✅ ✅
spec_decode/test_draft_parallel.py test_parallel_drafting_acceptance - ✅ ✅ ✅ ✅ ✅
spec_decode/test_eagle.py test_qwen3_vl_eagle - ✅
spec_decode/test_eagle.py test_qwen_eagle3_acceptance - ✅ ✅ ✅ ✅
spec_decode/test_extract_hidden_states.py test_extract_hidden_states_aclgraph_mode - ✅ ✅ ✅ ✅ ✅
spec_decode/test_extract_hidden_states.py test_extract_hidden_states_eager_mode - ✅ ✅ ✅ ✅ ✅
spec_decode/test_mtp_eagle_correctness.py test_deepseek_mtp wemaster/deepseek_mtp_main_random_bf16 ✅ ✅ ✅ ✅ ✅ ✅ ✅
spec_decode/test_ngram.py test_ngram - ✅ ✅
spec_decode/test_ngram_npu.py test_ngram_npu_async_acceptance - ✅ ✅ ✅ ✅
spec_decode/test_suffix.py test_suffix_acceptance - ✅ ✅
test_attention_fa3.py test_fa3_vs_fia_logprobs - ✅ ✅
test_attention_fa3.py test_fa3_vs_fia_mixed_lengths - ✅ ✅ ✅ ✅
test_attention_fa3.py test_fa3_vs_fia_single_prompt - ✅ ✅
test_attention_fa3.py test_fa3_vs_fia_with_chunkprefill - ✅ ✅
test_batch_invariant.py test_logprobs_bitwise_batch_invariance_bs1_vs_bsN - ✅ ✅ ✅ ✅ ✅
test_batch_invariant.py test_logprobs_without_batch_invariance_should_fail - ✅ ✅ ✅ ✅ ✅
test_batch_invariant.py test_simple_generation - ✅ ✅ ✅ ✅
test_batch_invariant.py test_v1_generation_is_deterministic_across_batch_sizes_with_needle - ✅ ✅ ✅ ✅
test_camem.py test_end_to_end Qwen/Qwen3-0.6B ✅ ✅ ✅
test_completion_with_prompt_embeds.py test_mixed_prompt_embeds_and_text Qwen/Qwen3-0.6B ✅ ✅ ✅
test_cpu_offloading.py test_cpu_offloading Qwen/Qwen3-0.6B ✅ ✅ ✅
test_guided_decoding.py test_guided_json_completion - ✅
test_guided_decoding.py test_guided_regex - ✅
test_minicpm.py test_minicpm OpenBMB/MiniCPM4-0.5B
openbmb/MiniCPM-2B-sft-bf16
✅ ✅
test_multi_instance.py test_two_instances_on_single_card - ✅
test_multistream_overlap_shared_expert.py test_models_with_multistream_overlap_shared_expert vllm-ascend/DeepSeek-V2-Lite-W8A8 ✅ ✅ ✅ ✅ ✅
test_qwen3_0_6b.py test_dense_default_full_and_piecewise_graph Qwen/Qwen3-0.6B ✅ ✅
test_qwen3_5_0_8b.py test_mamba_ssm_multimodal_reasoning_mtp_full_decode_only Qwen/Qwen3.5-0.8B ✅ ✅ ✅ ✅ ✅
test_qwen3_8b_w8a8.py test_dense_w8a8_eagle3_full_graph RedHatAI/Qwen3-8B-speculator.eagle3
vllm-ascend/Qwen3-8B-W8A8
✅ ✅ ✅ ✅ ✅
test_qwen3_embedding_0_6b.py test_embedding_full_decode_only Qwen/Qwen3-Embedding-0.6B ✅ ✅ ✅ ✅
test_sampler.py test_qwen3_exponential_overlap Qwen/Qwen3-0.6B ✅ ✅
test_sampler.py test_qwen3_prompt_logprobs Qwen/Qwen3-0.6B ✅ ✅ ✅
test_sampler.py test_qwen3_topk Qwen/Qwen3-0.6B ✅ ✅
test_vlm.py test_multimodal_audio Qwen/Qwen2-Audio-7B-Instruct ✅ ✅ ✅
test_vlm.py test_multimodal_vl openai-mirror/whisper-large-v3-turbo ✅ ✅ ✅
test_vlm.py test_multimodal_vl_language_model_only Qwen/Qwen3-VL-8B-Instruct ✅ ✅ ✅
test_vlm.py test_whisper openai-mirror/whisper-large-v3-turbo ✅ ✅ ✅
test_xlite.py test_models_with_xlite_decode_only - ✅ ✅
test_xlite.py test_models_with_xlite_full_mode - ✅

2-Card Tests

Test file Test method Model 310P Dense MoE Embedding Classification Reranker Mamba/SSM Multimodal Reasoning TP PP EP PCP DCP Context Parallel EPLB Dynamic EPLB Multistream MoE Full Graph Full Decode Only Graph Default FULL_AND_PIECEWISE Graph Piecewise Graph Eager Mode PD disaggregation W8A8 W4A8 FP16 LoRA Multi-LoRA Runtime LoRA updating Fully sharded LoRA parameterization Spec Decode MTP Eagle-3 SFA/DSA DSA CP Pooling runner Score API Classification API Distributed executor mp Flash Attention 3 FIA comparison Chunked Prefill Prefix Caching CPU/KV offloading KV transfer/events Sleep/Wake memory Xlite Graph CP KV Interleave Long Sequence FlashComm1 env Skipped Conditional skip Logprobs Batch inference Mixed lengths
aclgraph/test_aclgraph_capture_replay.py test_models_aclgraph_capture_replay_metrics_dp2 vllm-ascend/DeepSeek-V2-Lite-W8A8 ✅ ✅ ✅ ✅
aclgraph/test_full_graph_mode.py test_qwen3_moe_full_decode_only_tp2 Qwen/Qwen3-30B-A3B ✅ ✅ ✅ ✅
aclgraph/test_full_graph_mode.py test_qwen3_moe_full_graph_tp2 Qwen/Qwen3-30B-A3B ✅ ✅ ✅ ✅
lora/test_ilama_lora_tp2.py test_ilama_lora_tp2 - ✅ ✅ ✅ ✅ ✅
lora/test_llama32_lora_tp2.py test_llama_lora_tp2 - ✅ ✅ ✅ ✅
spec_decode/test_spec_decode.py test_eagle3_sp_acceptance - ✅ ✅ ✅ ✅ ✅ ✅
spec_decode/test_spec_decode.py test_p_eagle_acceptance - ✅ ✅ ✅ ✅ ✅ ✅
spec_decode/test_spec_decode.py test_qwen3_eagle3_pcp2_tp1 - ✅ ✅ ✅ ✅ ✅ ✅
test_data_parallel.py test_qwen3_inference_dp2 Qwen/Qwen3-30B-A3B
vllm-ascend/Qwen3-30B-A3B-W8A8
✅ ✅ ✅ ✅
test_deepseek_multistream_moe.py test_deepseek_multistream_moe_tp2 vllm-ascend/DeepSeek-V3-Pruning ✅ ✅ ✅ ✅ ✅
test_external_launcher.py test_qwen3_external_launcher Qwen/Qwen3-0.6B ✅ ✅ ✅
test_external_launcher.py test_qwen3_external_launcher_with_matmul_allreduce Qwen/Qwen3-0.6B ✅ ✅ ✅ ✅
test_external_launcher.py test_qwen3_external_launcher_with_sleepmode Qwen/Qwen3-8B ✅ ✅ ✅
test_external_launcher.py test_qwen3_external_launcher_with_sleepmode_level2 Qwen/Qwen3-8B ✅ ✅ ✅
test_external_launcher.py test_qwen3_moe_external_launcher_ep_tp2 Qwen/Qwen3-0.6B ✅ ✅ ✅
test_flashcomm_distributed.py test_deepseek_v2_lite_fc1_tp2 vllm-ascend/DeepSeek-V2-Lite-W8A8 ✅ ✅ ✅ ✅ ✅ ✅
test_flashcomm_distributed.py test_qwen3_dense_fc1_tp2 - ✅ ✅
test_flashcomm_distributed.py test_qwen3_dense_prefetch_mlp_weight_tp2 - ✅ ✅
test_flashcomm_distributed.py test_qwen3_moe_fc2_oshard_tp2 Qwen/Qwen3-30B-A3B ✅ ✅ ✅ ✅ ✅ ✅
test_gpt_oss_distributed.py test_gpt_oss_distributed_tp2 - ✅ ✅
test_moe_routing_replay.py test_qwen3_moe_routing_replay Qwen/Qwen3-30B-A3B
Qwen/Qwen3.5-35B-A3B
✅ ✅ ✅ ✅ ✅ ✅
test_offline_weight_load.py test_qwen3_offline_load_and_sleepmode_tp2 Qwen/Qwen3-30B-A3B ✅ ✅ ✅
test_prefix_caching.py test_models_prefix_cache_tp2 Qwen/Qwen3-8B
deepseek-ai/DeepSeek-V2-Lite-Chat
✅ ✅ ✅ ✅ ✅
test_qwen3_30b_a3b.py test_moe_tp_ep_eplb_full_decode_only Qwen/Qwen3-30B-A3B ✅ ✅ ✅
test_qwen3_6_27b_fia.py test_qwen3_6_27b_multimodel_fia_eager Qwen/Qwen3.6-27B/ ✅ ✅ ✅ ✅ ✅
test_qwen3_6_27b_fia.py test_qwen3_6_27b_multimodel_fia_acl_graph Qwen/Qwen3.6-27B/ ✅ ✅ ✅ ✅ ✅
test_qwen3_vl_30b_a3b_instruct.py test_multimodal_reasoning_pp_full_decode_only Qwen/Qwen3-VL-30B-A3B-Instruct ✅ ✅ ✅ ✅ ✅
test_sequence_parallelism_moe.py test_sequence_parallelism_moe_patterns - ✅
test_shared_expert_dp.py test_deepseek_v2_lite_enable_shared_expert_dp_tp2 deepseek-ai/DeepSeek-V2-Lite ✅ ✅
test_sp_pass.py test_qwen3_vl_sp_tp2 Qwen/Qwen3-VL-2B-Instruct ✅ ✅ ✅ ✅

4-Card Tests

Test file Test method Model 310P Dense MoE Embedding Classification Reranker Mamba/SSM Multimodal Reasoning TP PP EP PCP DCP Context Parallel EPLB Dynamic EPLB Multistream MoE Full Graph Full Decode Only Graph Default FULL_AND_PIECEWISE Graph Piecewise Graph Eager Mode PD disaggregation W8A8 W4A8 FP16 LoRA Multi-LoRA Runtime LoRA updating Fully sharded LoRA parameterization Spec Decode MTP Eagle-3 SFA/DSA DSA CP Pooling runner Score API Classification API Distributed executor mp Flash Attention 3 FIA comparison Chunked Prefill Prefix Caching CPU/KV offloading KV transfer/events Sleep/Wake memory Xlite Graph CP KV Interleave Long Sequence FlashComm1 env Skipped Conditional skip Logprobs Batch inference Mixed lengths
_310p/test_dense_model_310p.py test_qwen3_dense_tp2_fp16 Qwen/Qwen3-8B ✅ ✅ ✅ ✅ ✅ ✅
_310p/test_dense_model_310p.py test_qwen3_dense_tp4_w8a8 vllm-ascend/Qwen3-32B-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅
_310p/test_moe_model_310p.py test_qwen3_5_moe_tp4_fp16 Qwen/Qwen3.5-35B-A3B ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
_310p/test_moe_model_310p.py test_qwen3_moe_tp2_w8a8 vllm-ascend/Qwen3-30B-A3B-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
_310p/test_moe_model_310p.py test_qwen3_moe_tp4_fp16 Qwen/Qwen3-30B-A3B ✅ ✅ ✅ ✅ ✅ ✅ ✅
_310p/test_vl_model_310p.py test_qwen3_vl_8b_tp2_fp16 Qwen/Qwen3-VL-8B-Instruct ✅ ✅ ✅ ✅
context_parallel/test_accuracy.py test_accuracy_dcp_only_eager Qwen/Qwen3-8B
vllm-ascend/DeepSeek-V2-Lite-W8A8
✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_accuracy.py test_accuracy_dcp_only_graph Qwen/Qwen3-8B
vllm-ascend/DeepSeek-V2-Lite-W8A8
✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_accuracy.py test_accuracy_pcp_only Qwen/Qwen3-8B
vllm-ascend/DeepSeek-V2-Lite-W8A8
✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_accuracy.py test_models_long_sequence_cp_kv_interleave_size_output_between_tp_and_cp vllm-ascend/DeepSeek-V2-Lite-W8A8 ✅ ✅ ✅ ✅
context_parallel/test_accuracy.py test_models_long_sequence_output_between_tp_and_cp vllm-ascend/DeepSeek-V2-Lite-W8A8 ✅ ✅ ✅ ✅ ✅
context_parallel/test_basic.py test_dcp_basic deepseek-ai/DeepSeek-V2-Lite-Chat ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_basic.py test_dcp_full_graph deepseek-ai/DeepSeek-V2-Lite-Chat ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_basic.py test_dcp_piece_wise deepseek-ai/DeepSeek-V2-Lite-Chat ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_basic.py test_deepseek_v4_w4a8_dsa_cp_basic_greedy gdydems/DeepSeek-V4-Flash-w4a8-mtp ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_basic.py test_models_pcp_dcp_basic Qwen/Qwen3-Next-80B-A3B-Instruct
deepseek-ai/DeepSeek-V2-Lite-Chat
vllm-ascend/DeepSeek-V3.2-W8A8-Pruning
vllm-ascend/Qwen3-30B-A3B-W8A8
✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_basic.py test_models_pcp_dcp_full_graph deepseek-ai/DeepSeek-V2-Lite-Chat
vllm-ascend/Qwen3-30B-A3B-W8A8
✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_basic.py test_models_pcp_dcp_piece_wise deepseek-ai/DeepSeek-V2-Lite-Chat
vllm-ascend/Qwen3-30B-A3B-W8A8
✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_basic.py test_pcp_basic deepseek-ai/DeepSeek-V2-Lite-Chat ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_basic.py test_pcp_full_graph deepseek-ai/DeepSeek-V2-Lite-Chat ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_basic.py test_pcp_piece_wise deepseek-ai/DeepSeek-V2-Lite-Chat ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_basic.py test_qwen3_5_4b_multimodal_single_and_multi_image Qwen/Qwen3.5-4B ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_basic.py test_qwen3_vl_8b_multimodal_single_and_multi_image Qwen/Qwen3-VL-8B-Instruct ✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_chunked_prefill_cp.py test_models_chunked_prefill_mixed_length_prompts_including_1_token vllm-ascend/DeepSeek-V2-Lite-W8A8
vllm-ascend/Qwen3-30B-A3B-W8A8
✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_chunked_prefill_cp.py test_models_chunked_prefill_with_cp_basic vllm-ascend/DeepSeek-V2-Lite-W8A8
vllm-ascend/Qwen3-30B-A3B-W8A8
✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_chunked_prefill_cp.py test_models_chunked_prefill_with_cp_default_full_and_piecewise vllm-ascend/DeepSeek-V2-Lite-W8A8
vllm-ascend/Qwen3-30B-A3B-W8A8
✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_chunked_prefill_cp.py test_models_chunked_prefill_with_cp_full_graph vllm-ascend/DeepSeek-V2-Lite-W8A8
vllm-ascend/Qwen3-30B-A3B-W8A8
✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_chunked_prefill_cp.py test_models_chunked_prefill_with_empty_kvcache vllm-ascend/DeepSeek-V2-Lite-W8A8
vllm-ascend/Qwen3-30B-A3B-W8A8
✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_mtp.py test_dcp_mtp3_full_graph - ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_mtp.py test_pcp_dcp_mtp1_eager - ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_mtp.py test_pcp_dcp_mtp3_eager - ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_mtp.py test_pcp_dcp_mtp3_full_graph - ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_mtp.py test_pcp_dcp_mtp3_piecewise_graph - ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_mtp.py test_pcp_eagle3_eager - ✅ ✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_prefix_caching_cp.py test_models_prefix_cache_with_cp_basic vllm-ascend/DeepSeek-V2-Lite-W8A8
vllm-ascend/Qwen3-30B-A3B-W8A8
✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_prefix_caching_cp.py test_models_prefix_cache_with_cp_default_full_and_piecewise vllm-ascend/DeepSeek-V2-Lite-W8A8
vllm-ascend/Qwen3-30B-A3B-W8A8
✅ ✅ ✅ ✅ ✅ ✅
context_parallel/test_prefix_caching_cp.py test_models_prefix_cache_with_cp_full_graph vllm-ascend/DeepSeek-V2-Lite-W8A8
vllm-ascend/Qwen3-30B-A3B-W8A8
✅ ✅ ✅ ✅ ✅ ✅
spec_decode/test_mtp_qwen3_next.py test_qwen3_next_mtp_acceptance_tp4 Qwen/Qwen3-Next-80B-A3B-Instruct ✅ ✅ ✅ ✅ ✅ ✅ ✅
test_data_parallel_tp2.py test_qwen3_inference_dp2_tp2 Qwen/Qwen3-30B-A3B ✅ ✅ ✅
test_deepseek_v3_2_w8a8_pruning.py test_moe_w8a8_tp_pp_ep_full_decode_only vllm-ascend/DeepSeek-V3.2-W8A8-Pruning ✅ ✅ ✅ ✅ ✅ ✅
test_deepseek_v3_2_w8a8_pruning.py test_pd_disaggregation_w8a8_sfa_dsa_full_decode_only vllm-ascend/DeepSeek-V3.2-W8A8-Pruning ✅ ✅ ✅ ✅ ✅
test_deepseek_v4.py test_deepseek_v4_w4a8_tp4_basic_greedy gdydems/DeepSeek-V4-Flash-w4a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
test_deepseek_v4.py test_deepseek_v4_w4a8_tp4_index_cache_freq4 gdydems/DeepSeek-V4-Flash-w4a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
test_pipeline_parallel.py test_models_pp2_dp2 - ✅
test_pipeline_parallel.py test_models_pp2_tp2 - ✅
test_profiling_chunk_performance.py test_profiling_chunk_ttft_performance - ✅ ✅ ✅ ✅ ✅ ✅ ✅
test_qwen3_5.py test_qwen3_5_27b_distributed_mp_tp4 Qwen/Qwen3.5-27B ✅ ✅ ✅ ✅
test_qwen3_5.py test_qwen3_5_35b_distributed_mp_tp4 Qwen/Qwen3.5-35B-A3B ✅ ✅ ✅ ✅ ✅
test_qwen3_5.py test_qwen3_5_35b_distributed_mp_tp4_full_decode_only_mtp3 Qwen/Qwen3.5-35B-A3B ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
test_qwen3_5.py test_qwen3_5_35b_distributed_mp_tp4_full_decode_only_mtp3_flashcomm Qwen/Qwen3.5-35B-A3B ✅ ✅ ✅ ✅ ✅ ✅
test_qwen3_next.py test_qwen3_next_distributed_mp_flash_comm_tp4 Qwen/Qwen3-Next-80B-A3B-Instruct ✅ ✅ ✅ ✅ ✅
test_qwen3_next.py test_qwen3_next_distributed_mp_full_decode_only_tp4 Qwen/Qwen3-Next-80B-A3B-Instruct ✅ ✅ ✅ ✅
test_qwen3_next.py test_qwen3_next_distributed_mp_graph_mode_tp4 Qwen/Qwen3-Next-80B-A3B-Instruct ✅ ✅ ✅ ✅ ✅
test_qwen3_next.py test_qwen3_next_distributed_mp_tp4 Qwen/Qwen3-Next-80B-A3B-Instruct ✅ ✅ ✅ ✅
test_qwen3_next.py test_qwen3_next_w8a8dynamic_distributed_tp4_ep vllm-ascend/Qwen3-Next-80B-A3B-Instruct-W8A8 ✅ ✅ ✅ ✅ ✅

Nightly Tests

Test file Test method Model 310P Dense MoE Embedding Classification Reranker Mamba/SSM Multimodal Reasoning TP PP EP PCP DCP Context Parallel EPLB Dynamic EPLB Multistream MoE Full Graph Full Decode Only Graph Default FULL_AND_PIECEWISE Graph Piecewise Graph Eager Mode PD disaggregation W8A8 W4A8 FP16 LoRA Multi-LoRA Runtime LoRA updating Fully sharded LoRA parameterization Spec Decode MTP Eagle-3 SFA/DSA DSA CP Pooling runner Score API Classification API Distributed executor mp Flash Attention 3 FIA comparison Chunked Prefill Prefix Caching CPU/KV offloading KV transfer/events Sleep/Wake memory Xlite Graph CP KV Interleave Long Sequence FlashComm1 env Skipped Conditional skip Logprobs Batch inference Mixed lengths
310p/single_node/ops/singlecard_ops/test_recurrent_gated_delta_rule_v310.py test_recurrent_gated_delta_rule_v310 - ✅ ✅ ✅
multi_node/external_dp/config/GLM5_1-W8A8-EP-external.yaml multi-node-glm-5.1-w8a8-ep-external-dp Eco-Tech/GLM-5.1-w8a8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
multi_node/external_dp/scripts/test_external_dp.py test_external_dp - ✅
multi_node/internal_dp/config/DeepSeek-R1-W8A8-EPLB.yaml test DeepSeek-R1-W8A8 disaggregated_prefill vllm-ascend/DeepSeek-R1-0528-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
multi_node/internal_dp/config/DeepSeek-R1-W8A8-longseq.yaml test DeepSeek-R1-W8A8-longseq disaggregated_prefill vllm-ascend/DeepSeek-R1-0528-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
multi_node/internal_dp/config/DeepSeek-R1-W8A8.yaml test DeepSeek-R1-W8A8 disaggregated_prefill vllm-ascend/DeepSeek-R1-0528-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
multi_node/internal_dp/config/DeepSeek-V3.1-BF16.yaml test DeepSeek-V3.1-BF16 on A3 unsloth/DeepSeek-V3.1-BF16 ✅ ✅ ✅ ✅ ✅ ✅
multi_node/internal_dp/config/DeepSeek-V3_2-W8A8-A3-dual-nodes.yaml test DeepSeek-V3.2-W8A8 on A3 vllm-ascend/DeepSeek-V3.2-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
multi_node/internal_dp/config/DeepSeek-V3_2-W8A8-EP.yaml test DeepSeek-V3.2-W8A8-EP disaggregated_prefill vllm-ascend/DeepSeek-V3.2-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
multi_node/internal_dp/config/GLM5_1-W8A8-A2-dual-nodes.yaml multi-node-GLM-5.1-w8a8-A2 Eco-Tech/GLM-5.1-w8a8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
multi_node/internal_dp/config/GLM5_1-W8A8-A3-dual-nodes.yaml multi-node-GLM-5.1-w8a8-A3 Eco-Tech/GLM-5.1-w8a8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
multi_node/internal_dp/config/GLM5_1-W8A8-EP.yaml multi-node-GLM-5.1-w8a8-EP Eco-Tech/GLM-5.1-w8a8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
multi_node/internal_dp/config/Kimi-K2_5-W4A8-A2-dual-nodes.yaml test Kimi-K2.5-W4A8 A2 dual nodes Eco-Tech/Kimi-K2.5-W4A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
multi_node/internal_dp/config/Qwen3-235B-A22B-A2.yaml test Qwen3-235B-A22B multi-dp on A2 Qwen/Qwen3-235B-A22B ✅ ✅ ✅ ✅ ✅
multi_node/internal_dp/config/Qwen3-235B-A22B.yaml test Qwen3-235B-A22B multi-dp Qwen/Qwen3-235B-A22B ✅ ✅ ✅ ✅
multi_node/internal_dp/config/Qwen3-235B-W8A8-EPLB.yaml test Qwen3-235B-A22B-W8A8 disaggregated_prefill vllm-ascend/Qwen3-235B-A22B-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
multi_node/internal_dp/config/Qwen3-235B-W8A8-longseq.yaml test Qwen3-235B-A22B-W8A8-longseq disaggregated_prefill vllm-ascend/Qwen3-235B-A22B-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
multi_node/internal_dp/config/Qwen3-235B-W8A8.yaml test Qwen3-235B-A22B-W8A8 disaggregated_prefill vllm-ascend/Qwen3-235B-A22B-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅
multi_node/internal_dp/config/Qwen3-235B-disagg-pd.yaml test Qwen3-235B-A22B disaggregated_prefill Qwen/Qwen3-235B-A22B ✅ ✅ ✅ ✅ ✅ ✅
multi_node/internal_dp/config/Qwen3-VL-235B-disagg-pd.yaml test Qwen3-VL-235B-A22B disaggregated_prefill Qwen/Qwen3-VL-235B-A22B-Instruct ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/DeepSeek-R1-0528-W8A8.yaml DeepSeek-R1-0528-W8A8-EPLB vllm-ascend/DeepSeek-R1-0528-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/DeepSeek-R1-0528-W8A8.yaml DeepSeek-R1-0528-W8A8-aclgraph vllm-ascend/DeepSeek-R1-0528-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/DeepSeek-R1-0528-W8A8.yaml DeepSeek-R1-0528-W8A8-single vllm-ascend/DeepSeek-R1-0528-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/DeepSeek-V3.2-W8A8.yaml DeepSeek-V3.2-W8A8-TP8-DP2 vllm-ascend/DeepSeek-V3.2-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/DeepSeek-V4-Flash-W8A8-A3.yaml DeepSeek-V4-Flash-W8A8-A3 Eco-Tech/DeepSeek-V4-Flash-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/GLM-4.7.yaml GLM-4.7-TP8-DP2-decodegraph Eco-Tech/GLM-4.7-W8A8-floatmtp ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Hy3-preview.yaml Hy3-preview-TP16-EP-MTP Tencent-Hunyuan/Hy3-preview ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Kimi-K2-Thinking.yaml Kimi-K2-Thinking-TP16-Case moonshotai/Kimi-K2-Thinking ✅ ✅ ✅ ✅
single_node/models/configs/Kimi-K2.5.yaml Kimi-K2.5-W4A8-Case Eco-Tech/Kimi-K2.5-W4A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/MTPX-DeepSeek-R1-0528-W8A8.yaml MTPX-DeepSeek-R1-0528-W8A8-mtp2 vllm-ascend/DeepSeek-R1-0528-W8A8 ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/MTPX-DeepSeek-R1-0528-W8A8.yaml MTPX-DeepSeek-R1-0528-W8A8-mtp3 vllm-ascend/DeepSeek-R1-0528-W8A8 ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/MiniMax-M2.5-w8a8-QuaRot-A2.yaml MiniMax-M2.5-w8a8 Eco-Tech/MiniMax-M2.5-w8a8-QuaRot ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/MiniMax-M2.5-w8a8-QuaRot-A3.yaml MiniMax-M2.5-w8a8 Eco-Tech/MiniMax-M2.5-w8a8-QuaRot ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Prefix-Cache-DeepSeek-R1-0528-W8A8.yaml prefix-cache-deepseek-r1-0528-w8a8 vllm-ascend/DeepSeek-R1-0528-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Prefix-Cache-Qwen3-32B-Int8.yaml prefix-cache-qwen3-32b-w8a8 vllm-ascend/Qwen3-32B-W8A8 ✅ ✅ ✅ ✅
single_node/models/configs/Qwen3-235B-A22B-W8A8.yaml Qwen3-235B-A22B-W8A8-EPLB vllm-ascend/Qwen3-235B-A22B-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Qwen3-235B-A22B-W8A8.yaml Qwen3-235B-A22B-W8A8-full_graph vllm-ascend/Qwen3-235B-A22B-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Qwen3-235B-A22B-W8A8.yaml Qwen3-235B-A22B-W8A8-piecewise vllm-ascend/Qwen3-235B-A22B-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Qwen3-30B-A3B-W4A8-llm-compressor.yaml Qwen3-30B-A3B-W4A8-llm-compressor vllm-ascend/Qwen3-30B-A3B-Instruct-2507-quantized.w4a8 ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Qwen3-30B-A3B-W8A8.yaml Qwen3-30B-A3B-W8A8-TP1 vllm-ascend/Qwen3-30B-A3B-W8A8 ✅ ✅ ✅
single_node/models/configs/Qwen3-30B-QuaRot-eagle3.yaml Qwen3-30B-QuaRot vllm-ascend/Qwen3-30B-A3B-W8A8-QuaRot ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Qwen3-32B-Int8-A2.yaml Qwen3-32B-W8A8-aclgraph-a2 vllm-ascend/Qwen3-32B-W8A8 ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Qwen3-32B-Int8-A2.yaml Qwen3-32B-W8A8-single-a2 vllm-ascend/Qwen3-32B-W8A8 ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Qwen3-32B-Int8.yaml Qwen3-32B-W8A8-aclgraph-a3 vllm-ascend/Qwen3-32B-W8A8 ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Qwen3-32B-Int8.yaml Qwen3-32B-W8A8-single-a3 vllm-ascend/Qwen3-32B-W8A8 ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Qwen3-32B-QuaRot-eagle3.yaml Qwen3-32B-QuaRot vllm-ascend/Qwen3-32B-W8A8-QuaRot ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Qwen3-VL-235B-A22B-Instruct-W8A8.yaml Qwen3-VL-235B-A22B-Instruct-W8A8 Eco-Tech/Qwen3-VL-235B-A22B-Instruct-w8a8-QuaRot ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Qwen3-VL-32B-Instruct-W8A8.yaml Qwen3-VL-32B-Instruct-W8A8 Eco-Tech/Qwen3-VL-32B-Instruct-w8a8-QuaRot ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Qwen3.5-122B-A10B-W8A8-A3.yaml Qwen3.5-122B-A10B-W8A8-A3 Eco-Tech/Qwen3.5-122B-A10B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Qwen3.5-27B-w8a8-A2.yaml Qwen3.5-27B-w8a8 Eco-Tech/Qwen3.5-27B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Qwen3.5-27B-w8a8-A3.yaml Qwen3.5-27B-w8a8 Eco-Tech/Qwen3.5-27B-w8a8-mtp ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Qwen3.5-397B-A17B-W8A8-mtp-A3.yaml Qwen3.5-397B-A17B-w8a8-mtp Eco-Tech/Qwen3.5-397B-A17B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/models/configs/Qwen3.5-397B-A17B-w4a8-mtp-A2.yaml Qwen3.5-397B-A17B-w4a8-mtp Eco-Tech/Qwen3.5-397B-A17B-w4a8-mtp ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/ops/multicard_ops_a2/test_matmul_allreduce_add_rmsnorm.py test_matmul_allreduce_add_rmsnorm_kernel - ✅
single_node/ops/multicard_ops_a3/test_dispatch_ffn_combine.py test_dispatch_ffn_combine_kernel - ✅
single_node/ops/multicard_ops_a3/test_dispatch_ffn_combine_bf16.py test_dispatch_ffn_combine_kernel - ✅
single_node/ops/multicard_ops_a3/test_dispatch_ffn_combine_w4a8.py test_dispatch_ffn_combine_kernel - ✅
single_node/ops/multicard_ops_a3/test_dispatch_gmm_combine_decode.py test_dispatch_gmm_combine_decode_base - ✅
single_node/ops/multicard_ops_a3/test_dispatch_gmm_combine_decode.py test_dispatch_gmm_combine_decode_dynamic_eplb - ✅
single_node/ops/multicard_ops_a3/test_dispatch_gmm_combine_decode.py test_dispatch_gmm_combine_decode_with_mc2_mask - ✅
single_node/ops/singlecard_ops/test_add_rms_norm_bias.py test_quant_fpx_linear - ✅
single_node/ops/singlecard_ops/test_batch_matmul_transpose.py test_boundary_conditions - ✅
single_node/ops/singlecard_ops/test_batch_matmul_transpose.py test_random_shapes - ✅
single_node/ops/singlecard_ops/test_batch_matmul_transpose.py test_zero_values - ✅
single_node/ops/singlecard_ops/test_bgmv_expand.py test_bgmv_expand - ✅
single_node/ops/singlecard_ops/test_bgmv_shrink.py test_bgmv_shrink - ✅
single_node/ops/singlecard_ops/test_causal_conv1d_310.py test_ascend_causal_conv1d_310_fn - ✅ ✅
single_node/ops/singlecard_ops/test_causal_conv1d_310.py test_causal_conv1d_310_update - ✅ ✅
single_node/ops/singlecard_ops/test_copy_and_expand_eagle_inputs.py test_copy_and_expand_eagle_inputs - ✅
single_node/ops/singlecard_ops/test_copy_and_expand_eagle_inputs.py test_large_tokens_per_request - ✅
single_node/ops/singlecard_ops/test_copy_and_expand_eagle_inputs.py test_large_tokens_shift_true - ✅
single_node/ops/singlecard_ops/test_copy_and_expand_eagle_inputs.py test_minimal_case - ✅
single_node/ops/singlecard_ops/test_copy_and_expand_eagle_inputs.py test_no_rejected_tokens - ✅
single_node/ops/singlecard_ops/test_dequant_swiglu_quant.py test_npu_dequant_swiglu_quant_with_limit - ✅
single_node/ops/singlecard_ops/test_fused_gdn_gating.py test_fused_gdn_gating_bulk_dma_alignment - ✅
single_node/ops/singlecard_ops/test_fused_gdn_gating.py test_fused_gdn_gating_extreme_large_batch - ✅ ✅
single_node/ops/singlecard_ops/test_fused_gdn_gating.py test_fused_gdn_gating_large_batch_multi_row - ✅ ✅
single_node/ops/singlecard_ops/test_fused_gdn_gating.py test_fused_gdn_gating_non_bulk_dma_fallback - ✅
single_node/ops/singlecard_ops/test_fused_gdn_gating.py test_fused_gdn_gating_non_default_params - ✅
single_node/ops/singlecard_ops/test_fused_gdn_gating.py test_fused_gdn_gating_output_shapes - ✅
single_node/ops/singlecard_ops/test_fused_gdn_gating.py test_fused_gdn_gating_small_batch_optimization - ✅ ✅
single_node/ops/singlecard_ops/test_fused_gdn_gating.py test_fused_gdn_gating_vs_reference - ✅
single_node/ops/singlecard_ops/test_fused_moe.py test_select_experts - ✅ ✅
single_node/ops/singlecard_ops/test_fused_moe.py test_select_experts_invalid_scoring_func - ✅ ✅
single_node/ops/singlecard_ops/test_fused_moe.py test_token_dispatcher_with_all_gather - ✅ ✅
single_node/ops/singlecard_ops/test_fused_moe.py test_token_dispatcher_with_all_gather_quant - ✅ ✅ ✅
single_node/ops/singlecard_ops/test_gating_top_k_softmax.py test_quant_fpx_linear - ✅
single_node/ops/singlecard_ops/test_gmm_swiglu_quant_weight_nz_tensor_list.py test_gmm_swiglu_quant_weight_nz_tensor_list - ✅
single_node/ops/singlecard_ops/test_grouped_matmul_swiglu_quant.py test_grouped_matmul_swiglu_quant_kernel - ✅
single_node/ops/singlecard_ops/test_hamming_dist_top_k.py test_hamming_dist_top_k - ✅
single_node/ops/singlecard_ops/test_hamming_dist_top_k.py test_hamming_dist_top_k_compare - ✅
single_node/ops/singlecard_ops/test_mla_preprocess.py test_mla_preprocess_kernel - ✅ ✅
single_node/ops/singlecard_ops/test_mla_preprocess_nq.py test_mla_preprocess_kernel - ✅ ✅
single_node/ops/singlecard_ops/test_mla_preprocess_qdown.py test_mla_preprocess_kernel - ✅ ✅
single_node/ops/singlecard_ops/test_moe_init_routing_custom.py test_moe_init_routing_custom - ✅
single_node/ops/singlecard_ops/test_ngram_spec_decode.py test_ngram_spec_decode_attrs - ✅
single_node/ops/singlecard_ops/test_ngram_spec_decode.py test_ngram_spec_decode_basic - ✅
single_node/ops/singlecard_ops/test_ngram_spec_decode.py test_ngram_spec_decode_decode - ✅
single_node/ops/singlecard_ops/test_ngram_spec_decode.py test_ngram_spec_decode_discard - ✅
single_node/ops/singlecard_ops/test_ngram_spec_decode.py test_ngram_spec_decode_exact_match - ✅
single_node/ops/singlecard_ops/test_ngram_spec_decode.py test_ngram_spec_decode_full_capacity - ✅
single_node/ops/singlecard_ops/test_ngram_spec_decode.py test_ngram_spec_decode_k1 - ✅
single_node/ops/singlecard_ops/test_ngram_spec_decode.py test_ngram_spec_decode_minimal - ✅
single_node/ops/singlecard_ops/test_ngram_spec_decode.py test_ngram_spec_decode_no_valid_sampled - ✅
single_node/ops/singlecard_ops/test_ngram_spec_decode.py test_ngram_spec_decode_padding - ✅
single_node/ops/singlecard_ops/test_ngram_spec_decode.py test_ngram_spec_decode_prefill - ✅
single_node/ops/singlecard_ops/test_npu_hc_pre.py test_npu_hc_pre_v1_v2_bf16_3d_input - ✅
single_node/ops/singlecard_ops/test_npu_hc_pre.py test_npu_hc_pre_v1_v2_bf16_4d_input - ✅
single_node/ops/singlecard_ops/test_npu_moe_gating_top_k.py test_npu_moe_gating_topk_compare - ✅
single_node/ops/singlecard_ops/test_recurrent_gated_delta_rule.py test_recurrent_gated_delta_rule - ✅
single_node/ops/singlecard_ops/test_recurrent_gated_delta_rule.py test_recurrent_gated_delta_rule_no_accepted - ✅
single_node/ops/singlecard_ops/test_recurrent_gated_delta_rule_310.py test_fused_recurrent_gated_delta_rule_310 - ✅ ✅
single_node/ops/singlecard_ops/test_reshape_and_cache_bnsd.py test_reshape_and_cache_bnsd_bf16_shape - ✅
single_node/ops/singlecard_ops/test_reshape_and_cache_bnsd.py test_reshape_and_cache_bnsd_compare - ✅
single_node/ops/singlecard_ops/test_reshape_and_cache_bnsd.py test_reshape_and_cache_bnsd_with_expected_output - ✅
single_node/ops/singlecard_ops/test_transpose_kv_cache_by_block.py test_transpose_kv_cache_by_block - ✅
single_node/ops/singlecard_ops/test_vocabparallelembedding.py test_get_masked_input_and_mask - ✅
single_node/ops/singlecard_ops/triton/test_apply_penalties_triton.py test_apply_all_penalties_v1_vs_ascend - ✅ ✅
single_node/ops/singlecard_ops/triton/test_bad_words.py test_apply_bad_words_different_shapes - ✅
single_node/ops/singlecard_ops/triton/test_bad_words.py test_apply_bad_words_edge_cases - ✅
single_node/ops/singlecard_ops/triton/test_bad_words.py test_apply_bad_words_no_bad_words - ✅
single_node/ops/singlecard_ops/triton/test_bad_words.py test_apply_bad_words_token_limit - ✅
single_node/ops/singlecard_ops/triton/test_batch_memcpy.py test_batch_memcpy - ✅ ✅
single_node/ops/singlecard_ops/triton/test_bincount.py test_bincount_kernel - ✅ ✅
single_node/ops/singlecard_ops/triton/test_causal_conv1d.py test_ascend_causal_conv1d - ✅
single_node/ops/singlecard_ops/triton/test_causal_conv1d.py test_causal_conv1d - ✅ ✅
single_node/ops/singlecard_ops/triton/test_causal_conv1d.py test_causal_conv1d_update_qwen3_next_shape - ✅ ✅
single_node/ops/singlecard_ops/triton/test_causal_conv1d.py test_causal_conv1d_update_with_batch_gather - ✅ ✅ ✅
single_node/ops/singlecard_ops/triton/test_chunk_gated_delta_rule.py test_chunk_gated_delta_rule_310_state_layout_matches_vllm - ✅
single_node/ops/singlecard_ops/triton/test_chunk_gated_delta_rule.py test_triton_fusion_ops - ✅
single_node/ops/singlecard_ops/triton/test_clear_ssm_states.py test_clear_ssm_states_ref_parity - ✅
single_node/ops/singlecard_ops/triton/test_compute_slot_mapping.py test_compute_slot_mapping_npu_kernel - ✅
single_node/ops/singlecard_ops/triton/test_compute_token_logprobs.py test_topk_log_softmax_deterministic - ✅ ✅
single_node/ops/singlecard_ops/triton/test_compute_token_logprobs.py test_topk_log_softmax_dtypes - ✅ ✅
single_node/ops/singlecard_ops/triton/test_compute_token_logprobs.py test_topk_log_softmax_edge_cases - ✅ ✅
single_node/ops/singlecard_ops/triton/test_compute_token_logprobs.py test_topk_log_softmax_kernel - ✅ ✅
single_node/ops/singlecard_ops/triton/test_compute_topk_logprobs.py test_compute_topk_logprobs - ✅
single_node/ops/singlecard_ops/triton/test_fused_gdn_gating.py test_fused_gdn_gating_310p_parity_precision - ✅
single_node/ops/singlecard_ops/triton/test_fused_qkvzba_split_reshape_cat.py test_fused_qkvzba_split_reshape_cat - ✅
single_node/ops/singlecard_ops/triton/test_fused_recurrent_gated_delta_rule.py test_fused_recurrent_gated_delta_rule_310_state_layout_matches_vllm - ✅
single_node/ops/singlecard_ops/triton/test_fused_recurrent_gated_delta_rule.py test_fused_recurrent_gated_delta_rule_310p_parity_precision - ✅ ✅
single_node/ops/singlecard_ops/triton/test_fused_sigmoid_gating_delta_rule.py test_triton_fusion_ops - ✅
single_node/ops/singlecard_ops/triton/test_l2norm.py test_l2norm - ✅
single_node/ops/singlecard_ops/triton/test_log_softmax.py test_topk_log_softmax_kernel - ✅
single_node/ops/singlecard_ops/triton/test_min_p.py test_apply_min_p_kernel - ✅
single_node/ops/singlecard_ops/triton/test_mrope.py test_mrotary_embedding_triton_kernel - ✅
single_node/ops/singlecard_ops/triton/test_muls_add.py test_muls_add_triton_correctness - ✅
single_node/ops/singlecard_ops/triton/test_penality.py test_apply_penalties - ✅ ✅
single_node/ops/singlecard_ops/triton/test_post_update.py test_post_update - ✅ ✅
single_node/ops/singlecard_ops/triton/test_prepare_inputs_padded.py test_prepare_inputs_padded - ✅
single_node/ops/singlecard_ops/triton/test_rejection_sample.py test_rejection_random_sample - ✅ ✅
single_node/ops/singlecard_ops/triton/test_rejection_sample.py test_rejection_sampler_block_verify_triton_kernel - ✅ ✅
single_node/ops/singlecard_ops/triton/test_rope.py test_rotary_embedding_triton_kernel - ✅
single_node/ops/singlecard_ops/triton/test_rope.py test_rotary_embedding_triton_kernel_siso - ✅
single_node/ops/singlecard_ops/triton/test_rope.py test_rotary_embedding_triton_kernel_with_cos_sin_cache - ✅
single_node/ops/singlecard_ops/triton/test_split_qkv_rmsnorm_mrope.py test_split_qkv_rmsnorm_mrope - ✅
single_node/ops/singlecard_ops/triton/test_split_qkv_rmsnorm_rope.py test_split_qkv_rmsnorm_rope - ✅
single_node/ops/singlecard_ops/triton/test_split_qkv_rmsnorm_rope.py test_split_qkv_rmsnorm_rope_with_bias - ✅
single_node/ops/singlecard_ops/triton/test_split_qkv_tp_rmsnorm_rope.py test_split_qkv_tp_rmsnorm_rope - ✅
single_node/ops/singlecard_ops/triton/test_temperature.py test_temperature_kernel - ✅

Weekly Tests

Test file Test method Model 310P Dense MoE Embedding Classification Reranker Mamba/SSM Multimodal Reasoning TP PP EP PCP DCP Context Parallel EPLB Dynamic EPLB Multistream MoE Full Graph Full Decode Only Graph Default FULL_AND_PIECEWISE Graph Piecewise Graph Eager Mode PD disaggregation W8A8 W4A8 FP16 LoRA Multi-LoRA Runtime LoRA updating Fully sharded LoRA parameterization Spec Decode MTP Eagle-3 SFA/DSA DSA CP Pooling runner Score API Classification API Distributed executor mp Flash Attention 3 FIA comparison Chunked Prefill Prefix Caching CPU/KV offloading KV transfer/events Sleep/Wake memory Xlite Graph CP KV Interleave Long Sequence FlashComm1 env Skipped Conditional skip Logprobs Batch inference Mixed lengths
multi_node/internal_dp/config/DeepSeek-V3.yaml test DeepSeek-V3 disaggregated_prefill vllm-ascend/DeepSeek-V3-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅
multi_node/internal_dp/config/DeepSeek-V3_2-W8A8-EP_weekly.yaml weekly test DeepSeek-V3.2-W8A8-EP disaggregated_prefill vllm-ascend/DeepSeek-V3.2-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
multi_node/internal_dp/config/GLM-4.7-W8A8C8-Mooncake-Layerwise.yaml test GLM-4.7-W8A8C8 PD separation with mooncake layerwise connector vllm-ascend/GLM-4.7-W8A8C8 ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/DeepSeek-V3.2-W8A8_A3_weekly.yaml DeepSeek-V3.2-W8A8-weekly vllm-ascend/DeepSeek-V3.2-W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/GLM-5.yaml GLM-5-TP16-DP1-decodegraph Eco-Tech/GLM-5-w4a8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/GLM-5_1-W8A8_A3_weekly.yaml GLM-5_1-w8a8-High—Throughput-bs10 Eco-Tech/GLM-5.1-w8a8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/GLM-5_1-W8A8_A3_weekly.yaml GLM-5_1-w8a8-High—Throughput-bs20 Eco-Tech/GLM-5.1-w8a8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/GLM-5_1-W8A8_A3_weekly.yaml GLM-5_1-w8a8-High—Throughput-bs32 Eco-Tech/GLM-5.1-w8a8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/GLM-5_1-W8A8_A3_weekly.yaml GLM-5_1-w8a8-High—Throughput-bs8 Eco-Tech/GLM-5.1-w8a8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Kimi-K2.5-32k-512.yaml Kimi-K2.5-W4A8-TOPT20-32k-0.5k Eco-Tech/Kimi-K2.5-W4A8 ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Kimi-K2.5-32k-512.yaml Kimi-K2.5-W4A8-TOPT20-32k-0.5k-pc90 Eco-Tech/Kimi-K2.5-W4A8 ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Kimi-K2.5-32k-512.yaml Kimi-K2.5-W4A8-TOPT50-32k-0.5k Eco-Tech/Kimi-K2.5-W4A8 ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Kimi-K2.5-32k-512.yaml Kimi-K2.5-W4A8-TOPT50-32k-0.5k-prefix-cache90 Eco-Tech/Kimi-K2.5-W4A8 ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Kimi-K2.5.yaml Kimi-K2.5-W4A8-Case Eco-Tech/Kimi-K2.5-W4A8 ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Kimi-K2.5.yaml Kimi-K2.5-W4A8-TOPT20-128k-1k-pc90 Eco-Tech/Kimi-K2.5-W4A8 ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Kimi-K2.5.yaml Kimi-K2.5-W4A8-TOPT20-16k-1k Eco-Tech/Kimi-K2.5-W4A8 ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Kimi-K2.5.yaml Kimi-K2.5-W4A8-TOPT20-64k-1k-pc90 Eco-Tech/Kimi-K2.5-W4A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Kimi-K2.5.yaml Kimi-K2.5-W4A8-TOPT50-128k-1k-pc90 Eco-Tech/Kimi-K2.5-W4A8 ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Kimi-K2.5.yaml Kimi-K2.5-W4A8-TOPT50-16k-1k Eco-Tech/Kimi-K2.5-W4A8 ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Kimi-K2.5.yaml Kimi-K2.5-W4A8-TOPT50-64k-1k-pc90 Eco-Tech/Kimi-K2.5-W4A8 ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/MiniMax-M2.5-W8A8-A3.yaml MiniMax-M2.5-w8a8 Eco-Tech/MiniMax-M2.5-w8a8-QuaRot ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/MiniMax-M2.5-w8a8-QuaRot-A3.yaml MiniMax-M2.5-w8a8 Eco-Tech/MiniMax-M2.5-w8a8-QuaRot ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/MiniMax-M2.5-w8a8-QuaRot-A3.yaml MiniMax-M2.5-w8a8-in128k-32-8 Eco-Tech/MiniMax-M2.5-w8a8-QuaRot ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/MiniMax-M2.5-w8a8-QuaRot-A3.yaml MiniMax-M2.5-w8a8-in128k-4-1 Eco-Tech/MiniMax-M2.5-w8a8-QuaRot ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/MiniMax-M2.5-w8a8-QuaRot-A3.yaml MiniMax-M2.5-w8a8-in128k-64-16 Eco-Tech/MiniMax-M2.5-w8a8-QuaRot ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/MiniMax-M2.5-w8a8-QuaRot-A3.yaml MiniMax-M2.5-w8a8-in16k-120-30 Eco-Tech/MiniMax-M2.5-w8a8-QuaRot ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/MiniMax-M2.5-w8a8-QuaRot-A3.yaml MiniMax-M2.5-w8a8-in16k-16-4 Eco-Tech/MiniMax-M2.5-w8a8-QuaRot ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/MiniMax-M2.5-w8a8-QuaRot-A3.yaml MiniMax-M2.5-w8a8-in32k-36-9 Eco-Tech/MiniMax-M2.5-w8a8-QuaRot ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/MiniMax-M2.5-w8a8-QuaRot-A3.yaml MiniMax-M2.5-w8a8-in32k-4-1 Eco-Tech/MiniMax-M2.5-w8a8-QuaRot ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/MiniMax-M2.5-w8a8-QuaRot-A3.yaml MiniMax-M2.5-w8a8-in32k-4-1-90 Eco-Tech/MiniMax-M2.5-w8a8-QuaRot ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/MiniMax-M2.5-w8a8-QuaRot-A3.yaml MiniMax-M2.5-w8a8-in32k-80-20 Eco-Tech/MiniMax-M2.5-w8a8-QuaRot ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/MiniMax-M2.5-w8a8-QuaRot-A3.yaml MiniMax-M2.5-w8a8-in64k-4-1 Eco-Tech/MiniMax-M2.5-w8a8-QuaRot ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/MiniMax-M2.5-w8a8-QuaRot-A3.yaml MiniMax-M2.5-w8a8-in64k-72-18 Eco-Tech/MiniMax-M2.5-w8a8-QuaRot ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen2.5-VL-7B-Instruct-EPD.yaml Qwen2.5-VL-7B-Instruct-epd Qwen/Qwen2.5-VL-7B-Instruct ✅ ✅
single_node/configs/Qwen3-32B.yaml Qwen3-32B-TP4 Qwen/Qwen3-32B ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-122B-A10B-W8A8-A2.yaml Qwen3.5-122B-A10B-W8A8-single-A2 Eco-Tech/Qwen3.5-122B-A10B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-122B-A10B-W8A8-A3.yaml Qwen3.5-122B-A10B-W8A8-A3 Eco-Tech/Qwen3.5-122B-A10B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-122B-A10B-W8A8-A3.yaml Qwen3.5-122B-A10B-W8A8-TPOT20-16k-1k Eco-Tech/Qwen3.5-122B-A10B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-122B-A10B-W8A8-A3.yaml Qwen3.5-122B-A10B-W8A8-TPOT20-32k-0.5k Eco-Tech/Qwen3.5-122B-A10B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-122B-A10B-W8A8-A3.yaml Qwen3.5-122B-A10B-W8A8-TPOT20-64k-1k Eco-Tech/Qwen3.5-122B-A10B-w8a8-mtp ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-122B-A10B-W8A8-A3.yaml Qwen3.5-122B-A10B-W8A8-TPOT50-16k-1k Eco-Tech/Qwen3.5-122B-A10B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-122B-A10B-W8A8-A3.yaml Qwen3.5-122B-A10B-W8A8-TPOT50-32k-0.5k Eco-Tech/Qwen3.5-122B-A10B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-122B-A10B-W8A8-A3.yaml Qwen3.5-122B-A10B-W8A8-TPOT50-64k-1k Eco-Tech/Qwen3.5-122B-A10B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-27B-w8a8-A3.yaml Qwen3.5-27B-w8a8 Eco-Tech/Qwen3.5-27B-w8a8-mtp ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-27B-w8a8-A3.yaml Qwen3.5-27B-w8a8-in128k-28-7 Eco-Tech/Qwen3.5-27B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-27B-w8a8-A3.yaml Qwen3.5-27B-w8a8-in128k-4-1 Eco-Tech/Qwen3.5-27B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-27B-w8a8-A3.yaml Qwen3.5-27B-w8a8-in16k-16-4 Eco-Tech/Qwen3.5-27B-w8a8-mtp ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-27B-w8a8-A3.yaml Qwen3.5-27B-w8a8-in16k-56-14 Eco-Tech/Qwen3.5-27B-w8a8-mtp ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-27B-w8a8-A3.yaml Qwen3.5-27B-w8a8-in32k-16-4 Eco-Tech/Qwen3.5-27B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-27B-w8a8-A3.yaml Qwen3.5-27B-w8a8-in32k-56-14 Eco-Tech/Qwen3.5-27B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-27B-w8a8-A3.yaml Qwen3.5-27B-w8a8-in32k-8-2 Eco-Tech/Qwen3.5-27B-w8a8-mtp ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-27B-w8a8-A3.yaml Qwen3.5-27B-w8a8-in64k-16-4 Eco-Tech/Qwen3.5-27B-w8a8-mtp ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-27B-w8a8-A3.yaml Qwen3.5-27B-w8a8-in64k-48-12 Eco-Tech/Qwen3.5-27B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-27B-w8a8-A3.yaml Qwen3.5-27B-w8a8-in64k-8-2 Eco-Tech/Qwen3.5-27B-w8a8-mtp ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-27B-w8a8-A3.yaml Qwen3.5-27B-w8a8-in64k-8-2-90 Eco-Tech/Qwen3.5-27B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-397B-A17B-W8A8-mtp-A3.yaml Qwen3.5-397B-A17B-w8a8-mtp Eco-Tech/Qwen3.5-397B-A17B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-397B-A17B-W8A8-mtp-A3_weekly.yaml Qwen3-397B-A17B-w8a8-A3-High—Throughput-bs136 Eco-Tech/Qwen3.5-397B-A17B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-397B-A17B-W8A8-mtp-A3_weekly.yaml Qwen3-397B-A17B-w8a8-A3-High—Throughput-bs144 Eco-Tech/Qwen3.5-397B-A17B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-397B-A17B-W8A8-mtp-A3_weekly.yaml Qwen3-397B-A17B-w8a8-A3-High—Throughput-bs32_in65536 Eco-Tech/Qwen3.5-397B-A17B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-397B-A17B-W8A8-mtp-A3_weekly.yaml Qwen3-397B-A17B-w8a8-A3-High—Throughput-bs48 Eco-Tech/Qwen3.5-397B-A17B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-397B-A17B-W8A8-mtp-A3_weekly.yaml Qwen3-397B-A17B-w8a8-A3-High—Throughput-bs8 Eco-Tech/Qwen3.5-397B-A17B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-397B-A17B-W8A8-mtp-A3_weekly.yaml Qwen3-397B-A17B-w8a8-A3-High—Throughput-bs80 Eco-Tech/Qwen3.5-397B-A17B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-397B-A17B-W8A8-mtp-A3_weekly.yaml Qwen3-397B-A17B-w8a8-A3-Minimal-Delay-bs16 Eco-Tech/Qwen3.5-397B-A17B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-397B-A17B-W8A8-mtp-A3_weekly.yaml Qwen3-397B-A17B-w8a8-A3-Minimal-Delay-bs160 Eco-Tech/Qwen3.5-397B-A17B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-397B-A17B-W8A8-mtp-A3_weekly.yaml Qwen3-397B-A17B-w8a8-A3-Minimal-Delay-bs16_in65536 Eco-Tech/Qwen3.5-397B-A17B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-397B-A17B-W8A8-mtp-A3_weekly.yaml Qwen3-397B-A17B-w8a8-A3-Minimal-Delay-bs2 Eco-Tech/Qwen3.5-397B-A17B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-397B-A17B-W8A8-mtp-A3_weekly.yaml Qwen3-397B-A17B-w8a8-A3-Minimal-Delay-bs32 Eco-Tech/Qwen3.5-397B-A17B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅
single_node/configs/Qwen3.5-397B-A17B-W8A8-mtp-A3_weekly.yaml Qwen3-397B-A17B-w8a8-A3-Minimal-Delay-bs36 Eco-Tech/Qwen3.5-397B-A17B-w8a8-mtp ✅ ✅ ✅ ✅ ✅ ✅