project6-dev ad6863ed84 perf: replace Python Q-tiling fallback with ixformer.flash_attn_varlen_func ...

Verified on real BI-V100:
  flash_attn_func works with head_dim=256 (diff < 0.004, no NaN)
  flash_attn_varlen_func works for variable-length batching
  seq=1024: 1.7x faster than PyTorch matmul

The profiling-stage _run_sdpa_fallback now tries flash_attn_varlen_func
first, falls back to Python Q-tiling only on exception.

This addresses the 10-50x attention slowdown identified in the analysis:
  Python Q-tiling: O(L^2) per-tile matmul in Python loop
  flash_attn: fused kernel, O(L) memory, hardware-optimized

2026-08-13 05:14:08 +00:00

..

prebuilt/corex-3.2.3-ivcore10

fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params

2026-08-12 11:14:01 +00:00

qwen3_5

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

qwen3_5_moe

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

reasoning

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

vendor_overrides/vllm

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

wheels

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

api_server.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

bi100_env.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

bi100_profile.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

block_major_kv_cache.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_attn_head_rms_norm.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_fused_paged_prefill_split4.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_gdn_beta_decay.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_gdn_causal_conv.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_gdn_chunk_recurrent.sh

feat: C++ GDN chunk+recurrent from xllm upstream + verification script

2026-08-13 04:01:59 +00:00

build_corex_gdn_gated_norm.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_gdn_packed_decode.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_gdn_qk_map.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_moe_direct_routed.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_moe_exact_reduce.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_moe_index_combine.sh

feat: moe_compute_index + moe_combine_result CUDA kernels from xllm upstream

2026-08-13 03:48:12 +00:00

build_corex_moe_topk_softmax.sh

fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params

2026-08-12 11:14:01 +00:00

build_corex_moe_weight_gather.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_paged_kv_gather.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

chat_utils.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

cli_args.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_attn_head_rms_norm.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_block_major_kv_transfer.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_fused_paged_prefill_split4.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_gdn_beta_decay.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_gdn_causal_conv.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_gdn_chunk_recurrent.cu

feat: C++ GDN chunk+recurrent from xllm upstream + verification script

2026-08-13 04:01:59 +00:00

corex_gdn_gated_norm.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_gdn_packed_decode.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_gdn_qk_map.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_moe_direct_routed.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_moe_exact_reduce.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_moe_index_combine.cu

feat: moe_compute_index + moe_combine_result CUDA kernels from xllm upstream

2026-08-13 03:48:12 +00:00

corex_moe_topk_softmax.cu

fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params

2026-08-12 11:14:01 +00:00

corex_moe_weight_gather.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_paged_kv_gather.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_query_tiled_paged_prefill.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

device_utils.cuh

fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params

2026-08-12 11:14:01 +00:00

gdn_prefix.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

install_prebuilt_corex.sh

fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params

2026-08-12 11:14:01 +00:00

mamba_cache.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

moe_topk_sigmoid_kernels.cuh

fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params

2026-08-12 11:14:01 +00:00

moe_topk_softmax_kernels.cuh

fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params

2026-08-12 11:14:01 +00:00

paged_attn.py

fix: copy_blocks use vllm_copy_cache

2026-08-13 02:18:27 +00:00

patch_block_major_cache_engine.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_block_major_worker_capacity.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_block_manager_cache_trace.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_corex_swap_blocks.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_executor_startup_debug.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_model_runner.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_ops.sh

feat: integrate moe_compute_index kernel into MoE prefill path

2026-08-13 03:52:35 +00:00

patch_transformers_qwen3_5.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_utils.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_vllm_qwen3_5.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_vllm_tool_parser.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_worker_cache_transfer_order.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_worker_profile_override.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_worker_startup_profile_guard.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_xformers_profile.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_xformers_sdpa_batch_kernel.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_xformers_sdpa_batch.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_xformers_sdpa_seq_kernel.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_xformers_sdpa_seq.py

perf: replace Python Q-tiling fallback with ixformer.flash_attn_varlen_func

2026-08-13 05:14:08 +00:00

protocol.py

fix(critical): fold max_completion_tokens + max_num_seqs=2 + max_model_len=80000 + xllm_latest layer import

2026-08-13 03:19:39 +00:00

qwen3_5.py

feat: integrate moe_compute_index kernel into MoE prefill path

2026-08-13 03:52:35 +00:00

qwen3coder_tool_parser.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

scheduler.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

sequence.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

serving_chat.py

fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params

2026-08-12 11:14:01 +00:00

serving_tokenization.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00