dylanyunlong/project_6
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
bce79e44bef301ae77934be8c52ab9b5ab6fd303
project_6/qwen3_6_scripts
History
Claude bce79e44be perf(prefill): restore flash_attn_varlen_func with profiling safety guard 
Restores ixformer flash_attn acceleration for prefill that was lost in
38eca5c2 revert. The OOM root cause was profiling-stage flash_attn on
131K dummy sequences, not flash_attn itself.

Fix: two-tier dispatch in _run_sdpa_fallback:
  1. flash_attn_varlen_func — real inference (verified 1.7x on BI-V100)
  2. Q-tiling fallback     — profiling stage (seq > 32K) or exception

Import path: ixformer.contrib.vllm_flash_attn.flash_attn_varlen_func
(canonical path matching ex_engine/python/corex_fa2.py Tier 1 and
ixformer_sdk/contrib/vllm_flash_attn/flash_attn_interface.py signature).

Reference sources:
  - ixformer_sdk/contrib/vllm_flash_attn/flash_attn_interface.py (API)
  - ex_engine/python/corex_fa2.py (dispatch pattern)
  - upstream_ref/xllm_latest/core/kernels/ilu/attention.cpp (C++ batch_prefill)
2026-08-14 02:51:47 +00:00
..
cccl_preload
prebuilt: add corex_gdn_chunk_recurrent.so with fixed pybind kwargs
2026-08-14 02:10:54 +00:00
prebuilt/corex-3.2.3-ivcore10
prebuilt: add corex_gdn_chunk_recurrent.so with fixed pybind kwargs
2026-08-14 02:10:54 +00:00
qwen3_5
fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching
2026-08-14 01:06:49 +00:00
qwen3_5_moe
fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching
2026-08-14 01:06:49 +00:00
reasoning
fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching
2026-08-14 01:06:49 +00:00
vendor_overrides/vllm
fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching
2026-08-14 01:06:49 +00:00
wheels
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
api_server.py
fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching
2026-08-14 01:06:49 +00:00
bi100_env.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
bi100_profile.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
block_major_kv_cache.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_cccl_moe_sort_scatter.sh
fix: import torch.utils.cpp_extension explicitly in build script
2026-08-13 11:37:10 +00:00
build_corex_attn_head_rms_norm.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_fused_paged_prefill_split4.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_gdn_beta_decay.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_gdn_causal_conv.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_gdn_chunk_recurrent.sh
feat: C++ GDN chunk+recurrent from xllm upstream + verification script
2026-08-13 04:01:59 +00:00
build_corex_gdn_gated_norm.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_gdn_packed_decode.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_gdn_qk_map.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_moe_direct_routed.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_moe_exact_reduce.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_moe_index_combine.sh
feat: moe_compute_index + moe_combine_result CUDA kernels from xllm upstream
2026-08-13 03:48:12 +00:00
build_corex_moe_topk_softmax.sh
fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params
2026-08-12 11:14:01 +00:00
build_corex_moe_weight_gather.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_paged_kv_gather.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_ix_bridge.sh
feat: ix_full_bridge.so — dlopen bridge for ixformer::infer C++ API
2026-08-14 01:25:16 +00:00
cccl_moe_sort_scatter_pybind.cpp
fix(CCCL): split compilation to isolate CCCL headers from torch/corex
2026-08-13 11:35:43 +00:00
cccl_moe_sort_scatter.cu
fix(CCCL): split compilation to isolate CCCL headers from torch/corex
2026-08-13 11:35:43 +00:00
chat_utils.py
fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching
2026-08-14 01:06:49 +00:00
cli_args.py
fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching
2026-08-14 01:06:49 +00:00
corex_attn_head_rms_norm.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_block_major_kv_transfer.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_fused_paged_prefill_split4.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_gdn_beta_decay.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_gdn_causal_conv.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_gdn_chunk_recurrent.cu
fix(pybind): c10::optional<Tensor>() default — c10::nullopt not registered in pybind
2026-08-14 02:05:30 +00:00
corex_gdn_gated_norm.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_gdn_packed_decode.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_gdn_qk_map.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_moe_direct_routed.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_moe_exact_reduce.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_moe_index_combine.cu
feat: moe_compute_index + moe_combine_result CUDA kernels from xllm upstream
2026-08-13 03:48:12 +00:00
corex_moe_topk_softmax.cu
fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params
2026-08-12 11:14:01 +00:00
corex_moe_weight_gather.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_paged_kv_gather.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_query_tiled_paged_prefill.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
device_utils.cuh
fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params
2026-08-12 11:14:01 +00:00
gdn_prefix.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
install_prebuilt_corex.sh
fix(build): update prebuilt CoreX artifact count 13→14 — SHA256SUMS has 14 entries after corex_gdn_chunk_recurrent.so was added
2026-08-14 02:39:42 +00:00
ix_full_bridge.cpp
fix(build): std::nullopt → c10::nullopt for CoreX c10::optional
2026-08-14 01:50:47 +00:00
ix_moe_bridge.cpp
fix(build): c10::optional for CoreX CUDA 10.2 — std::optional incompatible
2026-08-14 01:49:25 +00:00
mamba_cache.py
fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching
2026-08-14 01:06:49 +00:00
moe_topk_sigmoid_kernels.cuh
fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params
2026-08-12 11:14:01 +00:00
moe_topk_softmax_kernels.cuh
fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params
2026-08-12 11:14:01 +00:00
paged_attn.py
perf: native ixformer decode — v1 ≤32K, v2 >32K (no Python fallback)
2026-08-13 07:09:50 +00:00
patch_block_major_cache_engine.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_block_major_worker_capacity.py
revert: restore a3c45d3b yaml + Q-tiling + remove all OOM hacks
2026-08-14 02:28:48 +00:00
patch_block_manager_cache_trace.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_corex_swap_blocks.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_executor_startup_debug.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_model_runner.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_ops.sh
revert: restore a3c45d3b yaml + Q-tiling + remove all OOM hacks
2026-08-14 02:28:48 +00:00
patch_transformers_qwen3_5.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_utils.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_vllm_qwen3_5.py
fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching
2026-08-14 01:06:49 +00:00
patch_vllm_tool_parser.py
fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching
2026-08-14 01:06:49 +00:00
patch_worker_cache_transfer_order.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_worker_profile_override.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_worker_startup_profile_guard.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_xformers_profile.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_xformers_sdpa_batch_kernel.py
fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching
2026-08-14 01:06:49 +00:00
patch_xformers_sdpa_batch.py
fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching
2026-08-14 01:06:49 +00:00
patch_xformers_sdpa_seq_kernel.py
fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching
2026-08-14 01:06:49 +00:00
patch_xformers_sdpa_seq.py
perf(prefill): restore flash_attn_varlen_func with profiling safety guard
2026-08-14 02:51:47 +00:00
protocol.py
fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching
2026-08-14 01:06:49 +00:00
qwen3_5.py
fix(pybind): add py::arg + defaults to corex_gdn_chunk_recurrent
2026-08-14 02:02:51 +00:00
qwen3coder_tool_parser.py
fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching
2026-08-14 01:06:49 +00:00
scheduler.py
fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching
2026-08-14 01:06:49 +00:00
sequence.py
fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching
2026-08-14 01:06:49 +00:00
serving_chat.py
fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching
2026-08-14 01:06:49 +00:00
serving_tokenization.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00