claude 051b02d3cd feat: ix_moe_bridge + ix_attn_bridge — dlopen bridges for full ixformer::infer API ...

Bridge architecture (from xllm/core/kernels/ilu/ixformer.h):

ix_moe_bridge.so (MoE 7-step fused pipeline):
  - topk_softmax → moe_compute_token_index_api → moe_expand_input
  - moe_w16a16_group_gemm (x2) → silu_and_mul → moe_output_reduce_sum
  - fused_moe_forward(): replaces entire Python expert loop
  - Fix: group_gemm format NT→TN (match xllm trans_b=true)

ix_attn_bridge.so (attention + linear):
  - ixinfer_flash_attn_unpad_with_block_tables (fused prefill)
  - xllm_paged_attention (fused paged decode)
  - ixformer_linear (matmul + activation)
  - residual_rms_norm (fused residual + norm)

Integration:
  - ix_fused_moe.py: Python loader (prebuilt .so → JIT → unavailable)
  - qwen3_5.py: Tier 0 dispatch in _pure_pytorch_experts()
  - patch_ops.sh: deploys ix_fused_moe.py + all prebuilt/*.so

Source: jd-opensource/xllm (fresh clone, all ILU kernels verified SAME)
Sync: upstream_ref/xllm_latest/models/llm/qwen3_next_hybrid_base.h (+32 lines)

Build on real machine:
  bash qwen3_6_scripts/build_ix_moe_bridge.sh
  bash qwen3_6_scripts/build_ix_attn_bridge.sh

2026-08-14 07:32:31 +00:00

..

cccl_preload

fix: restore libcccl_allocator.so + minimal .dockerignore + clean pycache

2026-08-14 03:51:43 +00:00

prebuilt/corex-3.2.3-ivcore10

prebuilt: corex_moe_index_combine.so + ix_full_bridge.so (BI-V100 compiled)

2026-08-14 07:10:52 +00:00

qwen3_5

fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching

2026-08-14 01:06:49 +00:00

qwen3_5_moe

fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching

2026-08-14 01:06:49 +00:00

reasoning

fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching

2026-08-14 01:06:49 +00:00

vendor_overrides/vllm

fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching

2026-08-14 01:06:49 +00:00

wheels

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

api_server.py

fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching

2026-08-14 01:06:49 +00:00

bi100_env.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

bi100_profile.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

block_major_kv_cache.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_cccl_moe_sort_scatter.sh

fix: import torch.utils.cpp_extension explicitly in build script

2026-08-13 11:37:10 +00:00

build_corex_attn_head_rms_norm.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_block_major_kv_transfer.sh

fix(P0): extra=allow + topk_softmax fallback + deploy_local.sh + SO chain verify

2026-08-14 06:56:00 +00:00

build_corex_fused_paged_prefill_split4.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_gdn_beta_decay.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_gdn_causal_conv.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_gdn_chunk_recurrent.sh

feat: C++ GDN chunk+recurrent from xllm upstream + verification script

2026-08-13 04:01:59 +00:00

build_corex_gdn_gated_norm.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_gdn_packed_decode.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_gdn_qk_map.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_moe_direct_routed.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_moe_exact_reduce.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_moe_index_combine.sh

feat: moe_compute_index + moe_combine_result CUDA kernels from xllm upstream

2026-08-13 03:48:12 +00:00

build_corex_moe_topk_softmax.sh

fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params

2026-08-12 11:14:01 +00:00

build_corex_moe_weight_gather.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_corex_paged_kv_gather.sh

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

build_ix_attn_bridge.sh

feat: ix_moe_bridge + ix_attn_bridge — dlopen bridges for full ixformer::infer API

2026-08-14 07:32:31 +00:00

build_ix_bridge.sh

fix(bridge): rewrite ix_full_bridge.cpp for real ixformer_torch_ext namespace

2026-08-14 07:00:30 +00:00

build_ix_moe_bridge.sh

feat: ix_moe_bridge + ix_attn_bridge — dlopen bridges for full ixformer::infer API

2026-08-14 07:32:31 +00:00

cccl_moe_sort_scatter_pybind.cpp

fix(CCCL): split compilation to isolate CCCL headers from torch/corex

2026-08-13 11:35:43 +00:00

cccl_moe_sort_scatter.cu

fix(CCCL): split compilation to isolate CCCL headers from torch/corex

2026-08-13 11:35:43 +00:00

chat_utils.py

fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching

2026-08-14 01:06:49 +00:00

cli_args.py

fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching

2026-08-14 01:06:49 +00:00

corex_attn_head_rms_norm.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_block_major_kv_transfer.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_fused_paged_prefill_split4.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_gdn_beta_decay.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_gdn_causal_conv.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_gdn_chunk_recurrent.cu

fix(pybind): c10::optional<Tensor>() default — c10::nullopt not registered in pybind

2026-08-14 02:05:30 +00:00

corex_gdn_gated_norm.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_gdn_packed_decode.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_gdn_qk_map.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_moe_direct_routed.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_moe_exact_reduce.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_moe_index_combine.cu

feat: moe_compute_index + moe_combine_result CUDA kernels from xllm upstream

2026-08-13 03:48:12 +00:00

corex_moe_topk_softmax.cu

fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params

2026-08-12 11:14:01 +00:00

corex_moe_weight_gather.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_paged_kv_gather.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

corex_query_tiled_paged_prefill.cu

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

deploy_local.sh

fix(P0): extra=allow + topk_softmax fallback + deploy_local.sh + SO chain verify

2026-08-14 06:56:00 +00:00

device_utils.cuh

fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params

2026-08-12 11:14:01 +00:00

gdn_prefix.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

install_prebuilt_corex.sh

build: all 16 .so prebuilt, no JIT compile in docker

2026-08-14 07:14:46 +00:00

ix_attn_bridge.cpp

feat: ix_moe_bridge + ix_attn_bridge — dlopen bridges for full ixformer::infer API

2026-08-14 07:32:31 +00:00

ix_full_bridge.cpp

fix(bridge): rewrite ix_full_bridge.cpp for real ixformer_torch_ext namespace

2026-08-14 07:00:30 +00:00

ix_fused_moe.py

feat: ix_moe_bridge + ix_attn_bridge — dlopen bridges for full ixformer::infer API

2026-08-14 07:32:31 +00:00

ix_moe_bridge.cpp

feat: ix_moe_bridge + ix_attn_bridge — dlopen bridges for full ixformer::infer API

2026-08-14 07:32:31 +00:00

mamba_cache.py

fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching

2026-08-14 01:06:49 +00:00

moe_topk_sigmoid_kernels.cuh

fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params

2026-08-12 11:14:01 +00:00

moe_topk_softmax_kernels.cuh

fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params

2026-08-12 11:14:01 +00:00

paged_attn.py

perf: native ixformer decode — v1 ≤32K, v2 >32K (no Python fallback)

2026-08-13 07:09:50 +00:00

patch_block_major_cache_engine.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_block_major_worker_capacity.py

revert: restore a3c45d3b yaml + Q-tiling + remove all OOM hacks

2026-08-14 02:28:48 +00:00

patch_block_manager_cache_trace.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_corex_swap_blocks.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_executor_startup_debug.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_model_runner.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_ops.sh

feat: ix_moe_bridge + ix_attn_bridge — dlopen bridges for full ixformer::infer API

2026-08-14 07:32:31 +00:00

patch_transformers_qwen3_5.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_utils.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_vllm_qwen3_5.py

fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching

2026-08-14 01:06:49 +00:00

patch_vllm_tool_parser.py

fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching

2026-08-14 01:06:49 +00:00

patch_worker_cache_transfer_order.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_worker_profile_override.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_worker_startup_profile_guard.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_xformers_profile.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

patch_xformers_sdpa_batch_kernel.py

fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching

2026-08-14 01:06:49 +00:00

patch_xformers_sdpa_batch.py

fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching

2026-08-14 01:06:49 +00:00

patch_xformers_sdpa_seq_kernel.py

fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching

2026-08-14 01:06:49 +00:00

patch_xformers_sdpa_seq.py

fix: max-num-seqs=1 + pure Q-tiling — match a3c45d3b exactly

2026-08-14 05:40:05 +00:00

protocol.py

fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching

2026-08-14 01:06:49 +00:00

qwen3_5.py

feat: ix_moe_bridge + ix_attn_bridge — dlopen bridges for full ixformer::infer API

2026-08-14 07:32:31 +00:00

qwen3coder_tool_parser.py

fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching

2026-08-14 01:06:49 +00:00

scheduler.py

fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching

2026-08-14 01:06:49 +00:00

sequence.py

fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching

2026-08-14 01:06:49 +00:00

serving_chat.py

fix(build): strip \r\n from all .py files — CRLF breaks patch_ops.sh text matching

2026-08-14 01:06:49 +00:00

serving_tokenization.py

feat: 替换为 project_7 验证通过的 wudixzy stack

2026-08-12 03:31:05 +00:00

verify_dlopen_chain.py

fix(P0): extra=allow + topk_softmax fallback + deploy_local.sh + SO chain verify

2026-08-14 06:56:00 +00:00