root cdcf115037 feat: CUTLASS Cu10 grouped GEMM — real device verified ...

BI-V100 real device results:
  moe_group_gemm: err=0.000015 PASS
  moe_decode_cutlass: NaN=False PASS
  cutlass grouped: 4.77ms vs torch.mm loop: 9.38ms → 1.97x speedup

Fix: gemm_grouped.cu ldb=K (not N) for ColumnMajor B view
Link: -lcuinfer from /usr/local/corex-3.2.3/lib64/libcuinfer.so.7

2026-08-17 04:18:29 +00:00

..

ilu

fix(build): 回退qwen3_6_scripts+ex_engine到26e6cb40(能得分版本)

2026-08-12 01:33:24 +00:00

moe

fix(build): 回退qwen3_6_scripts+ex_engine到26e6cb40(能得分版本)

2026-08-12 01:33:24 +00:00

moe_v055

fix(build): 回退qwen3_6_scripts+ex_engine到26e6cb40(能得分版本)

2026-08-12 01:33:24 +00:00

build_test_moe_tcu.sh

fix: use F.silu in test script for old corex torch

2026-08-15 05:22:31 +00:00

common_fused_moe_base.h

ref(EX): import upstream ILU kernels + xllm MoE CUDA sources into ex_engine

2026-08-10 03:59:45 +00:00

common_fused_moe.h

ref(EX): import upstream ILU kernels + xllm MoE CUDA sources into ex_engine

2026-08-10 03:59:45 +00:00

common_moe_fused_topk.cpp

ref(EX): import upstream ILU kernels + xllm MoE CUDA sources into ex_engine

2026-08-10 03:59:45 +00:00

common_moe_fused_topk.h

ref(EX): import upstream ILU kernels + xllm MoE CUDA sources into ex_engine

2026-08-10 03:59:45 +00:00

cuinfer_gemm_wrapper.cu

feat: CUTLASS Cu10 grouped GEMM — real device verified

2026-08-17 04:18:29 +00:00

cuinfer_handle.h

feat: CUTLASS Cu10 grouped GEMM — real device verified

2026-08-17 04:18:29 +00:00

cuinfer_types.h

feat: CUTLASS Cu10 grouped GEMM — real device verified

2026-08-17 04:18:29 +00:00

ex_registry.c

feat(EX): Algorithm Factor Replacement Engine — dlopen-based CUDA kernel dispatch

2026-08-10 02:25:23 +00:00

factor_gdn_chunk_fwd.cu.ref

refactor(EX): upstream-aligned kernels + FlashQLA GDN backend

2026-08-10 02:55:58 +00:00

factor_gdn_flashqla.py

refactor(EX): upstream-aligned kernels + FlashQLA GDN backend

2026-08-10 02:55:58 +00:00

factor_moe_fused_gemm.cu

feat(EX): Algorithm Factor Replacement Engine — dlopen-based CUDA kernel dispatch

2026-08-10 02:25:23 +00:00

factor_moe_topk_softmax.cu

refactor(EX): upstream-aligned kernels + FlashQLA GDN backend

2026-08-10 02:55:58 +00:00

gemm_grouped_bind.cpp

feat: CUTLASS Cu10 grouped GEMM — real device verified

2026-08-17 04:18:29 +00:00

gemm_grouped.cu

feat: CUTLASS Cu10 grouped GEMM — real device verified

2026-08-17 04:18:29 +00:00

ilu_CMakeLists.txt

fix(critical): fold max_completion_tokens + max_num_seqs=2 + max_model_len=80000 + xllm_latest layer import

2026-08-13 03:19:39 +00:00

ilu_kernel_activation.cpp

ref(EX): import upstream ILU kernels + xllm MoE CUDA sources into ex_engine

2026-08-10 03:59:45 +00:00

ilu_kernel_attention.cpp

ref(EX): import upstream ILU kernels + xllm MoE CUDA sources into ex_engine

2026-08-10 03:59:45 +00:00

ilu_kernel_fused_moe.cpp

ref(EX): import upstream ILU kernels + xllm MoE CUDA sources into ex_engine

2026-08-10 03:59:45 +00:00

ilu_kernel_group_gemm.cpp

ref(EX): import upstream ILU kernels + xllm MoE CUDA sources into ex_engine

2026-08-10 03:59:45 +00:00

ilu_kernel_matmul.cpp

ref(EX): import upstream ILU kernels + xllm MoE CUDA sources into ex_engine

2026-08-10 03:59:45 +00:00

ilu_kernel_norm.cpp

ref(EX): import upstream ILU kernels + xllm MoE CUDA sources into ex_engine

2026-08-10 03:59:45 +00:00

ilu_kernel_rope.cpp

ref(EX): import upstream ILU kernels + xllm MoE CUDA sources into ex_engine

2026-08-10 03:59:45 +00:00

ilu_layer_attention.cpp

ref(EX): import upstream ILU kernels + xllm MoE CUDA sources into ex_engine

2026-08-10 03:59:45 +00:00

ilu_layer_attention.h

fix(build): 回退qwen3_6_scripts+ex_engine到26e6cb40(能得分版本)

2026-08-12 01:33:24 +00:00

ilu_layer_fused_moe.cpp

ref(EX): import upstream ILU kernels + xllm MoE CUDA sources into ex_engine

2026-08-10 03:59:45 +00:00

ilu_layer_fused_moe.h

fix(build): 回退qwen3_6_scripts+ex_engine到26e6cb40(能得分版本)

2026-08-12 01:33:24 +00:00

ilu_layers_CMakeLists.txt

fix(critical): fold max_completion_tokens + max_num_seqs=2 + max_model_len=80000 + xllm_latest layer import

2026-08-13 03:19:39 +00:00

ix_attn_bridge.cpp

feat: ix_moe_bridge + ix_attn_bridge — dlopen bridges for full ixformer::infer API

2026-08-14 07:32:31 +00:00

ix_full_bridge_v2.cpp

[feat] group gemm

2026-08-17 02:16:58 +00:00

ix_full_bridge.cpp

refactor(bridge): rewrite ix_full_bridge.cpp for actual base image symbols

2026-08-10 06:34:54 +00:00

ix_moe_bridge.cpp

feat: ix_moe_bridge + ix_attn_bridge — dlopen bridges for full ixformer::infer API

2026-08-14 07:32:31 +00:00

moe_expert_gemm.cpp

feat: moe_expert_gemm.cpp — C++ loop over experts via ixformer_linear (replaces Python for-loop)

2026-08-14 12:09:50 +00:00

moe_ops_impl.cu

[feat] group gemm

2026-08-17 02:16:58 +00:00

moe_tcu_dispatch.cpp

fix: replace torch::silu with x*sigmoid(x) for old corex torch

2026-08-15 05:22:25 +00:00

moe_topk_softmax_v3.cu

fix(MoE): rewrite topk kernel — 1 block/row, shared mem, warp-agnostic

2026-08-10 08:03:08 +00:00