root cdcf115037 feat: CUTLASS Cu10 grouped GEMM — real device verified ...

BI-V100 real device results:
  moe_group_gemm: err=0.000015 PASS
  moe_decode_cutlass: NaN=False PASS
  cutlass grouped: 4.77ms vs torch.mm loop: 9.38ms → 1.97x speedup

Fix: gemm_grouped.cu ldb=K (not N) for ColumnMajor B view
Link: -lcuinfer from /usr/local/corex-3.2.3/lib64/libcuinfer.so.7

2026-08-17 04:18:29 +00:00

..

csrc

feat: CUTLASS Cu10 grouped GEMM — real device verified

2026-08-17 04:18:29 +00:00

fla_kernels

feat: import CUDA kernels from xllm/CCCL/FLA upstream repos

2026-08-14 07:48:52 +00:00

include

fix(CRITICAL): engine death on image request + stop overwriting base corex modules

2026-08-10 09:12:05 +00:00

moe

data: port complete MoE + xllm layer call chains from upstream repos

2026-08-15 14:26:24 +00:00

python

feat: CUTLASS Cu10 grouped GEMM — real device verified

2026-08-17 04:18:29 +00:00

xllm_kernels

data: port complete MoE + xllm layer call chains from upstream repos

2026-08-15 14:26:24 +00:00

xllm_layers

data: port complete MoE + xllm layer call chains from upstream repos

2026-08-15 14:26:24 +00:00

xllm_models

fix(critical): fold max_completion_tokens + max_num_seqs=2 + max_model_len=80000 + xllm_latest layer import

2026-08-13 03:19:39 +00:00

__init__.py

fix: add ex_engine/__init__.py for Python package import

2026-08-15 13:08:24 +00:00

build_cuinfer_gemm.sh

feat: CUTLASS Cu10 grouped GEMM — real device verified

2026-08-17 04:18:29 +00:00

build_gemm_grouped.sh

feat: CUTLASS Cu10 grouped GEMM — real device verified

2026-08-17 04:18:29 +00:00

build_ix_bridge.sh

feat: ILU kernel pipeline — ix_full_bridge_v2 build + deploy + 7-step MoE dispatch

2026-08-15 14:15:47 +00:00

build_xllm_ilu_kernels.sh

feat: ILU kernel pipeline — ix_full_bridge_v2 build + deploy + 7-step MoE dispatch

2026-08-15 14:15:47 +00:00

build_xllm_kernels.sh

feat: xllm_ops NO-FALLBACK kernel loader + 6 missing .so build targets + hot-path patcher

2026-08-15 14:13:13 +00:00

build.sh

fix(build): 回退qwen3_6_scripts+ex_engine到26e6cb40(能得分版本)

2026-08-12 01:33:24 +00:00

deploy_corex_modules.sh

feat(EX): corex_fa2.py — third dlopen module from comp 168 AST chain

2026-08-10 04:01:21 +00:00

deploy_ilu_pipeline.sh

feat: ILU kernel pipeline — ix_full_bridge_v2 build + deploy + 7-step MoE dispatch

2026-08-15 14:15:47 +00:00

deploy_ix_bridge.sh

feat: ix_ops integration layer — wire ix_full_bridge.so into vllm hot path

2026-08-15 06:15:17 +00:00

precompile_moe_kernels.py

fix(build): 回退qwen3_6_scripts+ex_engine到26e6cb40(能得分版本)

2026-08-12 01:33:24 +00:00

precompile_moe_topk.py

fix(MoE): robust CUDA kernel loading + no-GPU precompile

2026-08-10 07:50:28 +00:00