dylan e2fc3f270f fix: corex_batched_gemm use TCU OpClassTensorOp + Cu10 + float accum ...

Previous version used default SIMT path (25ms).
Fixed version matches moe_cutlass_batched.cu (2.462ms):
  - ElementAccumulator = float (was half_t)
  - OpClassTensorOp (was default OpClassSimt)
  - arch::Cu10 (was default Sm61)
  - RowMajor layout (was ColumnMajor)
  - torch::sigmoid(x)*x instead of torch::silu (not in corex torch)

Also fixed bind.cpp: removed col-major transposition logic,
kernel now RowMajor so A(M,K) @ B(K,N) = C(M,N) directly.

2026-08-15 12:35:56 +00:00

..

bindings

fix: corex_batched_gemm use TCU OpClassTensorOp + Cu10 + float accum

2026-08-15 12:35:56 +00:00

headers

data: complete SGEMM upstream from 3 repos (siboehm+wangzyon+edtallison) + xllm fused_qknorm_rope + xattention kernels

2026-08-15 07:00:09 +00:00

moe

fix: MoE kernel include paths — device_utils.cuh + arch_condition.h

2026-08-14 11:31:54 +00:00

xattention

data: complete SGEMM upstream from 3 repos (siboehm+wangzyon+edtallison) + xllm fused_qknorm_rope + xattention kernels

2026-08-15 07:00:09 +00:00

activation.cu

fix: activation.cu torch/extension.h + LOG(FATAL)→TORCH_CHECK, reshape_paged_cache.cu torch header

2026-08-14 10:52:54 +00:00

block_copy.cu

fix: add ceil_div + DEVICE_INLINE to device_utils.cuh

2026-08-14 11:11:15 +00:00

corex_batched_gemm_kernel.cu

fix: corex_batched_gemm use TCU OpClassTensorOp + Cu10 + float accum

2026-08-15 12:35:56 +00:00

fused_qknorm_rope.cu

data: complete SGEMM upstream from 3 repos (siboehm+wangzyon+edtallison) + xllm fused_qknorm_rope + xattention kernels

2026-08-15 07:00:09 +00:00

hgemm_blocktiling.cu

refactor: hgemm_blocktiling.cu — strict 1:1 from siboehm kernel 6

2026-08-14 16:24:22 +00:00

hgemm_warptiling.cu

perf: hgemm_warptiling Config B — beats cublas on MoE-sized GEMM (0.7x)

2026-08-15 05:11:32 +00:00

moe_cutlass_batched.cu

feat: Cu10 TensorOp batched HGEMM via Iluvatar CUTLASS framework

2026-08-15 05:44:15 +00:00

norm.cu

fix: remove glog/cuda_ops_api.h dependency from all xllm CUDA kernels

2026-08-14 10:30:10 +00:00

norm.cu.orig

fix: adapt xllm norm.cu for corex CUB (CUDA 10.2)

2026-08-14 10:19:51 +00:00

reshape_paged_cache.cu

fix: activation.cu torch/extension.h + LOG(FATAL)→TORCH_CHECK, reshape_paged_cache.cu torch header

2026-08-14 10:52:54 +00:00

rope.cu

fix: remove glog/cuda_ops_api.h dependency from all xllm CUDA kernels

2026-08-14 10:30:10 +00:00