Commit Graph

  • de1212c271 test: probe_ix_unified_bridge.sh — cat base镜像的ix_unified_bridge + corex_*.so + _custom_ops.py完整接口 Claude 2026-08-15 14:30:53 +00:00
  • a823bdf9ea test: probe_real_machine.sh — cat ixformer/vllm/cublas真机数据 Claude 2026-08-15 14:28:10 +00:00
  • 6415249693 data: port complete MoE + xllm layer call chains from upstream repos Claude 2026-08-15 14:26:18 +00:00
  • 7aa5054574 feat: ILU kernel pipeline — ix_full_bridge_v2 build + deploy + 7-step MoE dispatch dylan 2026-08-15 14:15:41 +00:00
  • 52e2ef31a8 feat: xllm_ops NO-FALLBACK kernel loader + 6 missing .so build targets + hot-path patcher Claude 2026-08-15 14:13:13 +00:00
  • e873e5f27b fix: eliminate 8x CUDA sync in MoE decode — tolist() once instead of .item() per expert dylan 2026-08-15 13:14:11 +00:00
  • 23fe535985 fix: add ex_engine/__init__.py for Python package import dylan 2026-08-15 13:08:24 +00:00
  • e18ece8f3a feat: port NaiveBatchedExperts from ds_vllm — view transpose + cublas transB dylan 2026-08-15 13:05:45 +00:00
  • 6f1904aa8c perf: MoE decode — pre-transposed bmm replaces F.linear (6.9ms vs 8.0ms, 14%) dylan 2026-08-15 12:52:55 +00:00
  • 9f265894cc test: MoE breakdown — F.linear vs torch.mm vs torch.bmm vs bmm pre-transposed Claude 2026-08-15 12:46:37 +00:00
  • e47b66e268 fix: module name in probe_moe_fused_breakdown.sh Claude 2026-08-15 12:43:55 +00:00
  • b0af7d54ff test: breakdown moe_decode_fused timing by step — find the real bottleneck Claude 2026-08-15 12:41:29 +00:00
  • 0795e064b2 fix: corex_batched_gemm TCU OpClassTensorOp + Cu10 + float accum (merge) dylan 2026-08-15 12:36:18 +00:00
  • 3b2a0bc4d3 fix: corex_batched_gemm TCU OpClassTensorOp + Cu10 + float accum dylan 2026-08-15 12:36:06 +00:00
  • e2fc3f270f fix: corex_batched_gemm use TCU OpClassTensorOp + Cu10 + float accum dylan 2026-08-15 12:35:56 +00:00
  • d8d241bf9f fix: corex_batched_gemm_kernel — use OpClassTensorOp + arch::Cu10 + FP32 accumulator Claude 2026-08-15 12:34:01 +00:00
  • 3481f2903f fix(build): cutlass.h lives under tensorflow/include on this image dylan 2026-08-15 12:03:12 +00:00
  • f41900c06b fix(build): auto-find cutlass/cutlass.h under COREX_ROOT dylan 2026-08-15 12:02:23 +00:00
  • bfa18cd5b4 fix(build): use CoreX clang++ instead of nvcc — match working build scripts dylan 2026-08-15 12:01:17 +00:00
  • 04cc9b88af fix(build): add CUDA include path to g++ step in build_corex_batched_gemm.sh dylan 2026-08-15 11:58:53 +00:00
  • ddcfbad431 feat: pybind wrapper for CUTLASS batched GEMM → MoE decode path dylan 2026-08-15 11:54:26 +00:00
  • a875fa5d4c Revert "data: cat SGEMM files from 3 repos into cat_files/" dylan 2026-08-15 11:48:10 +00:00
  • 36676f2d1b data: complete SGEMM upstream from 3 repos (siboehm+wangzyon+edtallison) + xllm fused_qknorm_rope + xattention kernels Claude 2026-08-15 07:00:04 +00:00
  • 7cfa87b5ac data: cat SGEMM files from 3 repos into cat_files/ dylan 2026-08-15 06:59:18 +00:00
  • 284804ac53 data: cat 3 SGEMM repos — siboehm, wangzyon, edtallison (full clone, no --depth) dylan 2026-08-15 06:58:07 +00:00
  • 854fb93a8e test: add test_ex_engine_cuda.py — test all 22 prebuilt .so on BI-V100 dylan 2026-08-15 06:28:34 +00:00
  • e8f0948fe1 feat: ix_ops integration layer — wire ix_full_bridge.so into vllm hot path dylan 2026-08-15 06:15:17 +00:00
  • 109d29fa60 Merge remote-tracking branch 'modelhub/main' root 2026-08-15 05:58:37 +00:00
  • 045ea5df79 feat: Cu10 TensorOp batched HGEMM via Iluvatar CUTLASS framework Claude 2026-08-15 05:44:15 +00:00
  • 30f98c0674 data: Cu10 CUTLASS part 2 — tensorop example, arch.h, cutlass.h root 2026-08-15 05:41:30 +00:00
  • f006ab1a01 test: cat tensorop GEMM example + arch.h + cutlass.h from corex-samples Claude 2026-08-15 05:41:03 +00:00
  • b922d694dc data: Cu10 CUTLASS headers from corex-samples root 2026-08-15 05:32:10 +00:00
  • 1d36754efc fix: cat_cutlass_cu10.sh writes to cat_files/ directory instead of stdout Claude 2026-08-15 05:31:33 +00:00
  • 4abb4df215 test: cat Cu10 CUTLASS files — mma_cu10.h, iluvatar_mma.hpp, batched_gemm.cu, default_mma_core_cu10.h Claude 2026-08-15 05:30:15 +00:00
  • 6b9086c3a9 test: probe Cu10 CUTLASS fork — find mma_cu10.h, tensor op files, batched_gemm example Claude 2026-08-15 05:27:43 +00:00
  • a465dd1d75 fix: use F.silu in test script for old corex torch Claude 2026-08-15 05:22:31 +00:00
  • a12d070d82 fix: replace torch::silu with x*sigmoid(x) for old corex torch Claude 2026-08-15 05:22:25 +00:00
  • c840c9159f feat: moe_tcu_dispatch.cpp — C++ MoE expert loop via torch::mm (TCU kernel) Claude 2026-08-15 05:20:05 +00:00
  • 9514092980 test: probe torch.matmul backend + ixformer.matmul/linear + Python loop overhead Claude 2026-08-15 05:17:13 +00:00
  • 395b3e4042 test: clean rebuild + debug output for kernel 10 correctness Claude 2026-08-15 05:14:18 +00:00
  • a8ca42b59c perf: hgemm_warptiling Config B — beats cublas on MoE-sized GEMM (0.7x) Claude 2026-08-15 05:11:32 +00:00
  • 21417319bc test: sweep 6 kernel 10 configs + cublas baseline — find best params for warp64 Claude 2026-08-15 05:08:11 +00:00
  • 27bb8d28df test: probe kernel 10 perf with CUDA events — isolate bottleneck Claude 2026-08-14 17:23:41 +00:00
  • 2b12fe687e feat: hgemm_warptiling.cu — siboehm kernel 10 ported to WARPSIZE=64 FP16 Claude 2026-08-14 17:05:59 +00:00
  • 11b8a98eea test: probe warp_size=64 behavior + kernel 10 warp tiling with WARPSIZE=64 on BI-V100 Claude 2026-08-14 17:02:55 +00:00
  • 1af7e7cf48 fix: use c10::cuda::getCurrentCUDAStream().stream() for corex torch Claude 2026-08-14 16:49:47 +00:00
  • 3bee73207e fix: add cuda_runtime.h to hgemm_bind.cpp for cudaStream_t Claude 2026-08-14 16:33:29 +00:00
  • 09e5261ba6 refactor: hgemm_blocktiling.cu — strict 1:1 from siboehm kernel 6 Claude 2026-08-14 16:24:22 +00:00
  • ab42fc1fd7 feat: hgemm_blocktiling.cu — FP16 GEMM kernel for MoE expert dispatch on BI-V100 Claude 2026-08-14 16:22:00 +00:00
  • 9ca33cf4d5 upstream: add GEMM kernel references from 4 repos for BI-V100 porting Claude 2026-08-14 15:11:57 +00:00
  • 29ecc2e602 feat: moe_expert_gemm.cpp — C++ loop over experts via ixformer_linear (replaces Python for-loop) Claude 2026-08-14 12:09:50 +00:00
  • 0ace44e293 test: cat ixinfer.h + functional batched GEMM test on BI-V100 Claude 2026-08-14 12:07:00 +00:00
  • bfc4de2cf3 test: probe cuinfer + cublasLt + cublas batched GEMM APIs for MoE expert dispatch Claude 2026-08-14 12:03:52 +00:00
  • d6958070cb test: probe CUTLASS + __CUDA_ARCH__ on BI-V100 for grouped GEMM feasibility Claude 2026-08-14 11:59:51 +00:00
  • 50a249e0a3 Revert "feat: batched MoE expert GEMM — replaces Python for-loop" claude 2026-08-14 11:47:37 +00:00
  • 06d7713db6 feat: batched MoE expert GEMM — replaces Python for-loop claude 2026-08-14 11:43:46 +00:00
  • 93353a1414 test: probe ixformer .so symbols for MoE grouped GEMM claude 2026-08-14 11:40:13 +00:00
  • 865c18f852 feat: integrate xllm_moe into qwen3_5.py MoE hot path claude 2026-08-14 11:37:21 +00:00
  • e147c283e3 prebuilt: 5 xllm CUDA kernel .so for BI-V100 (ivcore10) root 2026-08-14 11:34:23 +00:00
  • 31d3ee99bb fix: MoE kernel include paths — device_utils.cuh + arch_condition.h claude 2026-08-14 11:31:54 +00:00
  • df6a0f5d47 fix: remove cuda/functional from MoE topk kernels (not available on corex) claude 2026-08-14 11:29:19 +00:00
  • a50adefdfc feat: xllm MoE CUDA kernels — fused_topk + compute_index + combine claude 2026-08-14 11:23:49 +00:00
  • 49cd7def89 fix: slot_ids dtype long→int32 in cache test claude 2026-08-14 11:20:07 +00:00
  • 1f51feee05 fix: cos_sin_cache dtype float→half in rope test claude 2026-08-14 11:18:02 +00:00
  • 7fc0c1defa test: AST call chain verification for all 4 xllm kernel .so claude 2026-08-14 11:14:58 +00:00
  • 3d816cd18d fix: add ceil_div + DEVICE_INLINE to device_utils.cuh claude 2026-08-14 11:11:15 +00:00
  • 302aa9608a fix: block_copy.cu — DEVICE_INLINE, CHECK_EQ→TORCH_CHECK, cstdint claude 2026-08-14 11:06:07 +00:00
  • 900ae0b1ef fix: block_copy.cu remove utils.h (glog), CHECK→TORCH_CHECK claude 2026-08-14 11:02:57 +00:00
  • a206fc1d43 fix: activation.cu torch/extension.h + LOG(FATAL)→TORCH_CHECK, reshape_paged_cache.cu torch header claude 2026-08-14 10:52:54 +00:00
  • 093bfb380f feat: pybind11 bindings for xllm CUDA kernels claude 2026-08-14 10:50:13 +00:00
  • 415fff85f1 fix: add DISPATCH_FLOATING_TYPES macro to device_utils.cuh claude 2026-08-14 10:45:37 +00:00
  • 0359103b9b fix: remove glog/cuda_ops_api.h dependency from all xllm CUDA kernels claude 2026-08-14 10:30:10 +00:00
  • 51cb90b9ab fix: adapt xllm norm.cu for corex CUB (CUDA 10.2) claude 2026-08-14 10:19:51 +00:00
  • 089b9ff4e2 test: fix CUB compat tests + probe corex built-in CUB claude 2026-08-14 10:11:10 +00:00
  • 793743f5c0 test: CUB compatibility on BI-V100 — warp shuffle + BlockReduce claude 2026-08-14 08:21:48 +00:00
  • ec140f3605 docs: complete porting assessment — 5 repos, 2660 build targets, ivcore10 compatibility claude 2026-08-14 08:17:25 +00:00
  • 3a2cfc87c9 test: xllm CUDA kernel verification suite for BI-V100 claude 2026-08-14 08:01:23 +00:00
  • 8d75652949 feat: import CUDA kernels from xllm/CCCL/FLA upstream repos claude 2026-08-14 07:48:52 +00:00
  • 051b02d3cd feat: ix_moe_bridge + ix_attn_bridge — dlopen bridges for full ixformer::infer API claude 2026-08-14 07:32:31 +00:00
  • 5e9b7c292a build: all 16 .so prebuilt, no JIT compile in docker Claude 2026-08-14 07:14:46 +00:00
  • 28102196cd Merge branch 'main' of https://github.com/dylanyunlon/project_6 root 2026-08-14 07:13:36 +00:00
  • d32822c5d2 prebuilt: corex_moe_index_combine.so + ix_full_bridge.so (BI-V100 compiled) root 2026-08-14 07:10:52 +00:00
  • e7247bd57b build: integrate ix_full_bridge + corex_moe_index_combine into docker patch_ops.sh Claude 2026-08-14 07:09:01 +00:00
  • d9ffc5159d fix(bridge): rewrite ix_full_bridge.cpp for real ixformer_torch_ext namespace Claude 2026-08-14 07:00:30 +00:00
  • 9e3157b444 fix(P0): extra=allow + topk_softmax fallback + deploy_local.sh + SO chain verify Claude 2026-08-14 06:56:00 +00:00
  • 101db8774c diag: probe_bi100.py — run on real machine, paste output back Claude 2026-08-14 06:52:52 +00:00
  • 07fad2cce7 fix: max-num-seqs=1 + pure Q-tiling — match a3c45d3b exactly Claude 2026-08-14 05:40:05 +00:00
  • 1f69311375 fix: flash_attn import path ixformer.contrib → ixformer.functions Claude 2026-08-14 03:56:23 +00:00
  • 4c1adc11db fix: restore libcccl_allocator.so + minimal .dockerignore + clean pycache Claude 2026-08-14 03:51:43 +00:00
  • dfaaae988e diag: test_dlopen_chain.py — verify all .so and ixformer dispatch on BI-V100 Claude 2026-08-14 03:47:39 +00:00
  • 336f3349ca fix(submit): restore flash_attn prefill + all 38eca5c2 improvements Claude 2026-08-14 03:47:09 +00:00
  • 67a5639c3c fix(submit): restore a3c45d3b-proven config + safe improvements Claude 2026-08-14 03:35:24 +00:00
  • bce79e44be perf(prefill): restore flash_attn_varlen_func with profiling safety guard Claude 2026-08-14 02:51:47 +00:00
  • 74ce61712b fix(build): update prebuilt CoreX artifact count 13→14 — SHA256SUMS has 14 entries after corex_gdn_chunk_recurrent.so was added Claude 2026-08-14 02:39:42 +00:00
  • 38eca5c26a revert: restore a3c45d3b yaml + Q-tiling + remove all OOM hacks Claude 2026-08-14 02:28:48 +00:00
  • eb57eb7d1c clean: remove 444 .pyc files + libcccl_allocator.so from git tracking Claude 2026-08-14 02:20:26 +00:00
  • 41b51382fd prebuilt: corex_gdn_chunk_recurrent.so + remove __pycache__ from tracking root 2026-08-14 02:12:32 +00:00
  • 9a52f05783 prebuilt: add corex_gdn_chunk_recurrent.so with fixed pybind kwargs root 2026-08-14 02:10:54 +00:00
  • bb0de83d45 fix(pybind): c10::optional<Tensor>() default — c10::nullopt not registered in pybind Claude 2026-08-14 02:05:30 +00:00
  • 768d89c31a fix(pybind): add py::arg + defaults to corex_gdn_chunk_recurrent Claude 2026-08-14 02:02:51 +00:00