This website requires JavaScript.
de1212c271
test: probe_ix_unified_bridge.sh — cat base镜像的ix_unified_bridge + corex_*.so + _custom_ops.py完整接口
Claude
2026-08-15 14:30:53 +00:00
a823bdf9ea
test: probe_real_machine.sh — cat ixformer/vllm/cublas真机数据
Claude
2026-08-15 14:28:10 +00:00
6415249693
data: port complete MoE + xllm layer call chains from upstream repos
Claude
2026-08-15 14:26:18 +00:00
7aa5054574
feat: ILU kernel pipeline — ix_full_bridge_v2 build + deploy + 7-step MoE dispatch
dylan
2026-08-15 14:15:41 +00:00
52e2ef31a8
feat: xllm_ops NO-FALLBACK kernel loader + 6 missing .so build targets + hot-path patcher
Claude
2026-08-15 14:13:13 +00:00
e873e5f27b
fix: eliminate 8x CUDA sync in MoE decode — tolist() once instead of .item() per expert
dylan
2026-08-15 13:14:11 +00:00
23fe535985
fix: add ex_engine/__init__.py for Python package import
dylan
2026-08-15 13:08:24 +00:00
e18ece8f3a
feat: port NaiveBatchedExperts from ds_vllm — view transpose + cublas transB
dylan
2026-08-15 13:05:45 +00:00
6f1904aa8c
perf: MoE decode — pre-transposed bmm replaces F.linear (6.9ms vs 8.0ms, 14%)
dylan
2026-08-15 12:52:55 +00:00
9f265894cc
test: MoE breakdown — F.linear vs torch.mm vs torch.bmm vs bmm pre-transposed
Claude
2026-08-15 12:46:37 +00:00
e47b66e268
fix: module name in probe_moe_fused_breakdown.sh
Claude
2026-08-15 12:43:55 +00:00
b0af7d54ff
test: breakdown moe_decode_fused timing by step — find the real bottleneck
Claude
2026-08-15 12:41:29 +00:00
0795e064b2
fix: corex_batched_gemm TCU OpClassTensorOp + Cu10 + float accum (merge)
dylan
2026-08-15 12:36:18 +00:00
3b2a0bc4d3
fix: corex_batched_gemm TCU OpClassTensorOp + Cu10 + float accum
dylan
2026-08-15 12:36:06 +00:00
e2fc3f270f
fix: corex_batched_gemm use TCU OpClassTensorOp + Cu10 + float accum
dylan
2026-08-15 12:35:56 +00:00
d8d241bf9f
fix: corex_batched_gemm_kernel — use OpClassTensorOp + arch::Cu10 + FP32 accumulator
Claude
2026-08-15 12:34:01 +00:00
3481f2903f
fix(build): cutlass.h lives under tensorflow/include on this image
dylan
2026-08-15 12:03:12 +00:00
f41900c06b
fix(build): auto-find cutlass/cutlass.h under COREX_ROOT
dylan
2026-08-15 12:02:23 +00:00
bfa18cd5b4
fix(build): use CoreX clang++ instead of nvcc — match working build scripts
dylan
2026-08-15 12:01:17 +00:00
04cc9b88af
fix(build): add CUDA include path to g++ step in build_corex_batched_gemm.sh
dylan
2026-08-15 11:58:53 +00:00
ddcfbad431
feat: pybind wrapper for CUTLASS batched GEMM → MoE decode path
dylan
2026-08-15 11:54:26 +00:00
a875fa5d4c
Revert "data: cat SGEMM files from 3 repos into cat_files/"
dylan
2026-08-15 11:48:10 +00:00
36676f2d1b
data: complete SGEMM upstream from 3 repos (siboehm+wangzyon+edtallison) + xllm fused_qknorm_rope + xattention kernels
Claude
2026-08-15 07:00:04 +00:00
7cfa87b5ac
data: cat SGEMM files from 3 repos into cat_files/
dylan
2026-08-15 06:59:18 +00:00
284804ac53
data: cat 3 SGEMM repos — siboehm, wangzyon, edtallison (full clone, no --depth)
dylan
2026-08-15 06:58:07 +00:00
854fb93a8e
test: add test_ex_engine_cuda.py — test all 22 prebuilt .so on BI-V100
dylan
2026-08-15 06:28:34 +00:00
e8f0948fe1
feat: ix_ops integration layer — wire ix_full_bridge.so into vllm hot path
dylan
2026-08-15 06:15:17 +00:00
109d29fa60
Merge remote-tracking branch 'modelhub/main'
root
2026-08-15 05:58:37 +00:00
045ea5df79
feat: Cu10 TensorOp batched HGEMM via Iluvatar CUTLASS framework
Claude
2026-08-15 05:44:15 +00:00
30f98c0674
data: Cu10 CUTLASS part 2 — tensorop example, arch.h, cutlass.h
root
2026-08-15 05:41:30 +00:00
f006ab1a01
test: cat tensorop GEMM example + arch.h + cutlass.h from corex-samples
Claude
2026-08-15 05:41:03 +00:00
b922d694dc
data: Cu10 CUTLASS headers from corex-samples
root
2026-08-15 05:32:10 +00:00
1d36754efc
fix: cat_cutlass_cu10.sh writes to cat_files/ directory instead of stdout
Claude
2026-08-15 05:31:33 +00:00
4abb4df215
test: cat Cu10 CUTLASS files — mma_cu10.h, iluvatar_mma.hpp, batched_gemm.cu, default_mma_core_cu10.h
Claude
2026-08-15 05:30:15 +00:00
6b9086c3a9
test: probe Cu10 CUTLASS fork — find mma_cu10.h, tensor op files, batched_gemm example
Claude
2026-08-15 05:27:43 +00:00
a465dd1d75
fix: use F.silu in test script for old corex torch
Claude
2026-08-15 05:22:31 +00:00
a12d070d82
fix: replace torch::silu with x*sigmoid(x) for old corex torch
Claude
2026-08-15 05:22:25 +00:00
c840c9159f
feat: moe_tcu_dispatch.cpp — C++ MoE expert loop via torch::mm (TCU kernel)
Claude
2026-08-15 05:20:05 +00:00
9514092980
test: probe torch.matmul backend + ixformer.matmul/linear + Python loop overhead
Claude
2026-08-15 05:17:13 +00:00
395b3e4042
test: clean rebuild + debug output for kernel 10 correctness
Claude
2026-08-15 05:14:18 +00:00
a8ca42b59c
perf: hgemm_warptiling Config B — beats cublas on MoE-sized GEMM (0.7x)
Claude
2026-08-15 05:11:32 +00:00
21417319bc
test: sweep 6 kernel 10 configs + cublas baseline — find best params for warp64
Claude
2026-08-15 05:08:11 +00:00
27bb8d28df
test: probe kernel 10 perf with CUDA events — isolate bottleneck
Claude
2026-08-14 17:23:41 +00:00
2b12fe687e
feat: hgemm_warptiling.cu — siboehm kernel 10 ported to WARPSIZE=64 FP16
Claude
2026-08-14 17:05:59 +00:00
11b8a98eea
test: probe warp_size=64 behavior + kernel 10 warp tiling with WARPSIZE=64 on BI-V100
Claude
2026-08-14 17:02:55 +00:00
1af7e7cf48
fix: use c10::cuda::getCurrentCUDAStream().stream() for corex torch
Claude
2026-08-14 16:49:47 +00:00
3bee73207e
fix: add cuda_runtime.h to hgemm_bind.cpp for cudaStream_t
Claude
2026-08-14 16:33:29 +00:00
09e5261ba6
refactor: hgemm_blocktiling.cu — strict 1:1 from siboehm kernel 6
Claude
2026-08-14 16:24:22 +00:00
ab42fc1fd7
feat: hgemm_blocktiling.cu — FP16 GEMM kernel for MoE expert dispatch on BI-V100
Claude
2026-08-14 16:22:00 +00:00
9ca33cf4d5
upstream: add GEMM kernel references from 4 repos for BI-V100 porting
Claude
2026-08-14 15:11:57 +00:00
29ecc2e602
feat: moe_expert_gemm.cpp — C++ loop over experts via ixformer_linear (replaces Python for-loop)
Claude
2026-08-14 12:09:50 +00:00
0ace44e293
test: cat ixinfer.h + functional batched GEMM test on BI-V100
Claude
2026-08-14 12:07:00 +00:00
bfc4de2cf3
test: probe cuinfer + cublasLt + cublas batched GEMM APIs for MoE expert dispatch
Claude
2026-08-14 12:03:52 +00:00
d6958070cb
test: probe CUTLASS + __CUDA_ARCH__ on BI-V100 for grouped GEMM feasibility
Claude
2026-08-14 11:59:51 +00:00
50a249e0a3
Revert "feat: batched MoE expert GEMM — replaces Python for-loop"
claude
2026-08-14 11:47:37 +00:00
06d7713db6
feat: batched MoE expert GEMM — replaces Python for-loop
claude
2026-08-14 11:43:46 +00:00
93353a1414
test: probe ixformer .so symbols for MoE grouped GEMM
claude
2026-08-14 11:40:13 +00:00
865c18f852
feat: integrate xllm_moe into qwen3_5.py MoE hot path
claude
2026-08-14 11:37:21 +00:00
e147c283e3
prebuilt: 5 xllm CUDA kernel .so for BI-V100 (ivcore10)
root
2026-08-14 11:34:23 +00:00
31d3ee99bb
fix: MoE kernel include paths — device_utils.cuh + arch_condition.h
claude
2026-08-14 11:31:54 +00:00
df6a0f5d47
fix: remove cuda/functional from MoE topk kernels (not available on corex)
claude
2026-08-14 11:29:19 +00:00
a50adefdfc
feat: xllm MoE CUDA kernels — fused_topk + compute_index + combine
claude
2026-08-14 11:23:49 +00:00
49cd7def89
fix: slot_ids dtype long→int32 in cache test
claude
2026-08-14 11:20:07 +00:00
1f51feee05
fix: cos_sin_cache dtype float→half in rope test
claude
2026-08-14 11:18:02 +00:00
7fc0c1defa
test: AST call chain verification for all 4 xllm kernel .so
claude
2026-08-14 11:14:58 +00:00
3d816cd18d
fix: add ceil_div + DEVICE_INLINE to device_utils.cuh
claude
2026-08-14 11:11:15 +00:00
302aa9608a
fix: block_copy.cu — DEVICE_INLINE, CHECK_EQ→TORCH_CHECK, cstdint
claude
2026-08-14 11:06:07 +00:00
900ae0b1ef
fix: block_copy.cu remove utils.h (glog), CHECK→TORCH_CHECK
claude
2026-08-14 11:02:57 +00:00
a206fc1d43
fix: activation.cu torch/extension.h + LOG(FATAL)→TORCH_CHECK, reshape_paged_cache.cu torch header
claude
2026-08-14 10:52:54 +00:00
093bfb380f
feat: pybind11 bindings for xllm CUDA kernels
claude
2026-08-14 10:50:13 +00:00
415fff85f1
fix: add DISPATCH_FLOATING_TYPES macro to device_utils.cuh
claude
2026-08-14 10:45:37 +00:00
0359103b9b
fix: remove glog/cuda_ops_api.h dependency from all xllm CUDA kernels
claude
2026-08-14 10:30:10 +00:00
51cb90b9ab
fix: adapt xllm norm.cu for corex CUB (CUDA 10.2)
claude
2026-08-14 10:19:51 +00:00
089b9ff4e2
test: fix CUB compat tests + probe corex built-in CUB
claude
2026-08-14 10:11:10 +00:00
793743f5c0
test: CUB compatibility on BI-V100 — warp shuffle + BlockReduce
claude
2026-08-14 08:21:48 +00:00
ec140f3605
docs: complete porting assessment — 5 repos, 2660 build targets, ivcore10 compatibility
claude
2026-08-14 08:17:25 +00:00
3a2cfc87c9
test: xllm CUDA kernel verification suite for BI-V100
claude
2026-08-14 08:01:23 +00:00
8d75652949
feat: import CUDA kernels from xllm/CCCL/FLA upstream repos
claude
2026-08-14 07:48:52 +00:00
051b02d3cd
feat: ix_moe_bridge + ix_attn_bridge — dlopen bridges for full ixformer::infer API
claude
2026-08-14 07:32:31 +00:00
5e9b7c292a
build: all 16 .so prebuilt, no JIT compile in docker
Claude
2026-08-14 07:14:46 +00:00
28102196cd
Merge branch 'main' of https://github.com/dylanyunlon/project_6
root
2026-08-14 07:13:36 +00:00
d32822c5d2
prebuilt: corex_moe_index_combine.so + ix_full_bridge.so (BI-V100 compiled)
root
2026-08-14 07:10:52 +00:00
e7247bd57b
build: integrate ix_full_bridge + corex_moe_index_combine into docker patch_ops.sh
Claude
2026-08-14 07:09:01 +00:00
d9ffc5159d
fix(bridge): rewrite ix_full_bridge.cpp for real ixformer_torch_ext namespace
Claude
2026-08-14 07:00:30 +00:00
9e3157b444
fix(P0): extra=allow + topk_softmax fallback + deploy_local.sh + SO chain verify
Claude
2026-08-14 06:56:00 +00:00
101db8774c
diag: probe_bi100.py — run on real machine, paste output back
Claude
2026-08-14 06:52:52 +00:00
07fad2cce7
fix: max-num-seqs=1 + pure Q-tiling — match a3c45d3b exactly
Claude
2026-08-14 05:40:05 +00:00
1f69311375
fix: flash_attn import path ixformer.contrib → ixformer.functions
Claude
2026-08-14 03:56:23 +00:00
4c1adc11db
fix: restore libcccl_allocator.so + minimal .dockerignore + clean pycache
Claude
2026-08-14 03:51:43 +00:00
dfaaae988e
diag: test_dlopen_chain.py — verify all .so and ixformer dispatch on BI-V100
Claude
2026-08-14 03:47:39 +00:00
336f3349ca
fix(submit): restore flash_attn prefill + all 38eca5c2 improvements
Claude
2026-08-14 03:47:09 +00:00
67a5639c3c
fix(submit): restore a3c45d3b-proven config + safe improvements
Claude
2026-08-14 03:35:24 +00:00
bce79e44be
perf(prefill): restore flash_attn_varlen_func with profiling safety guard
Claude
2026-08-14 02:51:47 +00:00
74ce61712b
fix(build): update prebuilt CoreX artifact count 13→14 — SHA256SUMS has 14 entries after corex_gdn_chunk_recurrent.so was added
Claude
2026-08-14 02:39:42 +00:00
38eca5c26a
revert: restore a3c45d3b yaml + Q-tiling + remove all OOM hacks
Claude
2026-08-14 02:28:48 +00:00
eb57eb7d1c
clean: remove 444 .pyc files + libcccl_allocator.so from git tracking
Claude
2026-08-14 02:20:26 +00:00
41b51382fd
prebuilt: corex_gdn_chunk_recurrent.so + remove __pycache__ from tracking
root
2026-08-14 02:12:32 +00:00
9a52f05783
prebuilt: add corex_gdn_chunk_recurrent.so with fixed pybind kwargs
root
2026-08-14 02:10:54 +00:00
bb0de83d45
fix(pybind): c10::optional<Tensor>() default — c10::nullopt not registered in pybind
Claude
2026-08-14 02:05:30 +00:00
768d89c31a
fix(pybind): add py::arg + defaults to corex_gdn_chunk_recurrent
Claude
2026-08-14 02:02:51 +00:00