project_6 475574fd3d [muh] bench_triton_real + bi100_configs: REAL tunable surface benchmark ...

TUNING_SURFACE_TRUTH.md identified the 5 ACTUAL tunable surfaces on BI-V100
(ixformer pre-compiled kernels ignore CUB-style params). This commit adds
tools targeting those real surfaces:

New files:
- muh/bench_triton_real.py: Benchmark with ACTUAL parameter injection into
  Triton JIT kernels (prefix_prefill BLOCK/WARPS, flash_attn configs, MoE M)
- muh/bi100_triton_configs.py: SMEM-safe triton.Config generator (SM=16)
- muh/bi100_configs.json: 22 flash_attn + 9 prefill + 5 MoE candidate configs

SMEM formula: Q_resident + K_per_iter + softmax_state (not naive Q+K+V+acc).
BLOCK_M=128 fits at 85% SMEM utilization with head_dim=128.

2026-08-04 06:19:07 +00:00

..

include

[muh] 7 headers 完整移植 CCCL tuning tables: segmented_sort 7%→29%, merge_sort 22%→43%, merge 30%→49%, adjacent_difference 38%→65%, batch_memcpy 37%→41%, find 35%→43%, find_bound 31%→44%

2026-08-03 21:36:50 +00:00

schema

[MUH] Bootstrap muh toolchain — extract/parse/gen_yaml/gen_patch + baseline.muh

2026-07-30 10:39:06 +00:00

test

[MUH] Derive BI-V100 tuning values from hardware specs — fix 5 SMEM overflow bugs

2026-07-30 15:08:30 +00:00

tests

test: add SMEM safety validator for all 26 tuning algorithms

2026-08-01 12:37:14 +08:00

bench_bi100.py

feat(muh): add bench_bi100.py — CCCL BruteForceSeeker for BI-V100

2026-08-03 10:24:37 +00:00

bench_triton_prefill.py

feat: asymmetric BLOCK_M/BLOCK_N search + re-add BI-V100 autotune configs

2026-08-03 11:18:18 +00:00

bench_triton_real.py

[muh] bench_triton_real + bi100_configs: REAL tunable surface benchmark

2026-08-04 06:19:07 +00:00

bi100_configs.json

[muh] bench_triton_real + bi100_configs: REAL tunable surface benchmark

2026-08-04 06:19:07 +00:00

bi100_triton_configs.py

[muh] bench_triton_real + bi100_configs: REAL tunable surface benchmark

2026-08-04 06:19:07 +00:00

extract.py

[MUH] Bootstrap muh toolchain — extract/parse/gen_yaml/gen_patch + baseline.muh

2026-07-30 10:39:06 +00:00

gen_patch.py

feat(gen_patch): add TUNING_REGISTRY for all 26 algorithms

2026-08-01 12:33:14 +08:00

gen_yaml.py

[MUH] Bootstrap muh toolchain — extract/parse/gen_yaml/gen_patch + baseline.muh

2026-07-30 10:39:06 +00:00

parse.py

[MUH] Bootstrap muh toolchain — extract/parse/gen_yaml/gen_patch + baseline.muh

2026-07-30 10:39:06 +00:00

run_on_bi100.sh

feat: asymmetric BLOCK_M/BLOCK_N search + re-add BI-V100 autotune configs

2026-08-03 11:18:18 +00:00

vllm_bi100_patch.py

feat(muh): apply CCCL-derived BI-V100 tuning to 5 vllm Python files

2026-08-03 10:27:10 +00:00