muh 50c731412a [INSIGHT] tuning_scan: gridDim.x < 500 makes ALL delay policies equivalent on BI-V100 ...

From single_pass_scan_operators.cuh detail::delay():
  if (gridDim.x < GridThreshold=500) → __threadfence_block()
  else → __nanosleep(Delay)

BI-V100 max gridDim.x ≈ 80 (16 SMs × 5 subscription). Always < 500.
Therefore ns/dcid/l2w tuning dimensions are irrelevant — every delay
constructor degrades to threadfence_block on this hardware.

Also: paged_attn.py spread_out_items_per_thread adaptive tile sizing.
CCCL source: single_pass_scan_operators.cuh lines 160-175.

2026-08-05 09:32:21 +00:00

..

include

[INSIGHT] tuning_scan: gridDim.x < 500 makes ALL delay policies equivalent on BI-V100

2026-08-05 09:32:21 +00:00

schema

[MUH] Bootstrap muh toolchain — extract/parse/gen_yaml/gen_patch + baseline.muh

2026-07-30 10:39:06 +00:00

test

[MUH] Derive BI-V100 tuning values from hardware specs — fix 5 SMEM overflow bugs

2026-07-30 15:08:30 +00:00

tests

test: add SMEM safety validator for all 26 tuning algorithms

2026-08-01 12:37:14 +08:00

bench_bi100.py

feat(muh): add bench_bi100.py — CCCL BruteForceSeeker for BI-V100

2026-08-03 10:24:37 +00:00

bench_triton_prefill.py

feat: asymmetric BLOCK_M/BLOCK_N search + re-add BI-V100 autotune configs

2026-08-03 11:18:18 +00:00

bench_triton_real.py

[muh] bench_triton_real + bi100_configs: REAL tunable surface benchmark

2026-08-04 06:19:07 +00:00

bi100_configs.json

[muh] bench_triton_real + bi100_configs: REAL tunable surface benchmark

2026-08-04 06:19:07 +00:00

bi100_triton_configs.py

[muh] bench_triton_real + bi100_configs: REAL tunable surface benchmark

2026-08-04 06:19:07 +00:00

extract.py

[MUH] Bootstrap muh toolchain — extract/parse/gen_yaml/gen_patch + baseline.muh

2026-07-30 10:39:06 +00:00

gen_patch.py

[gen_patch] Replace dead .cu injection points with real Triton/config targets

2026-08-05 03:36:37 +00:00

gen_yaml.py

[MUH] Bootstrap muh toolchain — extract/parse/gen_yaml/gen_patch + baseline.muh

2026-07-30 10:39:06 +00:00

parse.py

[MUH] Bootstrap muh toolchain — extract/parse/gen_yaml/gen_patch + baseline.muh

2026-07-30 10:39:06 +00:00

run_on_bi100.sh

feat: asymmetric BLOCK_M/BLOCK_N search + re-add BI-V100 autotune configs

2026-08-03 11:18:18 +00:00

vllm_bi100_patch.py

feat(muh): apply CCCL-derived BI-V100 tuning to 5 vllm Python files

2026-08-03 10:27:10 +00:00