dylanyunlon fe64650681 add muh/run_on_bi100.sh — single-paste diagnostic + benchmark for Phanthy Cloud ...

8 steps in sequence, no user interaction needed:
1. Hardware diagnostics (SM count, SMEM, VRAM per GPU)
2. SMEM 32KB vs 48KB definitive answer from torch.cuda.get_device_properties
3. Triton availability check
4. prefix_prefill kernel import test
5. Triton compilation smoke test (compile+run trivial kernel)
6. Actual prefill kernel benchmark: 16 variants × 4 ctx_lens
7. Show current computility-run.yaml
8. fused_moe BLOCK_SIZE_M dispatch table for Qwen3.6 dimensions

2026-08-03 10:51:20 +00:00

..

include

feat(muh): reduce_by_key 55→203 lines — full key_size×accum_size dispatch

2026-08-03 07:20:23 +00:00

schema

[MUH] Bootstrap muh toolchain — extract/parse/gen_yaml/gen_patch + baseline.muh

2026-07-30 10:39:06 +00:00

test

[MUH] Derive BI-V100 tuning values from hardware specs — fix 5 SMEM overflow bugs

2026-07-30 15:08:30 +00:00

tests

test: add SMEM safety validator for all 26 tuning algorithms

2026-08-01 12:37:14 +08:00

bench_bi100.py

feat(muh): add bench_bi100.py — CCCL BruteForceSeeker for BI-V100

2026-08-03 10:24:37 +00:00

bench_triton_prefill.py

feat(muh): add bench_triton_prefill.py — real compile-time param injection benchmark

2026-08-03 10:46:19 +00:00

extract.py

[MUH] Bootstrap muh toolchain — extract/parse/gen_yaml/gen_patch + baseline.muh

2026-07-30 10:39:06 +00:00

gen_patch.py

feat(gen_patch): add TUNING_REGISTRY for all 26 algorithms

2026-08-01 12:33:14 +08:00

gen_yaml.py

[MUH] Bootstrap muh toolchain — extract/parse/gen_yaml/gen_patch + baseline.muh

2026-07-30 10:39:06 +00:00

parse.py

[MUH] Bootstrap muh toolchain — extract/parse/gen_yaml/gen_patch + baseline.muh

2026-07-30 10:39:06 +00:00

run_on_bi100.sh

add muh/run_on_bi100.sh — single-paste diagnostic + benchmark for Phanthy Cloud

2026-08-03 10:51:20 +00:00

vllm_bi100_patch.py

feat(muh): apply CCCL-derived BI-V100 tuning to 5 vllm Python files

2026-08-03 10:27:10 +00:00