dylanyunlon 09e7751d27 feat(muh): add muh_apply.py — Python-level injection tool for EngineX ...

EngineX ships Python + precompiled .so + Triton, no .cu source.
gen_patch.py generates C++ #define patches that have no target files.
muh_apply.py patches the actual Python runtime values:

Injection targets:
  - paged_attn.py: _PARTITION_SIZE (reduce tuning → partition granularity)
  - paged_attn.py: use_v1 threshold (V1/V2 dispatch)
  - computility-run.yaml: --max-num-seqs, --max-num-batched-tokens, --gpu-memory-utilization
  - prefix_prefill.py: BLOCK_M, NUM_WARPS (Triton JIT config)

Source of truth: muh/include/muh/tuning/tuning_*.cuh bi100_* structs
Pipeline: C++ headers → muh_apply.py extract → Python source patch

Modes:
  --check: verify Python values match C++ headers (CI gate)
  --dry-run: show what would change
  (default): apply patches in-place

2026-08-07 02:44:25 +00:00

..

include

[muh/scan] rewrite tuning_scan.cuh: 27%→42% CCCL parity

2026-08-06 06:19:59 +00:00

schema

[MUH] Bootstrap muh toolchain — extract/parse/gen_yaml/gen_patch + baseline.muh

2026-07-30 10:39:06 +00:00

test

[MUH] Derive BI-V100 tuning values from hardware specs — fix 5 SMEM overflow bugs

2026-07-30 15:08:30 +00:00

tests

test: add SMEM safety validator for all 26 tuning algorithms

2026-08-01 12:37:14 +08:00

bench_bi100.py

feat(muh): add bench_bi100.py — CCCL BruteForceSeeker for BI-V100

2026-08-03 10:24:37 +00:00

bench_triton_prefill.py

feat: asymmetric BLOCK_M/BLOCK_N search + re-add BI-V100 autotune configs

2026-08-03 11:18:18 +00:00

bench_triton_real.py

[muh] bench_triton_real + bi100_configs: REAL tunable surface benchmark

2026-08-04 06:19:07 +00:00

bi100_configs.json

[muh] bench_triton_real + bi100_configs: REAL tunable surface benchmark

2026-08-04 06:19:07 +00:00

bi100_triton_configs.py

[muh] bench_triton_real + bi100_configs: REAL tunable surface benchmark

2026-08-04 06:19:07 +00:00

derive_injection.py

[muh/pipeline] derive_injection.py: bridge CCCL struct fields → vllm runtime injection

2026-08-06 05:56:28 +00:00

extract.py

[MUH] Bootstrap muh toolchain — extract/parse/gen_yaml/gen_patch + baseline.muh

2026-07-30 10:39:06 +00:00

gen_patch.py

[muh] gen_patch: expand VLLM_INJECTION_POINTS to full real injection surface

2026-08-06 04:01:40 +00:00

gen_yaml.py

[MUH] Bootstrap muh toolchain — extract/parse/gen_yaml/gen_patch + baseline.muh

2026-07-30 10:39:06 +00:00

muh_apply.py

feat(muh): add muh_apply.py — Python-level injection tool for EngineX

2026-08-07 02:44:25 +00:00

parse.py

[MUH] Bootstrap muh toolchain — extract/parse/gen_yaml/gen_patch + baseline.muh

2026-07-30 10:39:06 +00:00

run_on_bi100.sh

feat: asymmetric BLOCK_M/BLOCK_N search + re-add BI-V100 autotune configs

2026-08-03 11:18:18 +00:00

vllm_bi100_patch.py

feat(muh): apply CCCL-derived BI-V100 tuning to 5 vllm Python files

2026-08-03 10:27:10 +00:00