dylanyunlong/project_6

Go to file

dylanyunlon 35ef79c5f8 [muh] scan: add bi100_lookback_1B_o8 — close SM100 parity gap (7/7 lookback branches)

CCCL SM100 scan lookback has 7 type-specialized branches:
  offset_size=4: 1B, 2B, 4B, 8B
  offset_size=8: 1B, 4B, 8B

muh BI-V100 previously had 6 (missing o8_1B).
This commit adds the o8_1B branch derived from SM100 ref:
  ipt_14.tpb_384.ns_228.dcid_7.l2w_775 → 1.107x
  BI-V100 delay: halved ns (L2 6MB vs 50MB): backon(114, 465)
  nominal_tile = 384*14*4 = 21504 ≤ 49152 ✓

Now: 7/7 lookback + 6/6 lookahead = 13/13 SM100 parity.

2026-07-31 18:35:01 +08:00

[INFRA] Import NVIDIA/CCCL upstream as optimization reference library

2026-07-30 09:35:51 +00:00

[ARCH] CCCL-derived paged attention kernel architecture + Triton rewrite

2026-07-31 04:13:07 +00:00

[muh] scan: add bi100_lookback_1B_o8 — close SM100 parity gap (7/7 lookback branches)

2026-07-31 18:35:01 +08:00

[OPT] BI-V100 Triton kernel tuning + computility-run.yaml optimization

2026-07-30 15:33:44 +00:00

qwen3_6_scripts

sync: align with enginex-vllm-bi100-qwen36 baseline (1902c81f)

2026-07-31 09:43:58 +00:00

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

__init__.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

.gitignore

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

attention.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

baseline.muh

[MUH] Fix three-layer disconnect — C++ headers are now the single source of truth

2026-07-30 14:12:33 +00:00

chat_dataset_v0.json

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

computility-run.yaml

sync: align with enginex-vllm-bi100-qwen36 baseline (1902c81f)

2026-07-31 09:43:58 +00:00

Dockerfile

[CRITICAL] Enable ixformer native V1/V2 paged attention kernels

2026-07-31 06:18:32 +00:00

enginex-vllm-bi100-qwen36-main.zip

update baseline

2026-07-30 15:19:37 +00:00

launch_service

sync: align with enginex-vllm-bi100-qwen36 baseline (1902c81f)

2026-07-31 09:43:58 +00:00

MUH_PROJECT_CHECKPOINT.md

[MUH] Fix 7 structural discrepancies vs CCCL — read source, not grep

2026-07-30 14:37:38 +00:00

paged_attention_v2_pytorch.py

[FIX] V2 shape mismatch bug — v_padded used num_heads for kv_h tensor

2026-07-31 03:52:23 +00:00

paged_attention_v2_triton.py

[ARCH] CCCL-derived paged attention kernel architecture + Triton rewrite

2026-07-31 04:13:07 +00:00

paged_attn.py

sync: align with enginex-vllm-bi100-qwen36 baseline (1902c81f)

2026-07-31 09:43:58 +00:00

prefix_prefill.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

README.md

Initial commit

2026-07-30 17:03:23 +08:00

README.md

project_6

Languages

C++ 41.8%

Cuda 31.6%

Python 22.2%

C 2.1%

CMake 1.1%

Other 1.1%