dylanyunlong/project_6

Go to file

muh-bot 162a45d4ea [muh_kernel_map] fix syntax error + add bytes_in_flight from CCCL babelstream benchmark

Two missing commas in BI_V100 dict caused Python SyntaxError.

Added bytes_in_flight=64KB from bench_bi100.py real-hardware data:
  bif=8 (64KB) beat bif=0 (32KB) at all problem sizes
  Top 30 transform/float16 results ALL have bif=8
  Physical: BW/SM × HBM_latency = 56 GB/s × 1100ns ≈ 62KB
  CCCL cc_to_min_bytes_in_flight: B200=64KB (54 GB/s/SM)
  BI-V100 matches B200 tier, not A100 (16KB) or V100 (12KB)

Source: cccl_upstream/cub/benchmarks/bench/transform/babelstream.cu
and cccl_upstream/cub/cub/device/dispatch/tuning/tuning_transform.cuh
cc_to_min_bytes_in_flight() function.

2026-08-05 03:34:12 +00:00

[CCCL] 瘦身 + 补全: 移除 cudax/python/libcudacxx-tests 冗余文件, 新增 c2h 测试助手 + cmake 构建系统 + 8 个 CUDA thrust examples

2026-08-03 12:39:26 +00:00

[docs] agent_scan.cuh architecture — scan SMEM is real, reduce SMEM is not

2026-08-05 03:33:40 +00:00

[analysis] 关键架构发现: gen_patch 注入目标不存在 + paged_attn V1 硬编码

2026-08-05 03:32:31 +00:00

fix: critical config + tuning corrections from CCCL source analysis

2026-08-03 06:45:54 +00:00

qwen3_6_scripts

feat: CCCL-derived 3-tier decode dispatch + SM=16 prefill tuning + multi-step scheduling

2026-08-03 08:28:38 +00:00

[v2] PARTITION_SIZE 512→1024 + fix import path

2026-08-05 03:32:23 +00:00

feat: add qwen3_5.py vllm adapter for Qwen3.6-35B-A3B

2026-08-01 13:54:33 +00:00

__init__.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

.gitignore

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

attention.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

baseline.muh

[MUH] Fix three-layer disconnect — C++ headers are now the single source of truth

2026-07-30 14:12:33 +00:00

BI_V100_BENCHMARK_RUNBOOK.md

[docs] BI-V100 benchmark runbook: Phase 0 硬件探测 + Phase 1 quick sweep + Phase 3 端到端验证

2026-08-04 01:14:30 +00:00

CCCL_INTEGRATION_STATUS.md

docs: CCCL integration status — 462 assets inventory, 8/8 decode hot path coverage, no-clone-more verdict

2026-08-03 03:50:24 +00:00

chat_dataset_v0.json

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

computility-run.yaml

[yaml+prefill] num-scheduler-steps 8→16 from CCCL delay analysis

2026-08-05 03:16:06 +00:00

Dockerfile

feat: deploy CCCL-tuned prefix_prefill + muh_dispatch + fix SM=16 count

2026-08-03 08:30:16 +00:00

ENGINEX_INJECTION_MAP.md

docs: EngineX vllm injection map — Python not C++, Triton not CUDA, 32KB SMEM claim

2026-08-03 03:59:49 +00:00

enginex-vllm-bi100-qwen36-main.zip

update baseline

2026-07-30 15:19:37 +00:00

launch_service

sync: align with enginex-vllm-bi100-qwen36 baseline (1902c81f)

2026-07-31 09:43:58 +00:00

muh_dispatch.py

feat: deploy CCCL-tuned prefix_prefill + muh_dispatch + fix SM=16 count

2026-08-03 08:30:16 +00:00

muh_kernel_map.py

[muh_kernel_map] fix syntax error + add bytes_in_flight from CCCL babelstream benchmark

2026-08-05 03:34:12 +00:00

MUH_PROJECT_CHECKPOINT.md

[MUH] Fix 7 structural discrepancies vs CCCL — read source, not grep

2026-07-30 14:37:38 +00:00

paged_attention_v2_pytorch.py

[v2] PARTITION_SIZE 512→1024 + fix import path

2026-08-05 03:32:23 +00:00

paged_attention_v2_triton.py

[ARCH] CCCL-derived paged attention kernel architecture + Triton rewrite

2026-07-31 04:13:07 +00:00

paged_attn.py

[v2] Wire paged_attention_v2_pytorch into vllm — enable V2 for long sequences

2026-08-05 03:26:18 +00:00

prefix_prefill.py

[prefill] asymmetric BLOCK_M/BLOCK_N from CCCL AgentReduce insight

2026-08-05 03:07:20 +00:00

README.md

Initial commit

2026-07-30 17:03:23 +08:00

TUNING_SURFACE_TRUTH.md

fix: revert invalid patches, add honest tuning surface assessment

2026-08-03 10:34:28 +00:00

README.md

project_6

Languages

C++ 41.8%

Cuda 31.6%

Python 22.2%

C 2.1%

CMake 1.1%

Other 1.1%