Files
project_6/qwen3_6_scripts
muh 9203e7b09e [critical/deploy] sync root paged_attn.py + prefix_prefill.py → qwen3_6_scripts/
ROOT CAUSE: All previous CCCL-informed optimizations were applied to
root-level copies (paged_attn.py, prefix_prefill.py), but deployment
uses qwen3_6_scripts/ versions. The two copies diverged silently.

Changes synced:
  paged_attn.py: GridEvenShare tile sizing (TARGET_TILES 4→2,
    MIN_TILE 64→128, MAX_TILE 4096→8192), V2 temp tensor caching,
    BI-V100 SM-aware V1/V2 dispatch heuristic
  prefix_prefill.py: BLOCK=64/BLOCK_N=64/NUM_WARPS=4 for BI-V100,
    SMEM-informed asymmetric tiling, num_stages=1 for CoreX

Without this sync, deployed engine would use old un-optimized code.
2026-08-06 06:10:56 +00:00
..