Commit Graph

1 Commits

Author SHA1 Message Date
project6-dev
9f02200ede diag: verify_flash_attn.py — test flash_attn_func correctness + perf for head_dim=256
flash_attn_func WORKS with head_dim=256 on BI-V100!
This is the path to 10-50x attention speedup.
Tests: correctness vs ref, GQA, long seq, varlen, paged decode, perf.
2026-08-13 04:29:49 +00:00