Files
project_6/qwen3_6_scripts
EX Engine d841c44e55 fix(GDN): dtype guard on _ix_matmul/_ix_bmm — ixformer.matmul requires kHalf
Root cause from competition platform log:
  /opt/apps/ixformer/functions/matmul.cu:149 'Expected input.dtype() == kHalf'
  Repeats ~80 times — every GDN layer token pass calls _ix_matmul with float32

GDN chunked delta rule uses float32 accumulation (correct for precision).
_ix_matmul was calling ixformer.matmul on float32 tensors → stderr spam.
The try/except caught it and fell back to torch.matmul, but the stderr
output floods the log and may slow down inference.

Fix: check a.dtype == torch.float16 before calling ixformer.matmul.
     Non-half tensors go directly to torch.matmul — zero stderr noise.
2026-08-10 04:45:24 +00:00
..