Files
project_6/qwen3_6_scripts
project6-dev 7d4edd4ac7 fix(GDN): force fp16 cast before norm+out_proj — ixformer matmul requires kHalf
matmul.cu:149 'Expected input.dtype() == kHalf' error in competition log.
Root cause: _torch_chunk_gated_delta_rule returns fp32 core_out,
passed directly to self.norm() → self.out_proj() which calls ixformer matmul.

Fix: explicit .to(torch.float16) on core_out and z before norm.
2026-08-10 04:45:32 +00:00
..