EX Engine d841c44e55 fix(GDN): dtype guard on _ix_matmul/_ix_bmm — ixformer.matmul requires kHalf
Root cause from competition platform log:
  /opt/apps/ixformer/functions/matmul.cu:149 'Expected input.dtype() == kHalf'
  Repeats ~80 times — every GDN layer token pass calls _ix_matmul with float32

GDN chunked delta rule uses float32 accumulation (correct for precision).
_ix_matmul was calling ixformer.matmul on float32 tensors → stderr spam.
The try/except caught it and fell back to torch.matmul, but the stderr
output floods the log and may slow down inference.

Fix: check a.dtype == torch.float16 before calling ixformer.matmul.
     Non-half tensors go directly to torch.matmul — zero stderr noise.
2026-08-10 04:45:24 +00:00
2026-08-07 08:43:51 +00:00
2026-07-30 17:03:23 +08:00
2026-08-07 07:47:01 +00:00

project_6

Description
No description provided
Readme 427 MiB
Languages
C++ 41.8%
Cuda 31.6%
Python 22.2%
C 2.1%
CMake 1.1%
Other 1.1%