35f9da0c80da85f89293ea83c69b320b394845d6
Policy: fallback = 0 score = same as crash. Better to crash with clear
error log so we can diagnose.
Changes:
1. corex_gdn.py: COMPLETE REWRITE (374 lines)
- CoreXGDN.forward() now implements full GDN layer forward
- Accepts all 13 args from qwen3_5.py (hidden_states, attn_metadata,
conv_state, temporal_state, in_proj_qkv/z/b/a, conv1d_weight,
A_log, dt_bias, norm, out_proj)
- Prefill: causal conv1d → split q/k/v → chunk_gated_delta_rule
(fp32 accumulation, xllm-aligned cumsum+difference form)
- Decode: causal_conv1d_update → single-step recurrent with
bmm/baddbmm_ (ixformer accelerated)
- NO FALLBACK — if something fails, it crashes
2. qwen3_5.py: Remove all try/except fallbacks
- GatedDeltaNet.__init__: CoreXGDN init MUST succeed (no try/except)
- GatedDeltaNet.forward: CoreXGDN.forward() called directly, no catch
- MoE init: raise RuntimeError if moe_forward missing
3. patch_ops.sh: MUST deploy all three corex modules
- Reverted previous 'don't overwrite' — base image produces NaN
- corex_gdn.py + corex_moe.py + corex_fa2.py all deployed unconditionally
project_6
Description
Languages
C++
41.8%
Cuda
31.6%
Python
22.2%
C
2.1%
CMake
1.1%
Other
1.1%