Claude ff971686d4 fix(CRITICAL): max_model_len 100000→80000 (KV cache only 88112) + NaN fix
Docker log proves two fatal issues:

1. max_model_len=100000 > KV cache capacity 88112 → ValueError crash
   'max seq len (100000) is larger than maximum number of tokens
    that can be stored in KV cache (88112)'
   Fix: set max_model_len=80000 (safe margin below 88112)

2. NaN in GatedDeltaNet layers 34,36,37,38 (frac=1.0000)
   Root cause: g.cumsum() → g.exp() overflow to inf → inf*0 = NaN
   Fix: clamp all g values to [-80,80] before exp() calls
   (max safe float32 exp input ~88, use 80 for margin)
   Applied to: cumsum result, k_cumdecay, attn_inter, last_state update

3. CoreX modules confirmed NOT in base image:
   'CoreX GDN module not found'
   'CoreX MoE module not found'
   → pure PyTorch is the only path, must be numerically stable
2026-08-08 15:08:00 +00:00
2026-08-07 08:43:51 +00:00
2026-07-30 17:03:23 +08:00
2026-08-07 07:47:01 +00:00

project_6

Description
No description provided
Readme 427 MiB
Languages
C++ 41.8%
Cuda 31.6%
Python 22.2%
C 2.1%
CMake 1.1%
Other 1.1%