project6-dev 1be9449883 feat(EX): corex_gdn + corex_moe — dlopen dispatch chain from comp 168 log analysis
From 2d5232c5 docker log analysis:
  07-23 (168's docker): corex_gdn.py + corex_moe.py → full fused kernels
  08-07 (our docker): missing both → NaN GDN + PyTorch MoE fallback

corex_gdn.py: GDN fused kernel dispatch
  - FlashQLA .so loading (gdn_forward.cu pre-compiled)
  - PyTorch chunked delta rule with fp32 accum + clamp (no NaN)
  - Decode single-step recurrent with state clamping

corex_moe.py: MoE fused pipeline
  - topk_softmax: replaces MISSING ixf_F.vllm_moe_topk_softmax
  - Per-expert GEMM via torch.matmul (cublas under the hood)
  - ixformer.silu_and_mul for activation when available

DLOPEN_DISPATCH_CHAIN.md: complete .so loading chain map
deploy_corex_modules.sh: wire into VLLM/model_executor/models/
2026-08-10 03:37:15 +00:00
2026-08-07 08:43:51 +00:00
2026-07-30 17:03:23 +08:00
2026-08-07 07:47:01 +00:00

project_6

Description
No description provided
Readme 427 MiB
Languages
C++ 41.8%
Cuda 31.6%
Python 22.2%
C 2.1%
CMake 1.1%
Other 1.1%