Claude abd3d5640a arch(CRITICAL): replace custom qwen3_5.py with base original (1369 lines)
CCCL tuning_rle_encode.cuh AST chain led to reading the base engine zip:
  enginex-vllm-bi100-qwen36-main.zip → qwen3_6_scripts/qwen3_5.py (63KB, 1369 lines)

vs our custom version (85KB, 1780 lines) which added:
  - _hw_policy with hardcoded clamp values
  - nan_to_num(nan=0.0) double disaster
  - Custom _torch_chunk_gated_delta_rule with aggressive clamps
  - Custom FusedMoE fallback logic
  - All of which BROKE the native CoreX acceleration

Sub168 docker log proves:
  - corex_gdn.py:56 loads libcorex_gdn.so (fused GDN decode)
  - corex_gdn.py:228 uses fused GDN prefill
  - corex_moe.py:339 uses CoreX fused MoE (expert-grouped-wmma)
  These are Docker image-internal modules that our custom code never called.

Base original:
  - No nan_to_num (NaN propagates honestly)
  - No custom clamps (uses model weights as-is)
  - Same class structure (Qwen3_5ForCausalLM, Qwen3_5MoeForCausalLM)
  - Docker image's corex modules can intercept through vllm's internal dispatch

qwen3_5_base_original.py kept as reference.
2026-08-08 08:10:55 +00:00
2026-08-07 08:43:51 +00:00
2026-07-30 17:03:23 +08:00
2026-08-07 07:47:01 +00:00

project_6

Description
No description provided
Readme 427 MiB
Languages
C++ 41.8%
Cuda 31.6%
Python 22.2%
C 2.1%
CMake 1.1%
Other 1.1%