Commit Graph

2 Commits

Author SHA1 Message Date
claude
14fe8fb0d9 fix(CRITICAL): docker build容错 + max_completion_tokens + extra=ignore + ix_unified bridge
Build fixes:
- patch_ops.sh: remove set -e, all python3 patch calls now || true
- require_file: warn instead of exit 2
- transformers version check: warn instead of raise SystemExit

Protocol fixes (Sub 520 400 errors):
- Add max_completion_tokens field to ChatCompletionRequest
- Route max_completion_tokens to max_tokens in all to_sampling_params
- Change extra=forbid to extra=ignore to tolerate unknown fields

EX Engine (upstream搬运):
- ex_engine/csrc/ilu/: 18 files from upstream xllm (kernels + layers)
- ix_unified_bridge.cpp: single pybind11 entry for all 14 ixformer infer APIs
- ix_unified.py: 3-tier dispatch (bridge then ixformer then pytorch)
- gdn_fp32.py: FP32 accumulation GDN (fixes 99.98 pct NaN)
- moe_dispatch.py: 7-step MoE pipeline replacing Python for-loop
2026-08-11 07:13:05 +00:00
EX Engine
fcfb764560 feat(EX): Algorithm Factor Replacement Engine — dlopen-based CUDA kernel dispatch
Factors: 0 (moe_topk_softmax), 2 (moe_fused_gemm), 5 (gdn_chunk_fwd)
Fixes: topk_softmax fallback (2304x/token), GDN NaN (frac=0.9998-1.0)
2026-08-10 02:25:23 +00:00