dylanyunlong/project_6
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

fix(deploy): wire corex_gdn.py + corex_moe.py into patch_ops.sh

Browse Source 
Deploy to $VLLM/model_executor/models/ so qwen3_5.py import succeeds:
  from vllm.model_executor.models import corex_gdn
  from vllm.model_executor.models import corex_moe

Dispatch chain now complete:
  GDN: corex_gdn (PyTorch fp32) || flash_qla_sm70 (CUDA, gate-clamped) || torch fallback
  MoE: ix_fused_moe_forward (C++) || corex_moe || EX CUB topk || torch fallback
This commit is contained in:
EX Engine
2026-08-10 03:39:49 +00:00
parent 8eba1750fa
commit dba027fded
1 changed files with 12 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

12
qwen3_6_scripts/patch_ops.sh
View File

@@ -178,6 +178,18 @@ if [ -n "$VLLM2" ]; then
cp ./chat_utils.py "$VLLM2/entrypoints/chat_utils.py" 2>/dev/null || true
fi
# Deploy corex_gdn.py + corex_moe.py → vllm model_executor/models/
# These provide the fused GDN prefill kernel and MoE pipeline that competitor 168 had
if [ -f "/workspace/ex_engine/python/corex_gdn.py" ]; then
cp "/workspace/ex_engine/python/corex_gdn.py" "$VLLM/model_executor/models/corex_gdn.py" 2>/dev/null || true
cp "/workspace/ex_engine/python/corex_moe.py" "$VLLM/model_executor/models/corex_moe.py" 2>/dev/null || true
echo "[patch_ops] Deployed: corex_gdn.py + corex_moe.py → $VLLM/model_executor/models/"
if [ -n "$VLLM2" ]; then
cp "/workspace/ex_engine/python/corex_gdn.py" "$VLLM2/model_executor/models/corex_gdn.py" 2>/dev/null || true
cp "/workspace/ex_engine/python/corex_moe.py" "$VLLM2/model_executor/models/corex_moe.py" 2>/dev/null || true
fi
fi
# Deploy EX Engine Python module + C++ bridge into vllm importable path
EX_ENGINE_SRC="/workspace/ex_engine"
if [ -d "$EX_ENGINE_SRC/python" ]; then