Claude
|
c152bd5a89
|
feat: ex_factor_0.so ctypes桥接 + ex_engine package部署
1. ex_topk_bridge.py (100行):
ctypes.CDLL加载ex_factor_0.so → ex_dispatch_moe_topk_softmax()
CCCL warp-shuffle kernel, 零SMEM, 64 experts × topk=8
2. _custom_ops.py topk_softmax调用链新增Priority 1:
P0: ix_bridge → ixformer::infer
P1: ex_factor_0.so → CCCL warp kernel ← NEW
P2: _moe_C.so → vllm v0.5.5 kernel
P3: moe_topk_softmax_v3.so → 自编译kernel
3. patch_ops.sh补齐ex_engine package部署:
ex_engine/python/*.py + build/*.so → site-packages/ex_engine/
|
2026-08-11 09:57:30 +00:00 |
|