EngineX-Iluvatar/enginex-vllm-bi100-qwen36
16
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Qwen3.6-27B iluvatar bi-v100 adaptation

Browse Source
This commit is contained in:
Lu Xinlong
2026-05-21 16:37:24 +08:00
parent fad74b701b
commit 0e89906481
13 changed files with 2283 additions and 11 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
qwen3_6_scripts/patch_ops.sh Executable file
View File

@@ -0,0 +1,10 @@
pip install transformers==4.55.3 -i https://pypi.tuna.tsinghua.edu.cn/simple
cp -r ./qwen3_5 /usr/local/lib/python3.10/site-packages/transformers/models/
python3 ./patch_transformers_qwen3_5.py
cp ./mamba_cache.py /usr/local/corex/lib/python3/dist-packages/vllm/model_executor/models/
cp ./qwen3_5.py /usr/local/corex/lib/python3/dist-packages/vllm/model_executor/models/
python3 ./patch_vllm_qwen3_5.py
# 此步骤脚本四选一（默认 matmul+seq策略）
python3 ./patch_xformers_sdpa_seq.py