xiejiahao
05f1c3932f
All checks were successful
Docker Build and Push / docker (push) Successful in 1m11s
- detect_model.py picks TP/port/served name/eager/util from config.json - validate TP against the model config (dense global KV heads, MoE k % 32) - one apply_patch.py covers both variants, idempotent - Dockerfile stays generic: no ENV/WORKDIR/EXPOSE/ENTRYPOINT - run.sh/verify.sh follow the llama4-bi150 layout
4 lines
74 B
Bash
4 lines
74 B
Bash
FRAMEWORK=vllm_gemma_4
|
|
GPU_TYPE=Iluvatar_bi-150
|
|
TASK_TYPE=text-generation
|