Previously any arguments after the image in docker run were silently
dropped: entrypoint.sh never forwarded "$@", so
docker run ... <image> --served-model-name mymodel
started fine but kept serving as llm with no warning.
- entrypoint.sh: forward "$@"; skip script-generated flags the user
already provided so vllm never sees duplicate keys; strip those keys
from EXTRA_ARGS when the command line also sets them
- precedence: command line > EXTRA_ARGS > same-name -e > detected default
- warn when --port / --served-model-name is overridden, since the host
-p side and the client model field must change too
- README: document the three ways and their precedence
- run.sh: bridge + -p ${HOST_PORT:-24396}:80, health check uses host port
- entrypoint.sh: PORT defaults to 80, SERVED_NAME defaults to llm
detected port/served name become log hints only
- verify.sh: read host port from port bindings, expect model name llm
- docker-compose.yml: ports mapping instead of network_mode host
- README: update tables, commands and rationale
- detect_model.py picks TP/port/served name/eager/util from config.json
- validate TP against the model config (dense global KV heads, MoE k % 32)
- one apply_patch.py covers both variants, idempotent
- Dockerfile stays generic: no ENV/WORKDIR/EXPOSE/ENTRYPOINT
- run.sh/verify.sh follow the llama4-bi150 layout
