Keep image generic; move startup settings into run.sh/compose
All checks were successful
Docker Build and Push / docker (push) Successful in 1h29m12s
All checks were successful
Docker Build and Push / docker (push) Successful in 1h29m12s
This commit is contained in:
@@ -78,6 +78,11 @@ MODEL_HOST_DIR=/mnt/disk0/models/LLM-Research/Llama-4-Maverick-17B-128E-Instruct
|
||||
GPUs : 0,1,2,...,15
|
||||
```
|
||||
|
||||
> 镜像本身不设置 `ENTRYPOINT` / `CMD` / `ENV` / `WORKDIR` / `EXPOSE`,
|
||||
> 启动方式、模型路径、端口、TP/PP、GPU 和挂载全部由 `run.sh` 或 `docker-compose.yml` 传入。
|
||||
> 如果直接 `docker run`,需要显式指定:
|
||||
> `--entrypoint /usr/local/bin/llama4-entrypoint.sh --workdir /opt/llama4`。
|
||||
|
||||
### 2.1 自动检测规则
|
||||
|
||||
`detect_model.py` 读取 `config.json`:
|
||||
|
||||
Reference in New Issue
Block a user