i-peixingyu/K100-vllm
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

添加 NV A100 Patched 镜像合并/entrypoint.sh

Browse Source
This commit is contained in:
i-peixingyu
2026-04-27 13:14:12 +08:00
parent d9b5380393
commit d78345e8f4
1 changed files with 14 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

14
NV A100 Patched 镜像合并/entrypoint.sh Normal file
View File

@@ -0,0 +1,14 @@
#!/bin/bash
set -e
MODEL_DIR=${MODEL_DIR:-/model}
FIX_TOKENIZER_DIR=/tmp/fixed_tokenizer
echo "[entrypoint] fixing tokenizer..."
python /opt/fix_tokenizer.py
echo "[entrypoint] starting vllm..."
exec vllm serve "$MODEL_DIR" \
--tokenizer "$FIX_TOKENIZER_DIR" \
"$@"