Initial commit: bi100 tokenizer patch
All checks were successful
Docker Build and Push / docker (push) Successful in 1m14s
All checks were successful
Docker Build and Push / docker (push) Successful in 1m14s
Add fix_tokenizer.py, vllm_wrapper.sh, Dockerfile, and README for automatic tokenizer_config.json repair on Iluvatar BI-100 vLLM images.
This commit is contained in:
10
Dockerfile
Normal file
10
Dockerfile
Normal file
@@ -0,0 +1,10 @@
|
||||
FROM harbor-contest.4pd.io/luopingyi/bi100/vllm:0.6.3
|
||||
|
||||
COPY fix_tokenizer.py /opt/fix_tokenizer.py
|
||||
COPY vllm_wrapper.sh /opt/vllm_wrapper.sh
|
||||
|
||||
RUN chmod +x /opt/vllm_wrapper.sh && \
|
||||
mv /usr/local/corex/lib64/python3/dist-packages/bin/vllm \
|
||||
/usr/local/corex/lib64/python3/dist-packages/bin/vllm_real && \
|
||||
ln -s /opt/vllm_wrapper.sh \
|
||||
/usr/local/corex/lib64/python3/dist-packages/bin/vllm
|
||||
Reference in New Issue
Block a user