### What this PR does / why we need it? For single node test, the lack of a retry mechanism for accessing ModelScope resulted in an HTTP 400 error sometimes. I recommend using a local offline cache instead. - vLLM version: v0.12.0 - vLLM main: https://github.com/vllm-project/vllm/commit/ad32e3e19ccf0526cb6744a5fed09a138a5fb2f9 --------- Signed-off-by: wangli <wangli858794774@gmail.com>