1 Commits

Author SHA1 Message Date
4paradigm
a0d9bdf96e fix README.md
All checks were successful
Docker Build and Push / docker (push) Successful in 1m5s
2026-08-05 14:13:43 +08:00

View File

@@ -57,7 +57,25 @@ docker run -dit --name <container_name> \
--trust-remote-code --max-model-len 2048 --enforce-eager -tp 1
```
## 构建
## 测试
如果发送请求时出现以下报错:
```
ValueError: default chat template is no longer allowed, so you must provide a chat template if the tokenizer does not define one.
```
请使用 completion 接口测试,而非 chat completion
```bash
curl http://localhost:8000/v1/completions \
-H "Content-Type: application/json" \
-d '{
"model": "llm",
"prompt": "Hello, how are you?",
"max_tokens": 100
}'
```
```bash
docker build -t vllm-ascend-fix-tokenizer:latest .