From a0d9bdf96e6bc2ad710fa7b1e0e3038078768742 Mon Sep 17 00:00:00 2001 From: 4paradigm <4paradigm@4paradigmdeMacBook-Pro.local> Date: Wed, 5 Aug 2026 14:13:43 +0800 Subject: [PATCH] fix README.md --- README.md | 20 +++++++++++++++++++- 1 file changed, 19 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 8b6b64e..8713078 100644 --- a/README.md +++ b/README.md @@ -57,7 +57,25 @@ docker run -dit --name \ --trust-remote-code --max-model-len 2048 --enforce-eager -tp 1 ``` -## 构建 +## 测试 + +如果发送请求时出现以下报错: + +``` +ValueError: default chat template is no longer allowed, so you must provide a chat template if the tokenizer does not define one. +``` + +请使用 completion 接口测试,而非 chat completion: + +```bash +curl http://localhost:8000/v1/completions \ + -H "Content-Type: application/json" \ + -d '{ + "model": "llm", + "prompt": "Hello, how are you?", + "max_tokens": 100 + }' +``` ```bash docker build -t vllm-ascend-fix-tokenizer:latest .