[Doc][Misc] Improve readability and fix typos in documentation (#8633)
### What this PR does / why we need it? This PR improves the readability of the documentation by fixing typos, correcting command extensions. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Documentation changes only. Signed-off-by: sunshine202600 <sunshine202600@163.com>
This commit is contained in:
@@ -350,7 +350,7 @@ curl http://localhost:8000/v1/chat/completions \
|
||||
{"role": "system", "content": "You are a helpful assistant."},
|
||||
{"role": "user", "content": [
|
||||
{"type": "image_url", "image_url": {"url": "https://modelscope.oss-cn-beijing.aliyuncs.com/resource/qwen.png"}},
|
||||
{"type": "text", "text": "What is the text in the illustrate?"}
|
||||
{"type": "text", "text": "What is the text in the illustration?"}
|
||||
]}
|
||||
]
|
||||
}'
|
||||
@@ -437,7 +437,7 @@ curl http://localhost:8000/v1/chat/completions \
|
||||
{"role": "system", "content": "You are a helpful assistant."},
|
||||
{"role": "user", "content": [
|
||||
{"type": "image_url", "image_url": {"url": "https://modelscope.oss-cn-beijing.aliyuncs.com/resource/qwen.png"}},
|
||||
{"type": "text", "text": "What is the text in the illustrate?"}
|
||||
{"type": "text", "text": "What is the text in the illustration?"}
|
||||
]}
|
||||
]
|
||||
}'
|
||||
|
||||
@@ -228,7 +228,7 @@ curl http://<node0_ip>:<port>/v1/chat/completions \
|
||||
{"role": "system", "content": "You are a helpful assistant."},
|
||||
{"role": "user", "content": [
|
||||
{"type": "image_url", "image_url": {"url": "https://modelscope.oss-cn-beijing.aliyuncs.com/resource/qwen.png"}},
|
||||
{"type": "text", "text": "What is the text in the illustrate?"}
|
||||
{"type": "text", "text": "What is the text in the illustration?"}
|
||||
]}
|
||||
]
|
||||
}'
|
||||
|
||||
@@ -117,7 +117,7 @@ curl http://localhost:8000/v1/chat/completions \
|
||||
{"role": "system", "content": "You are a helpful assistant."},
|
||||
{"role": "user", "content": [
|
||||
{"type": "image_url", "image_url": {"url": "https://modelscope.oss-cn-beijing.aliyuncs.com/resource/qwen.png"}},
|
||||
{"type": "text", "text": "What is the text in the illustrate?"}
|
||||
{"type": "text", "text": "What is the text in the illustration?"}
|
||||
]}
|
||||
],
|
||||
"max_completion_tokens": 100
|
||||
|
||||
@@ -151,8 +151,7 @@ python -m vllm.entrypoints.api_server \
|
||||
--tensor-parallel-size 2 \
|
||||
--data-parallel-size 1 \
|
||||
--served-model-name quantized_model \
|
||||
--trust-remote-code \
|
||||
--quantization ascend
|
||||
--trust-remote-code
|
||||
```
|
||||
|
||||
## References
|
||||
|
||||
@@ -133,7 +133,7 @@ curl http://localhost:8001/v1/chat/completions \
|
||||
{"role": "system", "content": "You are a helpful assistant."},
|
||||
{"role": "user", "content": [
|
||||
{"type": "image_url", "image_url": {"url": "https://modelscope.oss-cn-beijing.aliyuncs.com/resource/qwen.png"}},
|
||||
{"type": "text", "text": "What is the text in the illustrate?"}
|
||||
{"type": "text", "text": "What is the text in the illustration?"}
|
||||
]}
|
||||
]
|
||||
}'
|
||||
@@ -310,7 +310,7 @@ curl http://localhost:8001/v1/chat/completions \
|
||||
{"role": "system", "content": "You are a helpful assistant."},
|
||||
{"role": "user", "content": [
|
||||
{"type": "image_url", "image_url": {"url": "https://modelscope.oss-cn-beijing.aliyuncs.com/resource/qwen.png"}},
|
||||
{"type": "text", "text": "What is the text in the illustrate?"}
|
||||
{"type": "text", "text": "What is the text in the illustration?"}
|
||||
]}
|
||||
]
|
||||
}'
|
||||
|
||||
Reference in New Issue
Block a user