[Doc] Reranker guide remove deprecated task option (#6385)
### What this PR does / why we need it?
Reranker guide remove deprecated task option.
- vLLM version: v0.14.1
- vLLM main:
dc917cceb8
Signed-off-by: leo-pony <nengjunma@outlook.com>
This commit is contained in:
@@ -35,7 +35,7 @@ Using the Qwen3-Reranker-8B model as an example, first run the docker container
|
|||||||
### Online Inference
|
### Online Inference
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
vllm serve Qwen/Qwen3-Reranker-8B --task score --host 127.0.0.1 --port 8888 --hf_overrides '{"architectures": ["Qwen3ForSequenceClassification"],"classifier_from_token": ["no", "yes"],"is_original_qwen3_reranker": true}'
|
vllm serve Qwen/Qwen3-Reranker-8B --host 127.0.0.1 --port 8888 --hf_overrides '{"architectures": ["Qwen3ForSequenceClassification"],"classifier_from_token": ["no", "yes"],"is_original_qwen3_reranker": true}'
|
||||||
```
|
```
|
||||||
|
|
||||||
Once your server is started, you can send request with follow examples.
|
Once your server is started, you can send request with follow examples.
|
||||||
|
|||||||
Reference in New Issue
Block a user