update docs for Yi-VL
This commit is contained in:
@@ -357,9 +357,11 @@ python -m sglang.launch_server --model-path meta-llama/Llama-2-7b-chat-hf --port
|
||||
- Llama
|
||||
- Mistral
|
||||
- Mixtral
|
||||
- Qwen / Qwen 2
|
||||
- LLaVA
|
||||
- `python3 -m sglang.launch_server --model-path liuhaotian/llava-v1.5-7b --tokenizer-path llava-hf/llava-1.5-7b-hf --chat-template vicuna_v1.1 --port 30000`
|
||||
- Qwen / Qwen 2
|
||||
- Yi-VL
|
||||
- see [srt_example_yi_vl.py](examples/quick_start/srt_example_yi_vl.py).
|
||||
- AWQ quantization
|
||||
|
||||
## Benchmark And Performance
|
||||
|
||||
Reference in New Issue
Block a user