From c500f96bb16c686ee8ba5d5f1fc716a0bd8e5fff Mon Sep 17 00:00:00 2001 From: Lianmin Zheng Date: Tue, 3 Sep 2024 01:43:08 -0700 Subject: [PATCH] Update README.md for llava-onevision instructions (#1313) --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index edde172a2..6d5ddb3ee 100644 --- a/README.md +++ b/README.md @@ -239,6 +239,7 @@ python -m sglang.launch_server --model-path meta-llama/Meta-Llama-3-8B-Instruct - Qwen / Qwen 2 / Qwen 2 MoE - DeepSeek / DeepSeek 2 - [LLaVA-OneVision](https://llava-vl.github.io/blog/2024-08-05-llava-onevision/) + - `python3 -m sglang.launch_server --model-path lmms-lab/llava-onevision-qwen2-7b-ov --port=30000 --chat-template=chatml-llava` - `python3 -m sglang.launch_server --model-path lmms-lab/llava-onevision-qwen2-72b-ov --port=30000 --tp-size=8 --chat-template=chatml-llava` - Query the server with the [OpenAI Vision API](https://platform.openai.com/docs/guides/vision). See examples at [test/srt/test_vision_openai_server.py](test/srt/test_vision_openai_server.py) - LLaVA 1.5 / 1.6 / NeXT