Add Support for Qwen2-VL Multi-modal Embedding Models (#3694)

2025-03-07 08:46:20 +08:00
parent 13bc39c5d6
commit 361971b859
11 changed files with 356 additions and 34 deletions
--- a/docs/references/supported_models.md
+++ b/docs/references/supported_models.md
@@ -38,6 +38,8 @@
 - Mistral embedding models
 - Qwen embedding models
  - `python -m sglang.launch_server --model-path Alibaba-NLP/gte-Qwen2-7B-instruct --is-embedding`
+- Multi-modal embedding models
+  - `python -m sglang.launch_server --model-path Alibaba-NLP/gme-Qwen2-VL-2B-Instruct --is-embedding --chat-template gme-qwen2-vl`

 ## Reward Models