From 506e5de8febd65761d04f1f53e11d4e6bc3a31c2 Mon Sep 17 00:00:00 2001 From: simveit <69345428+simveit@users.noreply.github.com> Date: Mon, 19 May 2025 19:43:35 +0200 Subject: [PATCH] Improve supported models doc (#6430) --- docs/supported_models/embedding_models.md | 2 +- docs/supported_models/generative_models.md | 9 ++++++++- .../supported_models/multimodal_language_models.md | 14 +++++++++++--- docs/supported_models/reward_models.md | 2 +- 4 files changed, 21 insertions(+), 6 deletions(-) diff --git a/docs/supported_models/embedding_models.md b/docs/supported_models/embedding_models.md index 738a201a7..777341a41 100644 --- a/docs/supported_models/embedding_models.md +++ b/docs/supported_models/embedding_models.md @@ -43,7 +43,7 @@ print("Embeddings:", [x.get("embedding") for x in response.get("data", [])]) ``` -## Supporting Matrixs +## Supported models | Model Family (Embedding) | Example HuggingFace Identifier | Chat Template | Description | |-------------------------------------------------|-----------------------------------------------|---------------|--------------------------------------------------------------------------------------------------------------------------------------| diff --git a/docs/supported_models/generative_models.md b/docs/supported_models/generative_models.md index e6e396518..e7147ad8c 100644 --- a/docs/supported_models/generative_models.md +++ b/docs/supported_models/generative_models.md @@ -11,8 +11,15 @@ python3 -m sglang.launch_server \ --port 30000 \ ``` -## Supporting Matrixs +## Supported models +Below the supported models are summarized in a table. + +If unsure if a specific architecture is implemented you may look it up via github search for example to search for `Qwen3ForCausalLm` use the expression +``` +repo:sgl-project/sglang path:/^python\/sglang\/srt\/models\// Qwen3ForCausalLm +``` +in Github search. | Model Family (Variants) | Example HuggingFace Identifier | Description | |-------------------------------------|--------------------------------------------------|----------------------------------------------------------------------------------------| diff --git a/docs/supported_models/multimodal_language_models.md b/docs/supported_models/multimodal_language_models.md index 3f88db78e..9e6ddaece 100644 --- a/docs/supported_models/multimodal_language_models.md +++ b/docs/supported_models/multimodal_language_models.md @@ -1,7 +1,6 @@ # Multimodal Language Models -These models accept multi-modal inputs (e.g., images and text) and generate text output. They augment language models -with multimodal encoders. +These models accept multi-modal inputs (e.g., images and text) and generate text output. They augment language models with multimodal encoders. ## Example launch Command @@ -12,7 +11,16 @@ python3 -m sglang.launch_server \ --port 30000 \ ``` -## Supporting Metrics +## Supported models + +Below the supported models are summarized in a table. + +If unsure if a specific architecture is implemented you may look it up via Github search. For example to search for `Qwen2_5_VLForConditionalGeneration` use the expression +``` +repo:sgl-project/sglang path:/^python\/sglang\/srt\/models\// Qwen2_5_VLForConditionalGeneration +``` +in Github search. + | Model Family (Variants) | Example HuggingFace Identifier | Chat Template | Description | |----------------------------|--------------------------------------------|------------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| diff --git a/docs/supported_models/reward_models.md b/docs/supported_models/reward_models.md index d98e7b037..ef4474637 100644 --- a/docs/supported_models/reward_models.md +++ b/docs/supported_models/reward_models.md @@ -17,7 +17,7 @@ python3 -m sglang.launch_server \ --port 30000 \ ``` -## Supporting Matrixs +## Supported models | Model Family (Reward) | Example HuggingFace Identifier | Description | |---------------------------------------------------------------------------|-----------------------------------------------------|---------------------------------------------------------------------------------|