Improve supported models doc (#6430)
This commit is contained in:
@@ -43,7 +43,7 @@ print("Embeddings:", [x.get("embedding") for x in response.get("data", [])])
|
|||||||
```
|
```
|
||||||
|
|
||||||
|
|
||||||
## Supporting Matrixs
|
## Supported models
|
||||||
|
|
||||||
| Model Family (Embedding) | Example HuggingFace Identifier | Chat Template | Description |
|
| Model Family (Embedding) | Example HuggingFace Identifier | Chat Template | Description |
|
||||||
|-------------------------------------------------|-----------------------------------------------|---------------|--------------------------------------------------------------------------------------------------------------------------------------|
|
|-------------------------------------------------|-----------------------------------------------|---------------|--------------------------------------------------------------------------------------------------------------------------------------|
|
||||||
|
|||||||
@@ -11,8 +11,15 @@ python3 -m sglang.launch_server \
|
|||||||
--port 30000 \
|
--port 30000 \
|
||||||
```
|
```
|
||||||
|
|
||||||
## Supporting Matrixs
|
## Supported models
|
||||||
|
|
||||||
|
Below the supported models are summarized in a table.
|
||||||
|
|
||||||
|
If unsure if a specific architecture is implemented you may look it up via github search for example to search for `Qwen3ForCausalLm` use the expression
|
||||||
|
```
|
||||||
|
repo:sgl-project/sglang path:/^python\/sglang\/srt\/models\// Qwen3ForCausalLm
|
||||||
|
```
|
||||||
|
in Github search.
|
||||||
|
|
||||||
| Model Family (Variants) | Example HuggingFace Identifier | Description |
|
| Model Family (Variants) | Example HuggingFace Identifier | Description |
|
||||||
|-------------------------------------|--------------------------------------------------|----------------------------------------------------------------------------------------|
|
|-------------------------------------|--------------------------------------------------|----------------------------------------------------------------------------------------|
|
||||||
|
|||||||
@@ -1,7 +1,6 @@
|
|||||||
# Multimodal Language Models
|
# Multimodal Language Models
|
||||||
|
|
||||||
These models accept multi-modal inputs (e.g., images and text) and generate text output. They augment language models
|
These models accept multi-modal inputs (e.g., images and text) and generate text output. They augment language models with multimodal encoders.
|
||||||
with multimodal encoders.
|
|
||||||
|
|
||||||
## Example launch Command
|
## Example launch Command
|
||||||
|
|
||||||
@@ -12,7 +11,16 @@ python3 -m sglang.launch_server \
|
|||||||
--port 30000 \
|
--port 30000 \
|
||||||
```
|
```
|
||||||
|
|
||||||
## Supporting Metrics
|
## Supported models
|
||||||
|
|
||||||
|
Below the supported models are summarized in a table.
|
||||||
|
|
||||||
|
If unsure if a specific architecture is implemented you may look it up via Github search. For example to search for `Qwen2_5_VLForConditionalGeneration` use the expression
|
||||||
|
```
|
||||||
|
repo:sgl-project/sglang path:/^python\/sglang\/srt\/models\// Qwen2_5_VLForConditionalGeneration
|
||||||
|
```
|
||||||
|
in Github search.
|
||||||
|
|
||||||
|
|
||||||
| Model Family (Variants) | Example HuggingFace Identifier | Chat Template | Description |
|
| Model Family (Variants) | Example HuggingFace Identifier | Chat Template | Description |
|
||||||
|----------------------------|--------------------------------------------|------------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
|----------------------------|--------------------------------------------|------------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||||
|
|||||||
@@ -17,7 +17,7 @@ python3 -m sglang.launch_server \
|
|||||||
--port 30000 \
|
--port 30000 \
|
||||||
```
|
```
|
||||||
|
|
||||||
## Supporting Matrixs
|
## Supported models
|
||||||
|
|
||||||
| Model Family (Reward) | Example HuggingFace Identifier | Description |
|
| Model Family (Reward) | Example HuggingFace Identifier | Description |
|
||||||
|---------------------------------------------------------------------------|-----------------------------------------------------|---------------------------------------------------------------------------------|
|
|---------------------------------------------------------------------------|-----------------------------------------------------|---------------------------------------------------------------------------------|
|
||||||
|
|||||||
Reference in New Issue
Block a user