Update docs
This commit is contained in:
@@ -79,7 +79,7 @@ pip install -U --index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/
|
||||
## Backend: SGLang Runtime (SRT)
|
||||
The SGLang Runtime (SRT) is an efficient serving engine.
|
||||
|
||||
### Launching a Server
|
||||
### Quick Start
|
||||
Launch a server
|
||||
```
|
||||
python -m sglang.launch_server --model-path meta-llama/Meta-Llama-3-8B-Instruct --port 30000
|
||||
|
||||
@@ -121,6 +121,7 @@ Download an image
|
||||
curl -o example_image.png -L https://github.com/sgl-project/sglang/blob/main/test/lang/example_image.png?raw=true
|
||||
```
|
||||
|
||||
Send a request
|
||||
```python
|
||||
import requests
|
||||
|
||||
@@ -139,4 +140,4 @@ print(response.json())
|
||||
```
|
||||
|
||||
The `image_data` can be a file name, a URL, or a base64 encoded string. See also `python/sglang/srt/utils.py:load_image`.
|
||||
Streaming is supported in a similar manner as [above](#streaming).
|
||||
Streaming is supported in a similar manner as [above](#streaming).
|
||||
|
||||
Reference in New Issue
Block a user