[Doc]: Deepseek reference docs (#2787)

This commit is contained in:
Xiaotong Jiang
2025-01-09 13:43:12 -08:00
committed by GitHub
parent 4f077c01b8
commit 11fffbc95a
3 changed files with 37 additions and 2 deletions

View File

@@ -6,9 +6,9 @@ To use a model from [ModelScope](https://www.modelscope.cn), set the environment
export SGLANG_USE_MODELSCOPE=true
```
We take [Qwen2-7B-Instruct](https://www.modelscope.cn/models/qwen/qwen2-7b-instruct) as an example. Launch the Server:
---
We take [Qwen2-7B-Instruct](https://www.modelscope.cn/models/qwen/qwen2-7b-instruct) as an example.
Launch the Server:
```bash
python -m sglang.launch_server --model-path qwen/Qwen2-7B-Instruct --port 30000
```