EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Docs: Refactor Contribution Guide (#2690)

Browse Source
This commit is contained in:
Shi Shuai
2024-12-31 22:11:00 +00:00
committed by GitHub
parent 286cad3ee3
commit 0a765bbccc
5 changed files with 176 additions and 45 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
docs/backend/openai_api_completions.ipynb
View File

@@ -24,14 +24,7 @@
"source": [
"## Launch A Server\n",
"\n",
"This code block is equivalent to executing \n",
"\n",
"```bash\n",
"python -m sglang.launch_server --model-path meta-llama/Meta-Llama-3.1-8B-Instruct \\\n",
"--port 30000 --host 0.0.0.0\n",
"```\n",
"\n",
"in your terminal and wait for the server to be ready."
"Launch the server in your terminal and wait for it to initialize."
]
},
{

9
docs/backend/openai_api_embeddings.ipynb
View File

@@ -20,14 +20,7 @@
"source": [
"## Launch A Server\n",
"\n",
"The following code is equivalent to running this in the shell:\n",
"\n",
"```bash\n",
"python -m sglang.launch_server --model-path Alibaba-NLP/gte-Qwen2-7B-instruct \\\n",
" --port 30000 --host 0.0.0.0 --is-embedding\n",
"```\n",
"\n",
"Remember to add `--is-embedding` to the command."
"Launch the server in your terminal and wait for it to initialize. Remember to add `--is-embedding` to the command."
]
},
{

8
docs/backend/openai_api_vision.ipynb
View File

@@ -22,13 +22,7 @@
"source": [
"## Launch A Server\n",
"\n",
"This code block is equivalent to executing \n",
"\n",
"```bash\n",
"python3 -m sglang.launch_server --model-path meta-llama/Llama-3.2-11B-Vision-Instruct \\\n",
" --port 30000 --chat-template llama_3_vision\n",
"```\n",
"in your terminal and wait for the server to be ready.\n",
"Launch the server in your terminal and wait for it to initialize.\n",
"\n",
"Remember to add `--chat-template llama_3_vision` to specify the vision chat template, otherwise the server only supports text.\n",
"We need to specify `--chat-template` for vision language models because the chat template provided in Hugging Face tokenizer only supports text."