EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

[Docs]: Fix Multi-User Port Allocation Conflicts (#3601)

Browse Source 
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
Co-authored-by: simveit <simp.veitner@gmail.com>
This commit is contained in:
Shi Shuai
2025-02-19 19:15:44 +00:00
committed by GitHub
parent 6b0aeb58fd
commit 55de40f782
12 changed files with 168 additions and 117 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
docs/backend/native_api.ipynb
View File

@@ -252,7 +252,7 @@
"metadata": {},
"outputs": [],
"source": [
"terminate_process(server_process, port)\n",
"terminate_process(server_process)\n",
"\n",
"embedding_process, port = launch_server_cmd(\n",
" \"\"\"\n",
@@ -286,7 +286,7 @@
"metadata": {},
"outputs": [],
"source": [
"terminate_process(embedding_process, port)"
"terminate_process(embedding_process)"
]
},
{
@@ -304,7 +304,7 @@
"metadata": {},
"outputs": [],
"source": [
"terminate_process(embedding_process, port)\n",
"terminate_process(embedding_process)\n",
"\n",
"# Note that SGLang now treats embedding models and reward models as the same type of models.\n",
"# This will be updated in the future.\n",
@@ -355,7 +355,7 @@
"metadata": {},
"outputs": [],
"source": [
"terminate_process(reward_process, port)"
"terminate_process(reward_process)"
]
},
{
@@ -425,7 +425,7 @@
"metadata": {},
"outputs": [],
"source": [
"terminate_process(tokenizer_free_server_process, port)"
"terminate_process(tokenizer_free_server_process)"
]
}
],