EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

[doc] add a note for --n-share-experts-fusion args (#6154)

Browse Source
This commit is contained in:
Xiaoyu Zhang
2025-05-12 14:18:38 +08:00
committed by GitHub
parent 3f2702ae51
commit 9f2c9568f0
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
python/sglang/srt/server_args.py
View File

@@ -1194,7 +1194,7 @@ class ServerArgs:
type=int,
default=0,
help="The number of shared_experts need to be replicated to fuse with normal experts in deepseek v3/r1, "
"set it to tp_size can get best optimized performance.",
"set it to tp_size can get best optimized performance. Note that for architectures with SM==90, we have enabled the shared experts fusion optimization by default for DeepSeek V3/R1, with n_share_experts_fusion automatically set to the TP size.",
)
parser.add_argument(
"--disable-chunked-prefix-cache",