EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Minor remove one kernel for DeepSeek (#6977)

Browse Source
This commit is contained in:
fzyzcjy
2025-06-09 08:41:35 +08:00
committed by GitHub
parent 86fe943bc3
commit de1350ea20
1 changed files with 5 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
python/sglang/srt/models/deepseek_v2.py
View File

@@ -421,10 +421,13 @@ class DeepseekV2MoE(nn.Module):
topk_weights=topk_weights, topk_weights=topk_weights,
forward_mode=forward_mode, forward_mode=forward_mode,
) )
final_hidden_states *= self.routed_scaling_factor
if shared_output is not None: if shared_output is not None:
final_hidden_states = final_hidden_states + shared_output x = shared_output
x.add_(final_hidden_states, alpha=self.routed_scaling_factor)
final_hidden_states = x
else:
final_hidden_states *= self.routed_scaling_factor
return final_hidden_states return final_hidden_states