EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

[Auto Sync] Update deepseek_v2.py (20250922) (#10717)

Browse Source 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Michael Granado <mgranado@together.ai>
This commit is contained in:
Yineng Zhang
2025-09-21 17:43:50 -07:00
committed by GitHub
parent 0f04a5f428
commit f67d1f45bc
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
python/sglang/srt/models/deepseek_v2.py
View File

@@ -451,7 +451,7 @@ class MoEGate(nn.Module):
_is_cuda _is_cuda
and hidden_states.shape[0] <= 16 and hidden_states.shape[0] <= 16
and hidden_states.shape[1] == 7168 and hidden_states.shape[1] == 7168
and self.weight.shape[0] == 256 and (self.weight.shape[0] == 256 or self.weight.shape[0] == 384)
and _device_sm >= 90 and _device_sm >= 90
): ):
# router gemm output float32 # router gemm output float32