EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

fix crash of DeepSeek-V3 update_weights_from_disk (#8863)

Browse Source 
Co-authored-by: parkeychen <parkeychen@tencent.com>
This commit is contained in:
scut-cbq
2025-09-16 09:45:15 +08:00
committed by GitHub
parent 35ef3f2902
commit a220c14f81
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
python/sglang/srt/layers/quantization/fp8.py
View File

@@ -358,8 +358,8 @@ class Fp8LinearMethod(LinearMethodBase):
return return
else: else:
weight, weight_scale = layer.weight.data, layer.weight_scale_inv.data weight, weight_scale = layer.weight.data, layer.weight_scale_inv.data
layer.weight = Parameter(weight, requires_grad=False) layer.weight.data = weight.data
layer.weight_scale_inv = Parameter(weight_scale, requires_grad=False) layer.weight_scale_inv.data = weight_scale.data
else: else:
layer.weight = Parameter(layer.weight.data, requires_grad=False) layer.weight = Parameter(layer.weight.data, requires_grad=False)