EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Super tiny fix doc (#5233)

Browse Source
This commit is contained in:
fzyzcjy
2025-05-07 22:41:50 +08:00
committed by GitHub
parent 4c7b42424c
commit c68de47915
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
python/sglang/srt/entrypoints/engine.py
View File

@@ -348,8 +348,8 @@ class Engine(EngineBase):
load_format: Optional[str] = None, load_format: Optional[str] = None,
flush_cache: bool = True, flush_cache: bool = True,
): ):
"""Update weights from distributed source. If there are going to be more updates, set `flush_cache` to be true """Update weights from distributed source. If there are going to be more updates, set `flush_cache` to be false
to avoid duplicated operations such as clearing cache.""" to avoid duplicated cache cleaning operation."""
obj = UpdateWeightsFromTensorReqInput( obj = UpdateWeightsFromTensorReqInput(
serialized_named_tensors=[ serialized_named_tensors=[
MultiprocessingSerializer.serialize(named_tensors) MultiprocessingSerializer.serialize(named_tensors)