EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

[Bugfix] Fix two batch overlap with auto DeepEP Dispatch (#7853)

Browse Source 
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
This commit is contained in:
Shangming Cai
2025-07-08 17:49:32 +08:00
committed by GitHub
parent 2b0e1d1ce0
commit d379bda4fa
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
python/sglang/srt/two_batch_overlap.py
View File

@@ -490,6 +490,7 @@ class TboForwardBatchPreparer:
output_dict["spec_info"] = output_spec_info output_dict["spec_info"] = output_spec_info
for key in [ for key in [
"forward_mode", "forward_mode",
"is_extend_in_batch",
"return_logprob", "return_logprob",
"req_to_token_pool", "req_to_token_pool",
"token_to_kv_pool", "token_to_kv_pool",