router: Support parallel sampling num > 1 in grpc_server and non-stream handling (#10929)

Browse Source

...

This commit is contained in:

Chang Su

2025-09-25 20:03:35 -07:00

committed by GitHub

parent 3e95aa1a09

commit 37158f2018

8 changed files with 281 additions and 135 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

124

python/sglang/srt/grpc/sglang_scheduler_pb2.py

File diff suppressed because one or more lines are too long