EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Constraint Decoding: Set xgrammar as the default grammar backend (#4386)

Browse Source
This commit is contained in:
mlmz
2025-03-17 09:53:43 +08:00
committed by GitHub
parent d1112d8548
commit 452db50808
4 changed files with 243 additions and 10 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
python/sglang/srt/server_args.py
View File

@@ -125,7 +125,7 @@ class ServerArgs:
# Kernel backend
attention_backend: Optional[str] = None
sampling_backend: Optional[str] = None
grammar_backend: Optional[str] = "outlines"
grammar_backend: Optional[str] = "xgrammar"
# Speculative decoding
speculative_algorithm: Optional[str] = None