EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Fix the error message and dependency of openai backend (#71)

Browse Source
This commit is contained in:
Lianmin Zheng
2024-01-21 14:56:25 -08:00
committed by GitHub
parent e8f2b155fe
commit 007eeb4eb9
4 changed files with 26 additions and 16 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@@ -164,7 +164,8 @@ def image_qa(s, image_file, question):
```
### Constrained Decoding
Use `regex=` to specify a regular expression as a decoding constraint.
Use `regex` to specify a regular expression as a decoding constraint.
This is only supported for local models.
```python
@sgl.function