EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

[doc] Fix more broken links (#1294)

Browse Source
This commit is contained in:
Byron Hsu
2024-09-01 14:46:36 -07:00
committed by GitHub
parent 58fa607622
commit 4a9f8ea43b
1 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
README.md
View File

@@ -393,7 +393,7 @@ You can implement your prompt flow in a function decorated by `sgl.function`.
You can then invoke the function with `run` or `run_batch`. You can then invoke the function with `run` or `run_batch`.
The system will manage the state, chat template, parallelism and batching for you. The system will manage the state, chat template, parallelism and batching for you.
The complete code for the examples below can be found at [readme_examples.py](examples/usage/readme_examples.py) The complete code for the examples below can be found at [readme_examples.py](examples/frontend_language/usage/readme_examples.py)
#### Control Flow #### Control Flow
You can use any Python code within the function body, including control flow, nested function calls, and external libraries. You can use any Python code within the function body, including control flow, nested function calls, and external libraries.
@@ -442,7 +442,7 @@ def image_qa(s, image_file, question):
s += sgl.assistant(sgl.gen("answer", max_tokens=256) s += sgl.assistant(sgl.gen("answer", max_tokens=256)
``` ```
See also [srt_example_llava.py](examples/quick_start/srt_example_llava.py). See also [srt_example_llava.py](examples/frontend_language/quick_start/local_example_llava_next.py).
#### Constrained Decoding #### Constrained Decoding
Use `regex` to specify a regular expression as a decoding constraint. Use `regex` to specify a regular expression as a decoding constraint.
@@ -486,7 +486,7 @@ def character_gen(s, name):
s += sgl.gen("json_output", max_tokens=256, regex=character_regex) s += sgl.gen("json_output", max_tokens=256, regex=character_regex)
``` ```
See also [json_decode.py](examples/usage/json_decode.py) for an additional example of specifying formats with Pydantic models. See also [json_decode.py](examples/frontend_language/usage/json_decode.py) for an additional example of specifying formats with Pydantic models.
#### Batching #### Batching
Use `run_batch` to run a batch of requests with continuous batching. Use `run_batch` to run a batch of requests with continuous batching.