Add examples for server token-in-token-out (#4103)

Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
2025-03-05 16:16:31 -05:00
parent e70fa279bc
commit 357671e216
6 changed files with 154 additions and 3 deletions
--- a/examples/runtime/engine/readme.md
+++ b/examples/runtime/engine/readme.md
@@ -44,6 +44,6 @@ curl -X POST http://localhost:8000/generate_stream  -H "Content-Type: applicatio

 This will send both non-streaming and streaming requests to the server.

-### [Token-In-Token-Out for RLHF](./token_in_token_out)
+### [Token-In-Token-Out for RLHF](../token_in_token_out)

 In this example, we launch an SGLang engine, feed tokens as input and generate tokens as output.