[Feature] Prefill assistant response - add continue_final_message parameter (#4226)

Co-authored-by: Chayenne <zhaochen20@outlook.com>
2025-04-21 06:07:18 +05:30
parent 5156d5a413
commit 8b39274e34
6 changed files with 82 additions and 23 deletions
--- a/test/srt/test_openai_server.py
+++ b/test/srt/test_openai_server.py
@@ -534,6 +534,7 @@ The SmartHome Mini is a compact smart home assistant available in black or white
                },
            ],
            temperature=0,
+            extra_body={"continue_final_message": True},
        )

        assert (