Misc fixes (#432)

2024-05-12 15:05:40 -07:00
parent 72bb344388
commit 6e09cf6a15
6 changed files with 23 additions and 5 deletions
--- a/docs/test_process.md
+++ b/docs/test_process.md
@@ -81,3 +81,9 @@ python -m sglang.launch_server --model-path meta-llama/Llama-2-7b-chat-hf --port
 cd test/lang
 python3 run_all.py
 ```
+
+## OpenAI API server
+```
+cd test/srt
+python test_openai_server.py
+```