Support oai in benchmark/mmlu (#323)

2024-03-22 13:37:57 -07:00
parent b57abe1663
commit e2b2f0a213
3 changed files with 15 additions and 5 deletions
--- a/benchmark/mmlu/README.md
+++ b/benchmark/mmlu/README.md
@@ -15,6 +15,10 @@ python -m sglang.launch_server --model-path meta-llama/Llama-2-7b-chat-hf --port
 python3 bench_sglang.py --nsub 10
 ```

+```
+# OpenAI models
+python3 bench_sglang.py --backend gpt-3.5-turbo --parallel 8
+```

 ### Benchmark vllm
 ```