Benchmark Updates (#382)

2024-04-24 02:23:01 +08:00
parent 150d7020ed
commit da19434c2f
18 changed files with 72 additions and 17 deletions
--- a/benchmark/multi_chain_reasoning/README.md
+++ b/benchmark/multi_chain_reasoning/README.md
@@ -7,7 +7,7 @@ wget https://raw.githubusercontent.com/openai/grade-school-math/master/grade_sch

 ### Benchmark sglang
 ```
-python -m sglang.launch_server --model-path meta-llama/Llama-2-7b-chat-hf --port 30000
+python -m sglang.launch_server --model-path meta-llama/Llama-2-7b-chat-hf --port 30000  --schedule-conservativeness 1.3
 ```

 ```