Fix engine unit test (#1701)

2024-10-17 09:53:32 -07:00
parent 7feba41584
commit dd3809fad8
4 changed files with 12 additions and 8 deletions
--- a/benchmark/llava_bench/README.md
+++ b/benchmark/llava_bench/README.md
@@ -17,7 +17,7 @@ pip3 install "torch>=2.1.2" "transformers>=4.36" pillow
 ### Benchmark sglang
 Launch a server
 ```
-python3 -m sglang.launch_server --model-path liuhaotian/llava-v1.5-7b --tokenizer-path llava-hf/llava-1.5-7b-hf --port 30000
+python3 -m sglang.launch_server --model-path liuhaotian/llava-v1.6-vicuna-7b --tokenizer-path llava-hf/llava-1.5-7b-hf --port 30000
 ```

 Run benchmark