add a batch llava example

This commit is contained in:
Lianmin Zheng
2024-01-24 11:44:07 +00:00
parent 6dceab4d17
commit 711d343530
2 changed files with 23 additions and 2 deletions

View File

@@ -8,6 +8,7 @@ image benchmark source: https://huggingface.co/datasets/liuhaotian/llava-bench-i
### Other Dependency
```
pip3 install "sglang[all]"
pip3 install "torch>=2.1.2" "transformers>=4.36" pillow
```