add concurrency
This commit is contained in:
@@ -1,3 +1,4 @@
|
||||
concurrency: 8
|
||||
gpu_num: 1
|
||||
command:
|
||||
- vllm
|
||||
|
||||
Reference in New Issue
Block a user
@@ -1,3 +1,4 @@
|
||||
concurrency: 8
|
||||
gpu_num: 1
|
||||
command:
|
||||
- vllm
|
||||
|
||||