[Fix] fix Qwen2-Audio-7B-Instruct accuracy test (#4017)

### What this PR does / why we need it?

fix Qwen2-Audio-7B-Instruct accuracy test

### Does this PR introduce _any_ user-facing change?

### How was this patch tested?

- vLLM version: v0.11.0
- vLLM main:
83f478bb19

Signed-off-by: hfadzxy <starmoon_zhang@163.com>

tests/e2e/models/configs/Qwen2-Audio-7B-Instruct.yaml

@@ -8,3 +8,4 @@ tasks:
   - name: "exact_match,flexible-extract"
     value: 0.45
 num_fewshot: 5
+gpu_memory_utilization: 0.8