EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

[docs / oneliner] update mmmu docs instruction (#9768)

Browse Source 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
This commit is contained in:
Vincent Zhong
2025-09-14 23:26:39 -04:00
committed by GitHub
parent fc2c3a3d8e
commit 1489cd6c02
1 changed files with 4 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
benchmark/mmmu/README.md
View File

@@ -39,8 +39,11 @@ You can use `--extra-request-body` to specify additional OpenAI request paramete
python3 bench_sglang.py --extra-request-body '{"max_new_tokens": 128, "temperature": 0.01}' python3 bench_sglang.py --extra-request-body '{"max_new_tokens": 128, "temperature": 0.01}'
``` ```
### Evaluate hf ### Evaluate HF
``` ```
python benchmark/mmmu/bench_hf.py --model-path Qwen/Qwen2-VL-7B-Instruct python benchmark/mmmu/bench_hf.py --model-path Qwen/Qwen2-VL-7B-Instruct
``` ```
# Profiling MMMU
You should use the standard instructions found in the [dedicated profiling doc](../../docs/developer_guide/benchmark_and_profiling.md) if running this benchmark with the profile option. We recommend using `--concurrency 1` for consistency, which makes profiling and debugging easier.