Mick 4fa44d63c6 chore: improve mmmu benchmark (#7000) ...

Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>

2025-07-26 16:19:45 +08:00

..

bench_in_batch_prefix

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

benchmark_batch

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

benchmark_vllm_060

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

blog_v0_2

Add a new api configure_logging to allow dumping the requests (#2875)

2025-01-13 14:24:00 -08:00

deepseek_v3

chore: bump v0.4.9.post4 (#8305)

2025-07-25 17:12:47 -07:00

dspy

Organize Benchmark (#381)

2024-05-05 16:14:17 +08:00

fbgemm

[benchmark] fbgemm benchmark support bandwidth report and support fbgemm_cutlass_gmm (#7422)

2025-06-24 09:44:55 -07:00

generative_agents

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

gsm8k

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

hellaswag

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

hicache

bug fix and tag (#8282)

2025-07-23 16:50:31 +08:00

json_decode_regex

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

json_jump_forward

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

json_schema

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

kernels

Fix tuning_fused_moe_triton.py (#8175)

2025-07-19 17:33:50 -07:00

line_retrieval

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

llava_bench

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

llm_judge

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

long_json_decode

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

lora

support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277)

2025-06-04 22:11:24 -07:00

mmlu

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

mmmu

chore: improve mmmu benchmark (#7000)

2025-07-26 16:19:45 +08:00

mtbench

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

multi_chain_reasoning

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

multi_document_qa

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

multi_turn_chat

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

react

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

reasoning_benchmark

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

tip_suggestion

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

tree_of_thought_deep

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

tree_of_thought_v0

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00