Ravi Theja 7d9679b74d Add MMMU benchmark results (#4491) ...

Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>

2025-04-25 15:23:53 +08:00

..

bench_in_batch_prefix

Add a benchmark script for in-batch prefix caching (#2494)

2024-12-16 18:49:02 -08:00

benchmark_batch

Perform Batch Tokenization. (#5141)

2025-04-20 18:10:37 -07:00

benchmark_vllm_060

[Fix] Fix all the Huggingface paths (#1553)

2024-10-02 10:12:07 -07:00

blog_v0_2

Add a new api configure_logging to allow dumping the requests (#2875)

2025-01-13 14:24:00 -08:00

deepseek_v3

chore: bump v0.4.5.post3 (#5611)

2025-04-21 18:16:20 -07:00

dspy

Organize Benchmark (#381)

2024-05-05 16:14:17 +08:00

generative_agents

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

gsm8k

Basic Cleanup (#4833)

2025-03-27 16:55:48 -07:00

hellaswag

minor: support specifying local dataset path for gsm8k and hellaswag (#2816)

2025-01-09 22:24:42 +08:00

hicache

[CI] Remove unused imports with Ruff to pre-commit config, only to benchmarks/docs/examples folder (#3969)

2025-03-27 19:45:02 -07:00

json_decode_regex

[BugFix] Fix crash when receive a req with structed output in DP attention mode. (#3841)

2025-02-25 09:32:05 -08:00

json_jump_forward

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

json_schema

Merged three native APIs into one: get_server_info (#2152)

2024-11-24 01:37:58 -08:00

kernels

Minor update for ROCm variable style (#5562)

2025-04-19 23:45:27 -07:00

line_retrieval

misc: add pre-commit config (#637)

2024-07-17 11:55:39 -07:00

llava_bench

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

llm_judge

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

long_json_decode

Organize Benchmark (#381)

2024-05-05 16:14:17 +08:00

lora

[CI] Remove unused imports with Ruff to pre-commit config, only to benchmarks/docs/examples folder (#3969)

2025-03-27 19:45:02 -07:00

mmlu

[CI] Remove unused imports with Ruff to pre-commit config, only to benchmarks/docs/examples folder (#3969)

2025-03-27 19:45:02 -07:00

mmmu

Add MMMU benchmark results (#4491)

2025-04-25 15:23:53 +08:00

mtbench

Add EAGLE mtbench benchmark script (#4676)

2025-03-22 13:34:01 -07:00

multi_chain_reasoning

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

multi_document_qa

Organize Benchmark (#381)

2024-05-05 16:14:17 +08:00

multi_turn_chat

[CI] Remove unused imports with Ruff to pre-commit config, only to benchmarks/docs/examples folder (#3969)

2025-03-27 19:45:02 -07:00

react

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

reasoning_benchmark

Benchmark: Statistical Analysis of the Output Stability of the Deepseek Model (#4202)

2025-03-16 17:32:57 -07:00

tip_suggestion

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

tree_of_thought_deep

Improve type annotation and styles (#2926)

2025-01-16 12:51:11 -08:00

tree_of_thought_v0

Organize Benchmark (#381)

2024-05-05 16:14:17 +08:00