harrisonlimh 747dd45077 feat: throttle requests at scheduler based on --max_queued_requests (#7565)

2025-07-28 22:32:33 +08:00

..

attention

Fix circular import in test_prefix_chunk_info.py (#7097)

2025-06-11 10:57:45 -07:00

__init__.py

Fix circular imports in gptq.py and unblock test explorer (#4736)

2025-03-24 18:07:08 -07:00

few_shot_gsm8k_engine.py

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

few_shot_gsm8k.py

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

long_prompt.txt

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

run_eval.py

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

runners.py

[feat] Support different attention backends for prefill and decode (#6338)

2025-07-28 11:42:29 +08:00

send_one.py

Correctly abort the failed grammar requests & Improve the handling of abort (#6803)

2025-06-01 19:00:07 -07:00

simple_eval_common.py

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

simple_eval_gpqa.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_humaneval.py

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

simple_eval_math.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_mgsm.py

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

simple_eval_mmlu.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

test_activation.py

[AMD] Add silu_and_mul, gelu_and_mul, gelu_tanh_and_mul, and gelu_quick kernels for AMD GPUs (#7135)

2025-07-24 23:44:28 -07:00

test_block_fp8_deep_gemm_blackwell.py

[fix] fix DeepGEMM blackwell input quant & ut & fix style and log (#7247)

2025-06-16 11:45:54 -07:00

test_block_fp8_ep.py

[1/N] MoE Refactor: refactor select_experts (#7966)

2025-07-19 00:51:15 -07:00

test_block_fp8.py

[1/N] MoE Refactor: refactor select_experts (#7966)

2025-07-19 00:51:15 -07:00

test_custom_ops.py

[AMD] Remove vllm's scaled_fp8_quant and moe_sum when SGLANG_USE_AITER=1 (#7484)

2025-07-21 17:33:19 -07:00

test_cutlass_moe.py

[CUTLASS-FP4-MOE] Introduce CutlassMoEParams class for easy initialization of Cutlass Grouped Gems Metadata (#6887)

2025-06-05 13:13:14 -07:00

test_cutlass_w4a8_moe.py

[1/N] MoE Refactor: refactor select_experts (#7966)

2025-07-19 00:51:15 -07:00

test_deepep_utils.py

Add DeepEP to CI PR Test (#5655)

2025-05-06 17:36:03 -07:00

test_dynamic_grad_mode.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_fp4_moe.py

[1/N] MoE Refactor: refactor select_experts (#7966)

2025-07-19 00:51:15 -07:00

test_layernorm.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_marlin_moe.py

[3/n] chore: decouple AWQ implementation from vLLM dependency (#8113)

2025-07-18 11:45:22 -07:00

test_marlin_utils.py

[3/n] chore: decouple AWQ implementation from vLLM dependency (#8113)

2025-07-18 11:45:22 -07:00

test_programs.py

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

test_utils.py

feat: throttle requests at scheduler based on --max_queued_requests (#7565)

2025-07-28 22:32:33 +08:00