Baizhou Zhang 8ecef73f12 [1/2] Support deterministic inference with flashinfer attention backend (#10645) ...

Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>

2025-09-19 23:34:29 -07:00

..

attention

Integrate trtllm ragged attention for prefill self-attention (#9801)

2025-09-05 17:18:00 +08:00

__init__.py

Fix circular imports in gptq.py and unblock test explorer (#4736)

2025-03-24 18:07:08 -07:00

doc_patch.py

Refactor the docs (#9031)

2025-08-10 19:49:45 -07:00

few_shot_gsm8k_engine.py

Simplify frontend language (#9029)

2025-08-10 10:59:30 -07:00

few_shot_gsm8k.py

[Auto Sync] Update parallel_state.py, few_shot_gsm8k.py (20250903) (#9986)

2025-09-03 16:55:43 -07:00

long_prompt.txt

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

run_eval.py

Add CI for gpt-oss model on hopper (#8851)

2025-08-09 00:34:23 -07:00

runners.py

[Fix] Add speculative_draft_model_revision to server_args (#5255)

2025-09-05 19:45:46 +08:00

send_one.py

Correctly abort the failed grammar requests & Improve the handling of abort (#6803)

2025-06-01 19:00:07 -07:00

simple_eval_common.py

Add CI for gpt-oss model on hopper (#8851)

2025-08-09 00:34:23 -07:00

simple_eval_gpqa.py

Add CI for gpt-oss model on hopper (#8851)

2025-08-09 00:34:23 -07:00

simple_eval_humaneval.py

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

simple_eval_math.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_mgsm.py

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

simple_eval_mmlu.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

test_activation.py

[AMD] Add silu_and_mul, gelu_and_mul, gelu_tanh_and_mul, and gelu_quick kernels for AMD GPUs (#7135)

2025-07-24 23:44:28 -07:00

test_block_fp8_deep_gemm_blackwell.py

[fix] fix DeepGEMM blackwell input quant & ut & fix style and log (#7247)

2025-06-16 11:45:54 -07:00

test_block_fp8_ep.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

test_block_fp8.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

test_custom_ops.py

[AMD] Remove vllm's scaled_fp8_quant and moe_sum when SGLANG_USE_AITER=1 (#7484)

2025-07-21 17:33:19 -07:00

test_cutlass_moe.py

fix the cutlass moe tests (#10182)

2025-09-08 16:24:55 -07:00

test_cutlass_w4a8_moe.py

[feat] Support tp mode for DeepSeek-R1-W4AFP8 (#8118)

2025-09-01 22:17:26 -07:00

test_deepep_utils.py

Add DeepEP to CI PR Test (#5655)

2025-05-06 17:36:03 -07:00

test_deterministic.py

[1/2] Support deterministic inference with flashinfer attention backend (#10645)

2025-09-19 23:34:29 -07:00

test_disaggregation_utils.py

[CI] Refactor disaggregation tests (#10068)

2025-09-06 22:14:46 +08:00

test_dynamic_grad_mode.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_fp4_moe.py

[NVIDIA] [3/N] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#9199)

2025-09-11 20:18:43 -07:00

test_layernorm.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_marlin_moe.py

Replace sglang.srt.layers.quantization.scalar_types with sgl_kernel.scalar_type (#8951)

2025-08-13 19:41:41 -07:00

test_marlin_utils.py

Replace sglang.srt.layers.quantization.scalar_types with sgl_kernel.scalar_type (#8951)

2025-08-13 19:41:41 -07:00

test_programs.py

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

test_utils.py

[Feature] Speculative decoding support lookahead (#9873)

2025-09-18 16:42:41 -07:00