Stefan He e0917e6bd0 Remove vllm ops scaled fp8 quant and accelerate per token quant by 20-28% (#4215) ...

Co-authored-by: Stefan He <bhe@linkedin.com>

2025-03-12 00:08:03 -07:00

..

few_shot_gsm8k_engine.py

[engine] support async and streaming (#1614)

2024-10-11 15:26:25 -07:00

few_shot_gsm8k.py

Improve code styles (#4021)

2025-03-03 03:20:23 -08:00

long_prompt.txt

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

run_eval.py

Fuse more ops & Simplify token mapping (#1758)

2024-10-22 23:20:43 -07:00

runners.py

Add Support for Qwen2-VL Multi-modal Embedding Models (#3694)

2025-03-06 16:46:20 -08:00

send_one.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

simple_eval_common.py

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

simple_eval_gpqa.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_humaneval.py

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

simple_eval_math.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_mgsm.py

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

simple_eval_mmlu.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

test_activation.py

feat: use gelu_tanh_and_mul (#1193)

2024-08-24 01:58:16 -07:00

test_block_fp8_ep.py

Expert Parallelism (EP) Support for DeepSeek V3/R1 (#3602)

2025-02-26 02:29:37 -08:00

test_block_fp8.py

linear support deepgemm (#4199)

2025-03-11 00:38:37 -07:00

test_custom_ops.py

Remove vllm ops scaled fp8 quant and accelerate per token quant by 20-28% (#4215)

2025-03-12 00:08:03 -07:00

test_layernorm.py

feat: update GemmaRMSNorm (#1232)

2024-08-28 22:47:34 +10:00

test_programs.py

[Feature] SPMD for SGLang + Verl (#3852)

2025-02-28 09:53:10 -08:00

test_utils.py

Amd test fp8 (#4261)

2025-03-10 10:12:09 -07:00