Yun Dai 2695ab0537 Fix loading KV quantization scale; Enable modelopt kv cache (#4686) ...

Co-authored-by: qingquansong <ustcsqq@gmail.com>

2025-04-08 09:11:35 -07:00

..

attention

Add unit test on page_size > 1 and mla and integration test for Flash Attention 3 (#4760)

2025-04-07 23:20:51 -07:00

__init__.py

Fix circular imports in gptq.py and unblock test explorer (#4736)

2025-03-24 18:07:08 -07:00

few_shot_gsm8k_engine.py

[engine] support async and streaming (#1614)

2024-10-11 15:26:25 -07:00

few_shot_gsm8k.py

Improve code styles (#4021)

2025-03-03 03:20:23 -08:00

long_prompt.txt

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

run_eval.py

Fuse more ops & Simplify token mapping (#1758)

2024-10-22 23:20:43 -07:00

runners.py

support clip embedding model (#4506)

2025-03-27 00:18:15 -07:00

send_one.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

simple_eval_common.py

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

simple_eval_gpqa.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_humaneval.py

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

simple_eval_math.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_mgsm.py

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

simple_eval_mmlu.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

test_activation.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_block_fp8_ep.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_block_fp8.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_custom_ops.py

sgl scaled_fp8_quant support output padding (#4861)

2025-04-02 23:53:57 +08:00

test_dynamic_grad_mode.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_layernorm.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_programs.py

[Feature] SPMD for SGLang + Verl (#3852)

2025-02-28 09:53:10 -08:00

test_utils.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00