aoshen524 588865f0e0 [Feature] Support Tensor Parallelism and Weight Slicing for Lora (#4274) ...

Co-authored-by: ShenAo1111 <1377693092@qq.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>

2025-03-18 20:33:07 -07:00

..

few_shot_gsm8k_engine.py

[engine] support async and streaming (#1614)

2024-10-11 15:26:25 -07:00

few_shot_gsm8k.py

Improve code styles (#4021)

2025-03-03 03:20:23 -08:00

long_prompt.txt

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

run_eval.py

Fuse more ops & Simplify token mapping (#1758)

2024-10-22 23:20:43 -07:00

runners.py

[Feature] Support Tensor Parallelism and Weight Slicing for Lora (#4274)

2025-03-18 20:33:07 -07:00

send_one.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

simple_eval_common.py

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

simple_eval_gpqa.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_humaneval.py

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

simple_eval_math.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_mgsm.py

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

simple_eval_mmlu.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

test_activation.py

feat: use gelu_tanh_and_mul (#1193)

2024-08-24 01:58:16 -07:00

test_block_fp8_ep.py

Expert Parallelism (EP) Support for DeepSeek V3/R1 (#3602)

2025-02-26 02:29:37 -08:00

test_block_fp8.py

Revert "[XPU][CPU] Enable the native path of DeepSeek" (#4367)

2025-03-12 23:45:52 -07:00

test_custom_ops.py

Remove vllm ops scaled fp8 quant and accelerate per token quant by 20-28% (#4215)

2025-03-12 00:08:03 -07:00

test_dynamic_grad_mode.py

[Fix] use torch.inference_mode() instead of torch.no_grad() (#4372)

2025-03-16 22:54:16 -07:00

test_layernorm.py

feat: update GemmaRMSNorm (#1232)

2024-08-28 22:47:34 +10:00

test_programs.py

[Feature] SPMD for SGLang + Verl (#3852)

2025-02-28 09:53:10 -08:00

test_utils.py

Fix router test (#4483)

2025-03-16 22:49:47 -07:00