yiz-liu 5305a2ccf9 [Bugfix] Tweak distributed process group initialization and add dummy… (#816) ...

fix batch execution method to enable DP in V1

Signed-off-by: Yizhou Liu <liu_yizhou@outlook.com>

2025-05-12 17:31:29 +08:00

..

attention

[Core] Support the features of prefix cache and chunked prefill in v0/v1 (#782)

2025-05-09 16:39:28 +08:00

core

[MISC] fix format check error (#654)

2025-04-29 11:14:19 +08:00

device_allocator

[MISC] Clean up torch_npu (#688)

2025-04-29 18:03:38 +08:00

distributed

[Disaggregated Prefill] P2P Disaggregated Prefill based on llm_datadist (#694)

2025-05-01 22:31:36 +08:00

lora

[Bugfix] fix import error (#600)

2025-04-22 08:57:25 +08:00

models

[Perf] Optimize fused_experts quantization code to save npu memory (#784)

2025-05-09 15:09:37 +08:00

ops

[Bugfix] Correct method call for _set_cos_sin_cache (#774)

2025-05-09 12:55:57 +08:00

patch

[Bugfix] Tweak distributed process group initialization and add dummy… (#816)

2025-05-12 17:31:29 +08:00

quantization

[Perf] Optimize fused_experts quantization code to save npu memory (#784)

2025-05-09 15:09:37 +08:00

worker

[Bugfix] Tweak distributed process group initialization and add dummy… (#816)

2025-05-12 17:31:29 +08:00

__init__.py

[Core] Cleanup triton patch which has been fixed in vllm (#764)

2025-05-06 18:52:15 +08:00

envs.py

[MISC] Make vllm version configurable (#651)

2025-04-28 14:19:06 +08:00

platform.py

[Core] Support the features of prefix cache and chunked prefill in v0/v1 (#782)

2025-05-09 16:39:28 +08:00

utils.py

[MISC] Clean up torch_npu (#688)

2025-04-29 18:03:38 +08:00