whx 59d23c39eb [DP] External dp server starter (#2685) ...

This PR re-implements external-dp starter based on vllm's support for
external dp.

- vLLM version: v0.10.1.1
- vLLM main:
f38035c123

---------

Signed-off-by: whx-sjtu <2952154980@qq.com>

2025-09-03 16:30:26 +08:00

..

disaggregated_prefill_v1

[MAIN][BUGFIX] BugFix: Resolve the issue of waiting queue accumulation when requests are canceled. (#2426)

2025-08-29 17:19:23 +08:00

eplb

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837)

2025-07-17 14:13:30 +08:00

external_online_dp

[DP] External dp server starter (#2685)

2025-09-03 16:30:26 +08:00

offline_data_parallel.py

[Misc] Add extra checking to torchair_graph_config. (#1939)

2025-08-01 09:24:11 +08:00

offline_disaggregated_prefill_npu.py

[BugFix] update the kv transfer config (#2121)

2025-08-01 08:56:55 +08:00

offline_dualbatch_overlap_npu.py

[main][refactor] Refactoring forward_context and model_runner_v1 (#1979)

2025-07-28 14:06:20 +08:00

offline_embed.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837)

2025-07-17 14:13:30 +08:00

offline_external_launcher.py

ut: add example and e2e test for sleepmode in external_launcher (#2152)

2025-08-06 11:11:53 +08:00

offline_inference_audio_language.py

Fix some ci issue and refactor modelrunner (#2445)

2025-08-20 09:01:04 +08:00

offline_inference_npu_tp2.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837)

2025-07-17 14:13:30 +08:00

offline_inference_npu.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837)

2025-07-17 14:13:30 +08:00

offline_inference_sleep_mode_npu.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837)

2025-07-17 14:13:30 +08:00

prompt_embedding_inference.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837)

2025-07-17 14:13:30 +08:00

run_dp_server.sh

[Bug] Fix run bug in run_dp_server.sh (#2139)

2025-08-02 16:52:12 +08:00