whx 0a526768f5 [Feature] Support moe multi-stream for aclgraph. (#2946) ...

This PR puts the calculation of shared experts into a separate stream,
overlaping with routing experts.

- vLLM version: v0.10.2
- vLLM main:
fbd6523ac0

---------

Signed-off-by: whx-sjtu <2952154980@qq.com>

2025-09-19 11:06:45 +08:00

..

disaggregated_prefill_v1

Remove chunked_prefill_for_mla and fix ring_mla bug (#2781)

2025-09-18 19:43:26 +08:00

eplb

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837)

2025-07-17 14:13:30 +08:00

external_online_dp

[Feature] Support moe multi-stream for aclgraph. (#2946)

2025-09-19 11:06:45 +08:00

offline_data_parallel.py

[Misc] Add extra checking to torchair_graph_config. (#1939)

2025-08-01 09:24:11 +08:00

offline_disaggregated_prefill_npu.py

[BugFix] update the kv transfer config (#2121)

2025-08-01 08:56:55 +08:00

offline_dualbatch_overlap_npu.py

[main][refactor] Refactoring forward_context and model_runner_v1 (#1979)

2025-07-28 14:06:20 +08:00

offline_embed.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837)

2025-07-17 14:13:30 +08:00

offline_external_launcher.py

ut: add example and e2e test for sleepmode in external_launcher (#2152)

2025-08-06 11:11:53 +08:00

offline_inference_audio_language.py

Fix some ci issue and refactor modelrunner (#2445)

2025-08-20 09:01:04 +08:00

offline_inference_npu_tp2.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837)

2025-07-17 14:13:30 +08:00

offline_inference_npu.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837)

2025-07-17 14:13:30 +08:00

offline_inference_sleep_mode_npu.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837)

2025-07-17 14:13:30 +08:00

prompt_embedding_inference.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837)

2025-07-17 14:13:30 +08:00

run_dp_server.sh

[Feature] Support moe multi-stream for aclgraph. (#2946)

2025-09-19 11:06:45 +08:00