weijinqian0 6aa4253798 [Refactor] [SP]The sequence parallelism characteristics in the MoE and Dense models are integrated into a single solution. (#3085) ...

What this PR does / why we need it?

there are two sets of sp implementations for moe and dense models. One
is called sequence_parallelism, and the other is flashcomm_v1.
We did the following things：

Merge two sets of code with the same implementation into one.
Remove the implementation of sequence_parallelism, as this solution
cannot support aclgraph.
Does this PR introduce any user-facing change?

No

How was this patch tested?

e2e&ut

- vLLM version: v0.10.2
- vLLM main:
f225ea7dd9

---------

Signed-off-by: weijinqian_v1 <weijinqian@huawei.com>
Co-authored-by: weijinqian_v1 <weijinqian@huawei.com>

2025-09-24 11:29:59 +08:00

..

moe

[Refactor] [SP]The sequence parallelism characteristics in the MoE and Dense models are integrated into a single solution. (#3085)

2025-09-24 11:29:59 +08:00

__init__.py

Fix the bugs about operator registration by PyTorch Dispatcher (#2786)

2025-09-13 11:58:52 +08:00

activation.py

[main] mlp weight prefetch in Qwen Dense Models (#2816)

2025-09-11 21:20:09 +08:00

attention.py

Disaggregate prefill for kv cache register style (#950)

2025-07-26 17:15:47 +08:00

casual_conv1d.py

[2/N][Refactor][Qwen3-Next] remove redundant methods and patch methods in Qwen3NextGatedDeltaNet (#3082)

2025-09-24 11:25:42 +08:00

common_fused_moe.py

[Refactor] [SP]The sequence parallelism characteristics in the MoE and Dense models are integrated into a single solution. (#3085)

2025-09-24 11:29:59 +08:00

expert_load_balancer.py

Add static EPLB (#1116)

2025-06-09 19:28:11 +08:00

fla.py

[2/N][Refactor][Qwen3-Next] remove redundant methods and patch methods in Qwen3NextGatedDeltaNet (#3082)

2025-09-24 11:25:42 +08:00

fused_moe.py

[Refactor] [SP]The sequence parallelism characteristics in the MoE and Dense models are integrated into a single solution. (#3085)

2025-09-24 11:29:59 +08:00

layernorm.py

[main] addrmsnorm + quant fusion optim in Dense Models (#2772)

2025-09-16 22:31:38 +08:00

linear_op.py

[Refactor] [SP]The sequence parallelism characteristics in the MoE and Dense models are integrated into a single solution. (#3085)

2025-09-24 11:29:59 +08:00

linear.py

refactor linear (#2867)

2025-09-18 14:09:19 +08:00

register_custom_ops.py

[Refactor] [SP]The sequence parallelism characteristics in the MoE and Dense models are integrated into a single solution. (#3085)

2025-09-24 11:29:59 +08:00

rotary_embedding.py

Fix the bugs about operator registration by PyTorch Dispatcher (#2786)

2025-09-13 11:58:52 +08:00

sigmoid_gating.py

[2/N][Refactor][Qwen3-Next] remove redundant methods and patch methods in Qwen3NextGatedDeltaNet (#3082)

2025-09-24 11:25:42 +08:00

vocab_parallel_embedding.py

[CI] Update vllm version to 20250922(5aeb925) (#3091)

2025-09-22 22:18:13 +08:00