MidnightSun f4871c6ab9 [Kernel] add triton kernels for sampling (#4550) ...

### What this PR does / why we need it?
Replace pyorch implement of sampling with triton kernels

### Does this PR introduce _any_ user-facing change?
No


- vLLM version: v0.11.2

---------

Signed-off-by: Lord_of_Ironhill <suiweiyi@huawei.com>
Signed-off-by: whx-sjtu <2952154980@qq.com>
Co-authored-by: Lord_of_Ironhill <suiweiyi@huawei.com>
Co-authored-by: whx-sjtu <2952154980@qq.com>

2025-12-01 17:41:58 +08:00

..

_cann_ops_custom

[Kernel] add custom op GmmSwigluQuantWeightNzTensorList (#3804)

2025-11-28 18:06:39 +08:00

attention

[OPS] add bmm_transpose ops (#3990)

2025-12-01 09:09:51 +08:00

compilation

upgrade to vllm 0.11.2 (#4400)

2025-11-26 11:48:58 +08:00

core

Revert "drop ascend scheduler" (#4580)

2025-11-29 22:20:48 +08:00

device_allocator

[Misc]Clean up useless import from vllm (#2049)

2025-07-28 16:01:59 +08:00

distributed

[Bugfix] Fix bug with establishing the flashcomm2 and pp communication domains. (#4458)

2025-12-01 15:56:22 +08:00

eplb

[EPLB][Ops] Integerate grouped_matmul_swiglu_quant_weight_nz_tensor_list operator into dynamic EPLB (#4216)

2025-11-30 22:52:05 +08:00

kv_offload

Drop 0.11.0 support (#4377)

2025-11-24 17:08:20 +08:00

lora

[refact] unified soc_version code (#4359)

2025-11-26 14:28:55 +08:00

model_loader

Drop 0.11.0 support (#4377)

2025-11-24 17:08:20 +08:00

models

remove qwen3-next model file (#4573)

2025-11-29 18:37:26 +08:00

ops

[EPLB][Ops] Integerate grouped_matmul_swiglu_quant_weight_nz_tensor_list operator into dynamic EPLB (#4216)

2025-11-30 22:52:05 +08:00

patch

[BugFix] Fix Qwen2.5_Omni vision customized op attr err (#4568)

2025-12-01 09:18:55 +08:00

quantization

[EPLB][Ops] Integerate grouped_matmul_swiglu_quant_weight_nz_tensor_list operator into dynamic EPLB (#4216)

2025-11-30 22:52:05 +08:00

sample

[Kernel] add triton kernels for sampling (#4550)

2025-12-01 17:41:58 +08:00

spec_decode

[Bugfix] Resolve MTP > 1 issue when lm head tp > 1 (#4254)

2025-12-01 10:22:36 +08:00

torchair

[Bugfix] Resolve MTP > 1 issue when lm head tp > 1 (#4254)

2025-12-01 10:22:36 +08:00

worker

[Bugfix] Resolve MTP > 1 issue when lm head tp > 1 (#4254)

2025-12-01 10:22:36 +08:00

__init__.py

[Misc][Doc] Add service profiling feature with user guide (#3756)

2025-11-12 09:07:14 +08:00

ascend_config.py

Revert "drop ascend scheduler" (#4580)

2025-11-29 22:20:48 +08:00

ascend_forward_context.py

[Refactor] remove moe type of multicast. (#4224)

2025-11-24 17:32:37 +08:00

cpu_binding.py

[main] support cpu binding (#3546)

2025-10-21 09:17:03 +08:00

envs.py

[refact] unified soc_version code (#4359)

2025-11-26 14:28:55 +08:00

meta_registration.py

Fix the bugs about operator registration by PyTorch Dispatcher (#2786)

2025-09-13 11:58:52 +08:00

platform.py

Revert "drop ascend scheduler" (#4580)

2025-11-29 22:20:48 +08:00

profiling_config.py

Revert "drop ascend scheduler" (#4580)

2025-11-29 22:20:48 +08:00

utils.py

Move mla to ops module (#4575)

2025-11-29 18:36:55 +08:00