whx 98cadc2146 [Perf] Avoid performing index selection of sin/cos cache every layer (#1890) ...

Optimize number of index selections of sin/cos cache.

- vLLM version: v0.10.0
- vLLM main:
656c24f1b5

Signed-off-by: whx-sjtu <2952154980@qq.com>

2025-07-29 18:06:45 +08:00

..

attention

[Perf] Avoid performing index selection of sin/cos cache every layer (#1890)

2025-07-29 18:06:45 +08:00

core

[Test] Add uts for files in /core (#1957)

2025-07-25 09:48:19 +08:00

distributed/device_communicators

[Misc]Remove PD v0 code (#2047)

2025-07-28 19:09:22 +08:00

fake_weight

[CI] Add unit test framework (#1201)

2025-06-16 18:32:28 +08:00

kv_connector

Disaggregate prefill for kv cache register style (#950)

2025-07-26 17:15:47 +08:00

models

[Test] add ut for qwen3_moe.py (#2055)

2025-07-28 17:37:13 +08:00

multistream

[Test] Add ut for files in /multistream (#1947)

2025-07-24 10:42:49 +08:00

ops

[main][refactor] Refactoring forward_context and model_runner_v1 (#1979)

2025-07-28 14:06:20 +08:00

patch/worker/patch_common

[Feature]: implement the fusion of allreduce and matmul in prefill phase when tp is enabled (#1926)

2025-07-28 15:13:37 +08:00

quantization

[FOLLOWUP] Use base test to avoid patch everwhere (#1634)

2025-07-22 09:03:40 +08:00

torchair

[2/4][Refactor] Refactor torchair utils (#1892)

2025-07-21 19:43:30 +08:00

worker

[FOLLOWUP] Use base test to avoid patch everwhere (#1634)

2025-07-22 09:03:40 +08:00

__init__.py

[2/4][Refactor] Refactor torchair utils (#1892)

2025-07-21 19:43:30 +08:00

base.py

[Feature]: implement the fusion of allreduce and matmul in prefill phase when tp is enabled (#1926)

2025-07-28 15:13:37 +08:00

conftest.py

[1/N][CustomOp] Register activation customop instead of overwrite forward_oot (#1841)

2025-07-18 23:07:14 +08:00

test_ascend_config.py

[Dist][EP] Remove ETP/EP maintained in vllm-ascend (#1681)

2025-07-21 09:08:04 +08:00

test_platform.py

[1/4][Refactor] Refactor torchair worker (#1885)

2025-07-21 11:50:46 +08:00

test_utils.py

[Bugfix] Fix num_hidden_layers when Qwen2-Audio 7B (#1803)

2025-07-26 20:13:00 +08:00