rjg-lyh 0005479b9c [main] mlp weight prefetch in Qwen Dense Models (#2816) ...

### What this PR does / why we need it?
This PR prefetchs the weight of mlp layers in Qwen Dense Models to
optimize the performance in Decode phase mainly.

### Does this PR introduce _any_ user-facing change?
 No.

### How was this patch tested?
CI passed with new added/existing test.

- vLLM version: main
- vLLM main:
a1213fae5f

Signed-off-by: rjg-lyh <1318825571@qq.com>
Co-authored-by: Shuming19 <313093131@qq.com>

2025-09-11 21:20:09 +08:00

..

310p

Refactor e2e CI (#2276)

2025-09-02 09:02:22 +08:00

doctests

Remove transformer pins for v0.9.1-dev (#2234)

2025-08-07 14:41:10 +08:00

models

Accuracy report formatting (#2279)

2025-08-25 09:39:30 +08:00

multicard

[main] mlp weight prefetch in Qwen Dense Models (#2816)

2025-09-11 21:20:09 +08:00

pd_disaggreate

Disaggregate prefill for kv cache register style (#950)

2025-07-26 17:15:47 +08:00

prompts

[CI/UT] Add test for chunk prefill and prefix cache on v1/AscendScheduler (#1505)

2025-07-02 16:57:03 +08:00

singlecard

[Feat]support dynamic quantization in allgather (#2841)

2025-09-11 18:47:20 +08:00

__init__.py

[Test] Clean up duplicate test for ascend scheduler (#1819)

2025-07-16 17:57:48 +08:00

common.sh

[Doctest] add installation doctest (#1179)

2025-06-17 08:52:26 +08:00

conftest.py

[CI] recover e2e test (#2688)

2025-09-02 18:49:17 +08:00

model_utils.py

Refactor e2e CI (#2276)

2025-09-02 09:02:22 +08:00

run_disagg_pd.sh

[CI] Fix PD job (#1129)

2025-06-09 16:34:41 +08:00

run_doctests.sh

[Doctest] add installation doctest (#1179)

2025-06-17 08:52:26 +08:00

utils.py

[Test] Remove VLLM_USE_V1 in example and tests (#1733)

2025-07-15 12:49:57 +08:00