Canlin Guo and Mengqing Cao
a78a00e0b1
[Doc][ReleaseNote] Add release notes for v0.16.0rc1 ( #7067 )
...
Add release notes for v0.16.0rc1
- vLLM version: v0.16.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/4034c3d32e30d01639459edd3ab486f56993876d
---------
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: Canlin Guo <961750412@qq.com >
Co-authored-by: Mengqing Cao <cmq0113@163.com >
2026-03-10 22:45:05 +08:00
wangxiyuan
482d39c1b0
[commuinty]update contributor and refresh tool ( #7072 )
...
### What this PR does / why we need it?
This PR refactors the `tools/collect_user_first_contribution.sh` script
to improve how we track and update our contributors list.
Key changes include:
- **Incremental Updates**: The script can now perform incremental
updates by storing and reading the last processed commit hash from
`docs/source/community/contributors.md`. This is much more efficient
than re-processing all commits every time.
- **Full Refresh Option**: A `--full` flag is added to allow forcing a
full recalculation of all contributors, useful for correcting errors or
initial setup.
- **Improved Usage**: Replaced positional arguments with command-line
flags (`--repo`, `--file`, `--full`) for better usability and clarity.
- **Robust Contributor-ID detection**: Improved logic to find a
contributor's GitHub login, including a fallback to parse it from
`noreply` email addresses.
- **In-place File Updates**: The script now directly updates the
`contributors.md` file with new contributors and correct numbering,
automating the entire process.
These changes make the process of maintaining the contributors list more
automated, reliable, and efficient.
### Does this PR introduce _any_ user-facing change?
No, this only changes a developer tool and does not affect the vLLM
library's public API or behavior.
### How was this patch tested?
The script can be tested locally by running it against the repository.
For an incremental update:
`GITHUB_TOKEN=<your_token> ./tools/collect_user_first_contribution.sh`
For a full refresh:
`GITHUB_TOKEN=<your_token> ./tools/collect_user_first_contribution.sh
--full`
- vLLM version: v0.16.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/4034c3d32e30d01639459edd3ab486f56993876d
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2026-03-09 15:19:35 +08:00
bd571cf6d6
[Main2Main] Upgrade vLLM to 0303 ( #6944 )
...
### What this PR does / why we need it?
break:
- https://github.com/vllm-project/vllm/pull/34102
Disable_full param replaced with valid_modes/invalid_modes API
- https://github.com/vllm-project/vllm/pull/35503
Now must return float compilation_time
- https://github.com/vllm-project/vllm/pull/35564
New sequence_lengths param added
- https://github.com/vllm-project/vllm/pull/33807
A check was performed (if runner_backend != "auto")
- https://github.com/vllm-project/vllm/pull/34861
`BaseDeviceCommunicator` now accesses PyTorch's internal `pg_map` to
check process group state
- https://github.com/vllm-project/vllm/pull/35274
**Important change:**
- https://github.com/vllm-project/vllm/pull/28672
`matcher_utils` directly accesses `torch.ops._C.*` during the import
phase. In the Ascend environment, some unregistered ops trigger
`AttributeError`, causing e2e initialization failure.
https://github.com/vllm-project/vllm-ascend/actions/runs/22607260487/job/65502047131#step:10:2323
https://github.com/vllm-project/vllm/blob/main/vllm/compilation/passes/fusion/matcher_utils.py#L29
This PR adds temporary compatibility placeholders (rms_norm,
fused_add_rms_norm, rotate_embedding, static/dynamic fp8 quant,
silu_and_mul) to
`vllm_ascend/patch/platform/patch_fusion_matcher_compat_ops.py` to
ensure no crashes during the import phase. Upstream repairs will be
considered later.
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
- vLLM version: v0.16.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/15d76f74e2fdb12a95ea00f0ca283acf6219a2b7
---------
Signed-off-by: MrZ20 <2609716663@qq.com >
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: Meihan-chen <jcccx.cmh@gmail.com >
Co-authored-by: Claude Code <noreply@anthropic.com >
Co-authored-by: gcanlin <canlinguosdu@gmail.com >
2026-03-06 09:08:52 +08:00
wangxiyuan
3d563292f3
clean 0.15.0 support ( #6852 )
...
Clean up vllm 0.15.0 related code
- vLLM version: v0.16.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/15d76f74e2fdb12a95ea00f0ca283acf6219a2b7
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2026-02-28 09:20:57 +08:00
Canlin Guo and MrZ20
e4458b2d2b
[Main2Main] Upgrade vLLM to 0226 ( #6813 )
...
### What this PR does / why we need it?
Breaking:
1. https://github.com/vllm-project/vllm/pull/33452
2. https://github.com/vllm-project/vllm/pull/33451
3. https://github.com/vllm-project/vllm/pull/32567
4. https://github.com/vllm-project/vllm/pull/32344
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
- vLLM version: v0.15.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/83b47f67b1dfad505606070ae4d9f83e50ad4ebd
---------
Signed-off-by: MrZ20 <2609716663@qq.com >
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: MrZ20 <2609716663@qq.com >
2026-02-27 16:05:21 +08:00
wangxiyuan
3d43ed997e
add release note for 0.15.0rc1 ( #6839 )
...
Add release note for 0.15.0rc1
- vLLM version: v0.15.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/83b47f67b1dfad505606070ae4d9f83e50ad4ebd
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2026-02-27 11:55:55 +08:00
wangxiyuan
a95c0b8b82
[Doc] fix the nit in docs ( #6826 )
...
Refresh the doc, fix the nit in the docs
- vLLM version: v0.15.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/83b47f67b1dfad505606070ae4d9f83e50ad4ebd
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2026-02-27 11:50:27 +08:00
Icey
ee59429015
upgrade main to 0212 ( #6712 )
...
### What this PR does / why we need it?
Fixes `transformers_utils/processors/__init__` import error, due to
https://github.com/vllm-project/vllm/pull/33247
Fixes Fused MoE break introduced by `MoERunner abstraction,` due to
https://github.com/vllm-project/vllm/pull/32344
> delete AscendMoERunnere when
https://github.com/vllm-project/vllm/pull/35178 is merged
Fixes `Make Qwen3VL compatible with Transformers v5`, due to
https://github.com/vllm-project/vllm/pull/34262
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
- vLLM version: v0.15.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/9562912cead1f11e8540fb91306c5cbda66f0007
---------
Signed-off-by: wxsIcey <1790571317@qq.com >
2026-02-25 09:17:29 +08:00
Cao Yi
6de207de88
[main][Docs] Fix typos across documentation ( #6728 )
...
## Summary
Fix typos and improve grammar consistency across 50 documentation files.
### Changes include:
- Spelling corrections (e.g., "Facotory" → "Factory", "certainty" →
"determinism")
- Grammar improvements (e.g., "multi-thread" → "multi-threaded",
"re-routed" → "re-run")
- Punctuation fixes (semicolon consistency in filter parameters)
- Code style fixes (correct flag name `--num-prompts` instead of
`--num-prompt`)
- Capitalization consistency (e.g., "python" → "Python", "ascend" →
"Ascend")
- vLLM version: v0.15.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/9562912cead1f11e8540fb91306c5cbda66f0007
---------
Signed-off-by: SlightwindSec <slightwindsec@gmail.com >
2026-02-13 15:50:05 +08:00
Icey
88773bb101
[main to main] upgrade main 0210 ( #6673 )
...
### What this PR does / why we need it?
upgrade vllm commit to `9562912cead1f11e8540fb91306c5cbda66f0007`
### Does this PR introduce _any_ user-facing change?
N/A
### How was this patch tested?
all tests passed
- vLLM version: v0.15.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/13397841ab469cecf1ed425c3f52a9ffc38139b5
---------
Signed-off-by: wxsIcey <1790571317@qq.com >
2026-02-11 18:10:14 +08:00
wangxiyuan and wxsIcey
2a826b5fad
[Misc] upgrade to vllm main ( #6646 )
...
### What this PR does / why we need it?
This PR upgrades the core vLLM dependency to a newer version from the
main branch (`13397841ab469cecf1ed425c3f52a9ffc38139b5`). This is
necessary to keep our project up-to-date with the latest features and
fixes from upstream vLLM.
1.
https://github.com/vllm-project/vllm/commit/ac32e66cf95c40502ad7b00b2e80dfb0315bfee4
pass file is moved.
- vLLM version: v0.15.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/d7e17aaacd5ed1b4b4be6bcfef3a1b7cbc84fc9a
---------
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
Signed-off-by: wxsIcey <1790571317@qq.com >
Signed-off-by: Meihan-chen <jcccx.cmh@gmail.com >
Co-authored-by: wxsIcey <1790571317@qq.com >
2026-02-10 14:08:59 +08:00
Cao Yi
1c7d1163f5
[main][Docs] Fix spelling errors across documentation ( #6649 )
...
Fix various spelling mistakes in the project documentation to improve
clarity and correctness.
- vLLM version: v0.15.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/d7e17aaacd5ed1b4b4be6bcfef3a1b7cbc84fc9a
---------
Signed-off-by: SlightwindSec <slightwindsec@gmail.com >
2026-02-10 11:14:57 +08:00
wangxiyuan
c38166eefa
[Doc] backport 0.13.0 release note ( #6584 )
...
### What this PR does / why we need it?
Backport 0.13.0 release note to main branch and update related doc link
### Does this PR introduce _any_ user-facing change?
yes
### How was this patch tested?
by doc CI
- vLLM version: v0.15.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/d7e17aaacd5ed1b4b4be6bcfef3a1b7cbc84fc9a
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2026-02-06 10:29:15 +08:00
922e5c163b
[main2main] upgrade vllm main 0202 ( #6560 )
...
### What this PR does / why we need it?
1. Fix `TypeError: FusedMoEParallelConfig.__init__() missing 1 required
positional argument: 'is_sequence_parallel'` due to
https://github.com/vllm-project/vllm/pull/32567
2. Fix ` TypeError: '>' not supported between instances of 'MagicMock'
and 'int'` due to https://github.com/vllm-project/vllm/pull/33035
3. Fix `TypeError: Can't instantiate abstract class AscendMLAImpl with
abstract methods forward_mha, forward_mqa` and AttributeError: 'bool'
object has no attribute 'process_weights_after_loading' due to
https://github.com/vllm-project/vllm/pull/33284
4. Fix `'AscendSharedFusedMoE' object has no attribute
'_routed_input_transform'`due to
https://github.com/vllm-project/vllm/pull/32790
5. Fix `NPUModelRunner._dummy_run() got an unexpected keyword argument
'num_active_loras'` due to
https://github.com/vllm-project/vllm/pull/32005
6. Fix the problem caused by` 'tuple' object has no attribute 'job_id'`
due to https://github.com/vllm-project/vllm/pull/27492
7. Fix the problem that all_moe_layers is not equal to vllm.moe_forward,
vllm.moe_forward_shared due to
https://github.com/vllm-project/vllm/pull/33184
8. Add patch to fix the problem "got multiple values for keyword
argument 'add_special_tokens'" due to
https://github.com/vllm-project/vllm/pull/32863
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
- vLLM version: v0.15.0
- vLLM main: https://github.com/vllm-project/vllm/commit/v0.15.0
---------
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
Signed-off-by: Meihan-chen <jcccx.cmh@gmail.com >
Signed-off-by: hfadzxy <starmoon_zhang@163.com >
Co-authored-by: wangxiyuan <wangxiyuan1007@gmail.com >
Co-authored-by: hfadzxy <starmoon_zhang@163.com >
2026-02-05 19:31:17 +08:00
wangxiyuan and shen-shanshan
eeedf7c503
[Main2Main][Deps][Misc] Upgrade vLLM to v0.15.0 ( #6470 )
...
### What this PR does / why we need it?
This PR upgrades the vLLM dependency from `v0.14.1` to `v0.15.0`. This
involves:
- Updating the `VLLM_TAG` in all `Dockerfile`.
- Updating the vLLM version in `docs/source/conf.py`.
- Removing conditional code paths specific to `v0.14.1` across the
codebase, which simplifies maintenance.
- Fix `TypeError: MMEncoderAttention.__init__() got an unexpected
keyword argument 'multimodal_config'` due to
https://github.com/vllm-project/vllm/pull/31972 .
- Fix `_shared_experts: 'NoneType' object is not callable` due to
https://github.com/vllm-project/vllm/pull/32082 by
https://github.com/vllm-project/vllm-ascend/pull/6335 .
- Fix `ReshapeAndCacheOperation setup failed!` due to
https://github.com/vllm-project/vllm/pull/25954 by overriding attention
metadata slots.
This upgrade is necessary to keep the project aligned with the latest
features, bug fixes, and API changes in the vLLM project.
### Does this PR introduce _any_ user-facing change?
No, this is an internal dependency update and does not introduce any
user-facing changes.
### How was this patch tested?
CI is expected to pass with these changes, ensuring that all existing
tests are successful with the new vLLM version.
- vLLM version: v0.14.1
- vLLM main:
https://github.com/vllm-project/vllm/commit/dc917cceb877dfd13f98c538c4c96158047d98bd
co-authored-by: shen-shanshan <467638484@qq.com >
---------
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2026-02-02 15:57:55 +08:00
meihanc and wjunLu
fea197ad50
[Main2Main] Upgrade vllm commit to 0123 ( #6169 )
...
### What this PR does / why we need it?
1. ✅ Upgrade vllm commit to: 0115
(8471b27df97c3eb79f891802fc0e858f8f7ac6a0)
Modify import paths due to the refactors:
https://github.com/vllm-project/vllm/pull/32245
https://github.com/vllm-project/vllm/pull/32060
Test result:
https://github.com/vllm-project/vllm-ascend/actions/runs/21034239336/job/60490156965?pr=5913
2. ✅ Upgrade vllm commit to: 0119
(9a1f16da1e423ede2c2f52a9850cbfbb39cefe96)
Fix `WorkerProc.__init__() missing 1 required positional argument:
'is_driver_worker'` due to
https://github.com/vllm-project/vllm/pull/28506
Test result:
https://github.com/vllm-project/vllm-ascend/actions/runs/21156263050/job/60841668755?5569
3. ✅ Upgrade vllm commit to:
0120(148117ea2e689cd43df4be6892671a17cdae5833)
1. Add `skip_compiled` param in `set_forward_context` due to
https://github.com/vllm-project/vllm/pull/30385
2. Modify `tests/ut/spec_decode/test_eagle_proposer.py` due to
https://github.com/vllm-project/vllm/pull/24322
change `self.max_num_tokens =
vllm_config.scheduler_config.max_num_batched_tokens + max_batch_size`
3. Modify UT import paths due to the
refactors:https://github.com/vllm-project/vllm/pull/32060
Test result:
https://github.com/vllm-project/vllm-ascend/actions/runs/21204851770/job/60999046946
4. ✅ Upgrade vllm commit to:
0121(f23fb5a7c1b61350c5c40ca1115d3bf8cf2b8cc9)
1. vLLM switched `uses_mrope` from target to draft model config, making
`positions`/`mrope_positions` mutually exclusive, breaking vllm-ascend's
direct self.positions access and tests missing
`draft_model_config.uses_mrope`.
https://github.com/vllm-project/vllm/pull/32048
2. Moved bs_to_padded_graph_size from CompilationConfig to
CudagraphDispatcher due to the refactor
https://github.com/vllm-project/vllm/pull/30143
3. Remove unused `maybe_setup_kv_connector` due to
https://github.com/vllm-project/vllm/pull/32077
Test result:
https://github.com/vllm-project/vllm-ascend/actions/runs/21217728738/job/61043738834
6. ✅ Upgrade vllm commit to:
0122(8ebf271bb6d1e7e9b1a55be73d755ef1a57dbbe5)
Updating FusedMoEParallelConfig (added enable_eplb) and FusedMoEConfig
due to https://github.com/vllm-project/vllm/pull/32414
Test result:
https://github.com/vllm-project/vllm-ascend/actions/runs/21249922546/job/61148613054
8. ✅ Upgrade vllm commit to:
0123(dc917cceb877dfd13f98c538c4c96158047d98bd)
Setting temperature=0.0 due to the removal of the default temperature
value in https://github.com/vllm-project/vllm/pull/32723
Test result:
https://github.com/vllm-project/vllm-ascend/actions/runs/21280796875
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
- vLLM version: v0.14.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/d68209402ddab3f54a09bc1f4de9a9495a283b60
---------
Signed-off-by: wjunLu <wjunlu217@gmail.com >
Signed-off-by: Meihan-chen <jcccx.cmh@gmail.com >
Co-authored-by: wjunLu <wjunlu217@gmail.com >
2026-01-27 08:44:36 +08:00
wangxiyuan
d9979f4d13
[Doc] quick fix for vllm-ascend version ( #6278 )
...
Correct vllm-ascend version name in doc
- vLLM version: v0.14.1
- vLLM main:
https://github.com/vllm-project/vllm/commit/d68209402ddab3f54a09bc1f4de9a9495a283b60
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2026-01-26 19:33:18 +08:00
wangxiyuan
cb553f8eee
[Community] Nominate whx-sjtu as maintainer ( #6268 )
...
Since the first release v0.13.0rc2 and v0.14.0rc1 in 2026 are released.
We consider to refresh the maintainer team. I nominate whx-sjtu as the
new maintainer.
- vLLM version: v0.14.1
- vLLM main:
https://github.com/vllm-project/vllm/commit/d68209402ddab3f54a09bc1f4de9a9495a283b60
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2026-01-26 19:22:26 +08:00
wangxiyuan
52d4acfa51
[Doc] add release note for v0.14.0rc1 ( #6225 )
...
Add release note for v0.14.0rc1
- vLLM version: v0.14.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/d68209402ddab3f54a09bc1f4de9a9495a283b60
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2026-01-26 14:22:40 +08:00
wangxiyuan
99bdd7363c
[CI] update vLLM to 0.14.1 ( #6222 )
...
Upgrade vLLM to 0.14.1
- vLLM version: v0.14.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/d68209402ddab3f54a09bc1f4de9a9495a283b60
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2026-01-25 17:52:16 +08:00
wangxiyuan
21833a4321
[Doc] Add release note for 0.13.0rc2 ( #6207 )
...
Add release note for 0.13.0rc2
- vLLM version: v0.14.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/d68209402ddab3f54a09bc1f4de9a9495a283b60
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2026-01-24 12:51:47 +08:00
zhangxinyuehfad
819a4459ce
Drop vLLM 0.13.0 support ( #6069 )
...
### What this PR does / why we need it?
Drop vLLM 0.13.0 support, upgrade to 0.14.0
- vLLM version: v0.13.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/d68209402ddab3f54a09bc1f4de9a9495a283b60
---------
Signed-off-by: hfadzxy <starmoon_zhang@163.com >
2026-01-23 09:45:08 +08:00
wjunLu
a7d781f135
[Main] Upgrade PTA to 2.9.0 ( #6112 )
...
### What this PR does / why we need it?
Upgrade PTA to 2.9.0
- vLLM version: v0.13.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/d68209402ddab3f54a09bc1f4de9a9495a283b60
---------
Signed-off-by: wjunLu <wjunlu217@gmail.com >
2026-01-22 17:59:06 +08:00
meihanc
ea57e3e7a4
[Main2Main] Upgrade vllm commit to releases/v0.14.0 ( #5988 )
...
### What this PR does / why we need it?
Upgrade vllm commit to releases/v0.14.0
- vLLM version: v0.13.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/2c24bc6996cb165fce92f780b388a5e39b3f4060
Signed-off-by: Meihan-chen <jcccx.cmh@gmail.com >
2026-01-20 15:10:40 +08:00
wjunLu
73a3f822c7
[Main2Main] Upgrade vllm commit to releases/v0.14.0 ( #5911 )
...
### What this PR does / why we need it?
Upgrade vllm commit to releases/v0.14.0
- Re-open cases in `tests/e2e/singlecard/pooling/test_scoring.py`, since
the errors before have been fixed by
https://github.com/vllm-project/vllm/pull/32243
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
- vLLM version: v0.13.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/11b6af5280d6d6dfb8953af16e67b25f819b3be9
Signed-off-by: wjunLu <wjunlu217@gmail.com >
2026-01-15 23:22:43 +08:00
wjunLu and hfadzxy
c11a05c4e1
[Main2Main] Upgrade vllm commit to 0113 ( #5839 )
...
### What this PR does / why we need it?
Upgrade vllm commit to 0113 (11b6af5280d6d6dfb8953af16e67b25f819b3be9)
- Modify import paths due to the refactors
https://github.com/vllm-project/vllm/pull/31916
https://github.com/vllm-project/vllm/pull/32054
- Fix `TypeError: NPUOffloadingSpec.__init__() takes 2 positional
arguments but 3 were given` due to
https://github.com/vllm-project/vllm/pull/24498
- Skip the async-scheduling tests in
`tests/e2e/multicard/4-cards/long_sequence/test_mtp.py`, which are never
verified
https://github.com/vllm-project/vllm/pull/31998
- Skip some pooling tests, which are caused by
https://github.com/vllm-project/vllm/pull/32148
where vllm is also failed
https://buildkite.com/vllm/ci/builds/46705/steps/canvas?jid=019bb329-3834-4685-862b-1613b8e0f5d4
We will reopen those tests when main2main reachs
https://github.com/vllm-project/vllm/pull/32243
- Skip some cases in
`tests/e2e/multicard/4-cards/long_sequence/test_mtp.py`, which are
broken by
https://github.com/vllm-project/vllm/pull/32118
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
- vLLM version: v0.13.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/2f4e6548efec402b913ffddc8726230d9311948d
Signed-off-by: wjunLu <wjunlu217@gmail.com >
Signed-off-by: hfadzxy <starmoon_zhang@163.com >
Co-authored-by: hfadzxy <starmoon_zhang@163.com >
2026-01-15 09:48:53 +08:00
SILONG ZENG and root
4811ba62e0
[Lint]Style: reformat markdown files via markdownlint ( #5884 )
...
### What this PR does / why we need it?
reformat markdown files via markdownlint
- vLLM version: v0.13.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/bde38c11df0ea066a740efe9b77fff5418be45df
---------
Signed-off-by: root <root@LAPTOP-VQKDDVMG.localdomain >
Signed-off-by: MrZ20 <2609716663@qq.com >
Co-authored-by: root <root@LAPTOP-VQKDDVMG.localdomain >
2026-01-15 09:06:01 +08:00
zhangxinyuehfad
f7b904641e
[Main2Main] Upgrade vllm commit to 0109 ( #5752 )
...
### What this PR does / why we need it?
Upgrade vllm commit to 0109 (bde38c11df0ea066a740efe9b77fff5418be45df)
1. remove `init_cached_hf_modules ` due to
https://github.com/vllm-project/vllm/pull/31786
2. fix spec_decode e2e test due to
https://github.com/vllm-project/vllm/pull/29821 break
3. fix `vllm.v1.attention.backends.utils` duo to
https://github.com/vllm-project/vllm/pull/31891
4. fix `self.seq_lens - query_lens` on same device due to
https://github.com/vllm-project/vllm/pull/31773
5. skip model_runner_v2 e2e test due to `'_OpNamespace' '_C' object has
no attribute 'get_cuda_view_from_cpu_tensor'`
- vLLM version: v0.13.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/2f4e6548efec402b913ffddc8726230d9311948d
Signed-off-by: hfadzxy <starmoon_zhang@163.com >
2026-01-13 19:14:43 +08:00
Yikun Jiang
fe251a2efe
[Doc] Update community contributors and versioning naming to follow vLLM ( #5820 )
...
### What this PR does / why we need it?
This pull request updates documentation to align with vLLM's community
standards.
- Change `Maintainers` to `Committers` to follow vLLM naming:
https://docs.vllm.ai/en/latest/governance/committers/
- Change release branch policy from `vX.Y.Z-dev` to `releases/vX.Y.Z`
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
doc ci passed
- vLLM version: v0.13.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/2f4e6548efec402b913ffddc8726230d9311948d
Signed-off-by: Yikun Jiang <yikunkero@gmail.com >
2026-01-13 08:47:11 +08:00
wangxiyuan
5ccd53e28a
[CI] adpat v0.13.0 change ( #5793 )
...
Add `releases` match case for CI jobs and update related doc for v0.13.0
branch
- vLLM version: v0.13.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/2f4e6548efec402b913ffddc8726230d9311948d
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2026-01-12 14:06:56 +08:00
wjunLu
b8f245792e
[Main2Main] Upgrade vllm commit to 0106 ( #5617 )
...
### What this PR does / why we need it?
Upgrade vllm commit to 0106
- vLLM version: v0.13.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/8be6432bdaf6275664d857b1e5e9bf8ed1ce299e
Signed-off-by: wjunLu <wjunlu217@gmail.com >
2026-01-06 15:50:40 +08:00
wjunLu
3cf059a72b
[Main2Main] Upgrade vllm commit to 0105 ( #5595 )
...
### What this PR does / why we need it?
Upgrade vllm commit to 0105 (8be6432bdaf6275664d857b1e5e9bf8ed1ce299e)
1. Remove `maybe_padded_num_tokens` arg in `model_runner_v1.py` since
https://github.com/vllm-project/vllm/pull/31517 deleted unused arg
2. Remove dense `Qwen/Qwen3-0.6B` in
`tests/e2e/multicard/test_aclgraph_capture_replay.py` and
`tests/e2e/multicard/test_data_parallel.py` due to
https://github.com/vllm-project/vllm/pull/30739
where offline data parallel mode will not be supported/useful for dense
models
3. Adapt `vllm_ascend/worker/worker.py` due to
https://github.com/vllm-project/vllm/pull/31584
4. Adapt `self.block_size` calling due to
https://github.com/vllm-project/vllm/pull/31540
5. Modify `test_mla_v1.py` due to
https://github.com/vllm-project/vllm/pull/28454 , which refactorred
`get_head_size()`
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
- vLLM version: v0.13.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/7157596103666ee7ccb7008acee8bff8a8ff1731
Signed-off-by: wjunLu <wjunlu217@gmail.com >
2026-01-06 08:44:29 +08:00
wjunLu
3c2d3e52e5
[Main2Main] Upgrade vllm commit to 1230 ( #5495 )
...
### What this PR does / why we need it?
Upgrade vllm commit to 1230
Affected by https://github.com/vllm-project/vllm/pull/27614 (and the
core PR https://github.com/vllm-project/vllm/pull/26866 ), we have to
make the following changes:
1. Modify `tests/e2e/multicard/test_aclgraph_capture_replay.py` to keep
compatible with both vllm version of `v0.13.0` and latest main commitID,
while vllm enables async scheduling by default
2. Skip `test_guided_decoding.py` due to xgrammar errors
(https://github.com/vllm-project/vllm-ascend/issues/5524 )
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
- vLLM version: v0.13.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/45c1ca1ca1ee8fa06df263c8715e8a412ff408d4
---------
Signed-off-by: wjunLu <wjunlu217@gmail.com >
2025-12-31 09:44:35 +08:00
zhangyiming
98798d80a0
[Doc] Add new contributors. ( #5537 )
...
### What this PR does / why we need it?
Update new contributors.
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
- vLLM version: v0.13.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/45c1ca1ca1ee8fa06df263c8715e8a412ff408d4
Signed-off-by: menogrey <1299267905@qq.com >
2025-12-31 07:39:42 +08:00
Nengjun Ma
5e96f94d2a
Update corresponding vllm commit ID to 12 29 ( #5475 )
...
### What this PR does / why we need it?
- Fixes vllm break:
1. [[BugFix] register quant scale tensors as buffer #31395 ]
(https://github.com/vllm-project/vllm/pull/31395 )
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
- vLLM version: v0.13.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/5326c89803566a131c928f7fdd2100b75c981a42
---------
Signed-off-by: leo-pony <nengjunma@outlook.com >
2025-12-29 22:48:05 +08:00
ZT-AIA and leo-pony
24328aaf00
update vllm pin to 12.27 ( #5412 )
...
### What this PR does / why we need it?
update vllm pin to 12.27
1、Fix Qwen2-MoE shared_expert_gate
:https://github.com/vllm-project/vllm/pull/31339
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
vLLM version: release/v0.13.0
vLLM main:
https://github.com/vllm-project/vllm/commit/5326c89803566a131c928f7fdd2100b75c981a42
Co-authored-by: leo-pony [nengjunma@outlook.com ](nengjunma@outlook.com )
---------
Signed-off-by: ZT-AIA <1028681969@qq.com >
Signed-off-by: leo-pony <nengjunma@outlook.com >
Co-authored-by: leo-pony <nengjunma@outlook.com >
2025-12-28 00:19:36 +08:00
Mengqing Cao
1b5d5abf86
[ReleaseNote] Add release note for v0.13.0rc1 ( #5334 )
...
### What this PR does / why we need it?
Add release note for v0.13.0rc1
- vLLM version: release/v0.13.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/bc0a5a0c089844b17cb93f3294348f411e523586
---------
Signed-off-by: MengqingCao <cmq0113@163.com >
2025-12-27 18:46:57 +08:00
ZT-AIA and Mengqing Cao
1d8aa892bf
Update vllm pin to 12.26 ( #5378 )
...
### What this PR does / why we need it?
Update vllm pin to 12.26
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
- vLLM version: release/v0.13.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/81786c87748b0177111dfdc07af5351d8389baa1
---------
Signed-off-by: ZT-AIA <1028681969@qq.com >
Signed-off-by: Mengqing Cao <cmq0113@163.com >
Signed-off-by: ZT-AIA <63220130+ZT-AIA@users.noreply.github.com >
Co-authored-by: Mengqing Cao <cmq0113@163.com >
2025-12-26 23:44:48 +08:00
ZT-AIA
adaa89a7a5
Update vllm pin to 12.25 ( #5342 )
...
### What this PR does / why we need it?
- Fix vllm break in the pr:
1.[Drop v0.14 deprecations
]https://github.com/vllm-project/vllm/pull/31285
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
- vLLM version: release/v0.13.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/bc0a5a0c089844b17cb93f3294348f411e523586
---------
Signed-off-by: ZT-AIA <1028681969@qq.com >
2025-12-26 14:05:40 +08:00
Nengjun Ma and zxwang
42c989a437
Update vllm pin to 12.24 ( #5307 )
...
### What this PR does / why we need it?
Fix vllm break in the pr:
1. [Add MiMo-V2-Flash support]
(https://github.com/vllm-project/vllm/pull/30836 )
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
Co-authored-by: zxwang [1476209578@qq.com ](mailto:1476209578@qq.com )
- vLLM version: release/v0.13.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/5fbfa8d9ef15948599631baeb91e8220b2ee9bcc
---------
Signed-off-by: leo-pony <nengjunma@outlook.com >
Signed-off-by: zxwang <1476209578@qq.com >
Co-authored-by: zxwang <1476209578@qq.com >
2025-12-24 17:24:31 +08:00
Nengjun Ma and zxwang
3b59f20a28
update to vllm 12-19 ( #5223 )
...
### What this PR does / why we need it?
### Does this PR introduce _any_ user-facing change?
Fix vllm break:
1. [Enable cuda graph for deepepHT, 5.3% throughput improvement, 4.4%
TTFT improvement] (https://github.com/vllm-project/vllm/pull/29558 )
Fix Solution: Add the now-necessary `all2all_backend` parameter. The
impact of this parameter on the original `set_splitting_ops_for_v1`
implementation is only that graph mode is disabled in `vllm` if
`deepep_high_throughput` is enabled; it has no effect on the
`vllm-ascend` logic.
2.[Migrate legacy ViT MultiHeadAttention to new MMEncoderAttention
interface ] (https://github.com/vllm-project/vllm/pull/30684 )
Fix Solution: The reason why the GPU does not need to convert qkv to 3D
is that the GPU's flash_attention operator is compatible with 3D and 4D
(b s h d and s b ( h d)), but the NPU's flash_attention_unpad operator
only supports 3D (s b ( h d)). Therefore, we need to introduce the
reshape_qkv_to_3d operation.
4.Skip Tencent-Hunyuan/HunyuanOCR test case, as it has following issue
in upgrade vllm code:
https://github.com/vllm-project/vllm-ascend/issues/5297
### How was this patch tested?
Co-authored-by: zxwang <1476209578@qq.com >
- vLLM version: release/v0.13.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/ad32e3e19ccf0526cb6744a5fed09a138a5fb2f9
---------
Signed-off-by: leo-pony <nengjunma@outlook.com >
Signed-off-by: zxwang <1476209578@qq.com >
Co-authored-by: zxwang <1476209578@qq.com >
2025-12-23 23:52:11 +08:00
zhangyiming
35dbdbb398
[Doc] Add new contributors and relative scripts. ( #5070 )
...
### What this PR does / why we need it?
[Doc] Add new contributors and relative scripts.
Usage of scripts:
- `export GITHUB_TOKEN=<your github token>`
- `bash tools/collect_user_first_contribution.sh
vllm-project/vllm-ascend <base_sha> <head_sha>` and save the result to
one temporary file such as `contributors.txt`
- `python tools/format_contributors.py contributors.txt --start <start
index now>`
- Use the output to update the `contributors.md`
- vLLM version: v0.12.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/ad32e3e19ccf0526cb6744a5fed09a138a5fb2f9
---------
Signed-off-by: menogrey <1299267905@qq.com >
2025-12-23 10:01:45 +08:00
wangxiyuan
758d81dcb1
Drop 0.12.0 support ( #5146 )
...
We decided to release v0.13.0 soon. So no need to support 0.12.0 now.
Let's drop it.
- vLLM version: v0.12.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/ad32e3e19ccf0526cb6744a5fed09a138a5fb2f9
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2025-12-20 09:38:53 +08:00
wangxiyuan
0f571c347b
Nominate new maintainers @zzzzwwjj @realliujiaxu @LCAIZJ ( #5152 )
...
I'd like to nominate @zzzzwwjj @realliujiaxu @LCAIZJ to join vLLM Ascend
committer team.
@zzzzwwjj
---
- Review Quality:
He has completed 80+reviews since April. 2025, include
https://github.com/vllm-project/vllm-ascend/pull/3232#issuecomment-3506110786 ,
https://github.com/vllm-project/vllm-ascend/pull/4822#discussion_r2601661204 ,
https://github.com/vllm-project/vllm-ascend/pull/4768#issuecomment-3644795995
high quality review.
- Sustained Contributions
15+ Valuable bug fix and refactor is very good.
https://github.com/vllm-project/vllm-ascend/pulls?q=is%3Apr+author%3Azzzzwwjj+is%3Aclosed+review%3Aapproved
Continuous optimization of code architecture
https://github.com/vllm-project/vllm-ascend/pulls?q=author%3Azzzzwwjj+is%3Amerged
- Quality Contribution:
https://github.com/vllm-project/vllm-ascend/pull/1229
https://github.com/vllm-project/vllm-ascend/pull/1979
https://github.com/vllm-project/vllm-ascend/pull/4359
https://github.com/vllm-project/vllm-ascend/pull/4878
- Community Involvement:
He lead the https://github.com/vllm-project/vllm-ascend/issues/1147 , to
refactor AscendFusedMoE at the first time.
He shared topics about large-scale distributed inference and
reinforcement learning on vLLM-Ascend meetup on August 2nd.
@realliujiaxu
---
- Review Quality:
He has completed about [40+
reviews](https://github.com/vllm-project/vllm-ascend/pulls?q=is%3Apr+commenter%3Arealliujiaxu+-author%3Arealliujiaxu+ )
since September, include
https://github.com/vllm-project/vllm-ascend/pull/4868#discussion_r2605549015 ,
https://github.com/vllm-project/vllm-ascend/pull/2275#discussion_r2268455665 .
- Sustained Contributions
He has completed (17
commits)[https://github.com/vllm-project/vllm-ascend/pulls?q=is%3Apr+author%3Arealliujiaxu+is%3Amerged ],
continuously optimizing the performance of the MoE model.
- Quality Contribution:
Contributed the Flash Comm1 feature to the community, supporting both
eager and aclgraph execution modes, while compatible with multiple MoE
models including DeepSeek and GLM4.5.
- https://github.com/vllm-project/vllm-ascend/pull/3334
- https://github.com/vllm-project/vllm-ascend/pull/3420
- https://github.com/vllm-project/vllm-ascend/pull/3015
co-author:
- https://github.com/vllm-project/vllm-ascend/pull/3495
- https://github.com/vllm-project/vllm-ascend/pull/4868
- Community Involvement:
1. Completed two major refactors, enabling vllm-ascend to evolve more
rapidly and robustly: [Linear
module](https://github.com/vllm-project/vllm-ascend/pull/2867 ) and
[rejection
sampler](https://github.com/vllm-project/vllm-ascend/pull/4975 )
2. [fixed 8
bugs](https://github.com/vllm-project/vllm-ascend/pulls?q=is%3Apr+author%3Arealliujiaxu+is%3Amerged+bugfix+ )
in graph mode, spec decoding and async scheduling.
@LCAIZJ
---
- Review Quality: He's been the go-to reviewer for virtually all PD
disaggregation and KV Pool related PRs, having completed [30+
reviews](https://github.com/vllm-project/vllm-ascend/pulls?q=is%3Apr+commenter%3ALCAIZJ+is%3Aopen+-author%3ALCAIZJ+ )
since May 2025. Notable examples include
[discussion_r2553887360](https://github.com/vllm-project/vllm-ascend/pull/4345#discussion_r2553887360 ),
[issuecomment-3540994801](https://github.com/vllm-project/vllm-ascend/pull/4161#issuecomment-3540994801 ),
and
[discussion_r2492593988](https://github.com/vllm-project/vllm-ascend/pull/3981#discussion_r2492593988 ),
all demonstrating thorough and insightful feedback.
- Sustained and Quality Contributions: His contributions reflect a
strong grasp of both vLLM and vLLM Ascend codebases, particularly in
prefill-decode disaggregation and KV pool areas ([7 PRs
merged](https://github.com/vllm-project/vllm-ascend/pulls?q=is%3Apr+author%3ALCAIZJ+is%3Amerged+ )).
Prefill-Decode Disaggregation: Delivered KV transfer functionality using
Mooncake TransferEngine and enabled layerwise KV transfer
https://github.com/vllm-project/vllm-ascend/pull/1568
https://github.com/vllm-project/vllm-ascend/pull/2602
KV Pool: Developed the foundational KV Pool infrastructure and migrated
it to the latest ADXL stack
https://github.com/vllm-project/vllm-ascend/pull/2913
https://github.com/vllm-project/vllm-ascend/pull/3350
- Quality Contribution:
https://github.com/vllm-project/vllm-ascend/pull/1568
https://github.com/vllm-project/vllm-ascend/pull/2602
https://github.com/vllm-project/vllm-ascend/pull/2913
https://github.com/vllm-project/vllm-ascend/pull/3350
- Community Involvement:
He actively responds to [community
issues](https://github.com/vllm-project/vllm-ascend/issues?q=is%3Aissue%20commenter%3ALCAIZJ%20is%3Aopen%20-author%3ALCAIZJ ),
continuously monitors functionality and accuracy issues related to PD
disaggregation and KV Pool, and proactively delivers [bug
fixes](https://github.com/vllm-project/vllm-ascend/pulls?q=is%3Apr+author%3ALCAIZJ+is%3Amerged+bugfix ).
- vLLM version: v0.12.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/ad32e3e19ccf0526cb6744a5fed09a138a5fb2f9
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2025-12-18 18:49:07 +08:00
ZixuanWang and leo-pony
b1a853b0f6
Upgrade vllm commit hash to 1216 ( #5053 )
...
### What this PR does / why we need it?
Upstream vLLM PR #30212 https://github.com/vllm-project/vllm/pull/30212
refactored the attention backend selection interface, This PR adapts
vllm-ascend's get_attn_backend_cls to align with the new upstream
standard, ensuring compatibility and reducing maintenance overhead.
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
co-author:[leo-pony][nengjunma@outlook.com ](mailto:nengjunma@outlook.com )
- vLLM version: v0.12.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/ad32e3e19ccf0526cb6744a5fed09a138a5fb2f9
---------
Signed-off-by: zxwang <1476209578@qq.com >
Signed-off-by: leo-pony <nengjunma@outlook.com >
Co-authored-by: leo-pony <nengjunma@outlook.com >
2025-12-17 08:48:36 +08:00
wangxiyuan
d11b74a571
Add release note for v0.11.0 ( #4918 )
...
Add release note for v0.11.0. We'll release soon.
- vLLM version: v0.12.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/ad32e3e19ccf0526cb6744a5fed09a138a5fb2f9
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2025-12-16 17:31:45 +08:00
Li Wang
6063853ead
[Misc] Upgrade vllm commit hash to 1215 ( #5029 )
...
### What this PR does / why we need it?
Upgrade vllm commit hash to `4429d934de3c5cc327b0d7aec8e473aeba38db90`
- vLLM version: v0.12.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/ad32e3e19ccf0526cb6744a5fed09a138a5fb2f9
---------
Signed-off-by: wangli <wangli858794774@gmail.com >
2025-12-16 09:23:02 +08:00
Li Wang
8d2998d0e4
[Misc] Upgrade vllm hash to 12_14 ( #5000 )
...
### What this PR does / why we need it?
### Does this PR introduce _any_ user-facing change?
1. fix https://github.com/vllm-project/vllm/pull/27938
2. fix https://github.com/vllm-project/vllm/pull/27145
pooling models now supports chunked prefill and prefix caching,
3. fix https://github.com/vllm-project/vllm/pull/30181
define the CPU fields in the field config where they really belong.
4. fix https://github.com/vllm-project/vllm/pull/28168
define the CPU fields in the field config where they really belong.
5. fix https://github.com/vllm-project/vllm/pull/30201
some moudle rename
6. fix https://github.com/vllm-project/vllm/pull/29067
fusedmoe moudle refactor
7. fix https://github.com/vllm-project/vllm/pull/29066
fusedmoe moudle refactor
8. fix https://github.com/vllm-project/vllm/pull/29624
### How was this patch tested?
- vLLM version: v0.12.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/ad32e3e19ccf0526cb6744a5fed09a138a5fb2f9
---------
Signed-off-by: wangli <wangli858794774@gmail.com >
2025-12-15 19:54:23 +08:00
wangxiyuan
42ceaf08a1
add release note for 0.12.0 ( #4995 )
...
Add release note for v0.12.0rc1
Update deepseek3.2 tutorial doc
- vLLM version: v0.12.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/ad32e3e19ccf0526cb6744a5fed09a138a5fb2f9
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2025-12-13 22:09:59 +08:00
wangxiyuan and Yikun Jiang
00b4fb80de
[Doc] Update vLLM version in doc ( #4691 )
...
Correct vLLM version in doc
- vLLM version: v0.12.0
- vLLM main: https://github.com/vllm-project/vllm/commit/v0.12.0
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
Co-authored-by: Yikun Jiang <yikunkero@gmail.com >
2025-12-05 08:59:41 +08:00