starkwj
389030a8f8
add env vars & misc
2026-02-11 06:27:58 +00:00
starkwj
739d074b0c
update other platforms' Dockerfile
2026-01-23 03:24:25 +00:00
Li Wang
76d0ba4342
[Image][Build] Cherry pick #4062 from main ( #4506 )
...
### What this PR does / why we need it?
This patch aims to integrate the mooncake
[v0.3.7.2.post2](https://github.com/kvcache-ai/Mooncake/releases/tag/v0.3.7.post2 )
to vllm-ascend images
Signed-off-by: wangli <wangli858794774@gmail.com >
2025-12-01 11:39:40 +08:00
SILONG ZENG
5ad0ccdc31
[v0.11.0]Upgrade cann to 8.3.rc2 ( #4332 )
...
### What this PR does / why we need it?
Upgrade CANN to 8.3.rc2
Signed-off-by: MrZ20 <2609716663@qq.com >
2025-11-21 22:48:57 +08:00
Ting FU
97ffb9120f
[CI] Defaultly compile vllm with multimodal audio feature in dockerfile ( #4324 ) ( #4341 )
...
### What this PR does / why we need it?
For better usability, add multimodal audio to vllm compiling in
dockerfile defaultly.
Image size will increase only 2.xM.
Signed-off-by: Ting FU <futing10@huawei.com >
2025-11-21 17:53:00 +08:00
wangxiyuan
7ee0b0b5d8
[cherry-pick]Upgrade CANN to 8.3.rc1 ( #3945 ) ( #3962 )
...
This PR upgrade CANN from 8.2rc1 to 8.3rc1 and remove the CANN version
check logic.
TODO: we notice that UT runs failed with CANN 8.3 image. So the base
image for UT is still 8.2. We'll fix it later.
- vLLM version: v0.11.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/83f478bb19489b41e9d208b47b4bb5a95ac171ac
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2025-11-06 09:05:08 +08:00
wangxiyuan
a43e2f61e1
[CI] Update vLLM to v0.11.0 ( #3315 )
...
### What this PR does / why we need it?
There are 3 step to upgrade vllm-ascend to newest vllm. We'll create 3
PR
- [x] Upgrade vllm to v0.11.0 to make CI happy first .
- [ ] Move deepseek v3.2 to vllm way
- [ ] Then we'll add a new PR to add vllm main support.
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
- vLLM version: v0.11.0
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2025-10-09 10:41:19 +08:00
Yikun Jiang
5503a3142f
Bump version to v0.11.0rc3 ( #3213 )
...
### What this PR does / why we need it?
Bump version to v0.11.0rc2 and prepare vLLM Ascend v0.11.0rc0
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
CI passed
- vLLM version: v0.10.2
- vLLM main:
https://github.com/vllm-project/vllm/commit/releases/v0.11.0
---------
Signed-off-by: Yikun Jiang <yikunkero@gmail.com >
2025-09-29 21:48:06 +08:00
Yikun Jiang
0747a6e68c
Bump vLLM version to v0.10.2 ( #2914 )
...
### What this PR does / why we need it?
Bump vLLM version to v0.10.2
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
CI passed
- vLLM version: v0.10.2rc3
- vLLM main:
https://github.com/vllm-project/vllm/commit/15b8fef453b373b84406207a947005a4d9d68acc
Signed-off-by: Yikun Jiang <yikunkero@gmail.com >
2025-09-14 06:57:59 +08:00
Yikun Jiang
f97a64ba7f
Bump vLLM version to v0.10.2rc3 ( #2911 )
...
### What this PR does / why we need it?
Bump vLLM version to v0.10.2rc3
https://github.com/vllm-project/vllm/compare/v0.10.2rc2...v0.10.2rc3
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
CI passed
- vLLM version: v0.10.2rc2
- vLLM main:
https://github.com/vllm-project/vllm/commit/15b8fef453b373b84406207a947005a4d9d68acc
Signed-off-by: Yikun Jiang <yikunkero@gmail.com >
2025-09-13 19:15:48 +08:00
Yikun Jiang
8ece6956e7
Revert "Upgrade CANN version to 8.3.rc1.alpha001 ( #2903 )" ( #2909 )
...
### What this PR does / why we need it?
This reverts commit 339fceb89c .
### Does this PR introduce _any_ user-facing change?
Yes, use 8.2rc1 image by default
### How was this patch tested?
CI passed
- vLLM version: v0.10.2rc2
- vLLM main:
https://github.com/vllm-project/vllm/commit/cfa3234a5b8a6ec4f65ceb080bdc232eaee9b080
Signed-off-by: Yikun Jiang <yikunkero@gmail.com >
2025-09-13 16:21:54 +08:00
Yikun Jiang
339fceb89c
Upgrade CANN version to 8.3.rc1.alpha001 ( #2903 )
...
### What this PR does / why we need it?
Upgrade CANN version to 8.3.rc1.alpha001
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
- vLLM version: v0.10.2rc2
- vLLM main:
https://github.com/vllm-project/vllm/commit/89e08d6d180c76019daa5aa1bbf7759dfaedde2e
Signed-off-by: Yikun Jiang <yikunkero@gmail.com >
2025-09-13 12:10:21 +08:00
Yikun Jiang
138e932630
Bump vLLM version to v0.10.2rc2 ( #2902 )
...
### What this PR does / why we need it?
Upgrade vLLM version to 0.10.2rc2
### Does this PR introduce _any_ user-facing change?
Yes, image will use 0.10.2rc2 vLLM
### How was this patch tested?
- vLLM version: main
- vLLM main:
https://github.com/vllm-project/vllm/commit/f17c075884009a3bfb7c66cb0897719b8e18f196
Signed-off-by: Yikun Jiang <yikunkero@gmail.com >
2025-09-13 11:39:48 +08:00
Mengqing Cao
edf1f600ad
[CI] Remove compatibility maintenance for vllm v0.10.1 and v0.10.1.1 ( #2840 )
...
### What this PR does / why we need it?
Remove compatibility maintenance for vllm v0.10.1 and v0.10.1.1
### Does this PR introduce _any_ user-facing change?
branch main of vllm-ascend will not be compatible with vllm v0.10.1 and
v0.10.1.1
### How was this patch tested?
CI passed with existing test.
- vLLM version: v0.10.1.1
- vLLM main:
https://github.com/vllm-project/vllm/commit/6fb27881634d89c2e70e9e5fbad1b918c0d916cf
---------
Signed-off-by: MengqingCao <cmq0113@163.com >
2025-09-10 08:43:10 +08:00
Icey
af62af3cc5
[Image] Upgrade openEuler to 24.03 ( #2631 )
...
### What this PR does / why we need it?
Upgrade openEuler to 24.03
### Does this PR introduce _any_ user-facing change?
N/A
### How was this patch tested?
CI passed with new added/existing test.
- vLLM version: v0.10.1.1
- vLLM main:
https://github.com/vllm-project/vllm/commit/4071c76cf3cff46e14630f1e66cbf006b6eb51d3
---------
Signed-off-by: Icey <1790571317@qq.com >
2025-09-02 20:09:09 +08:00
Mengqing Cao
b0403f8d8a
[CI] fix ci ( #2464 )
...
### What this PR does / why we need it?
1. use action/checkout@v5 instead of v4
2. remove dbo test case because there is issue with it and will be
refactored later
3. make vllm-ascend compatible with vllm v0.10.1.1 and add CI for it
4. fix sampler api changes introduced by
https://github.com/vllm-project/vllm/pull/22387
6. fix qwen3 moe config changes intruoduced by
https://github.com/vllm-project/vllm/pull/20562
7. fix kvcache block changes introduced by
https://github.com/vllm-project/vllm/pull/23262
### Does this PR introduce _any_ user-facing change?
N/A
### How was this patch tested?
CI passed with existing test.
- vLLM version: v0.10.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/0c6e40bbaa4707528286a1e7bf17c90c88a1d920
---------
Signed-off-by: MengqingCao <cmq0113@163.com >
2025-08-22 07:30:48 +08:00
Mengqing Cao
75e28d0356
[Build][Ray] Fix protobuf version in Dockerfile ( #2028 )
...
### What this PR does / why we need it?
Fix protobuf version in Dockerfile to resolve `AttributeError: 'str'
object has no attribute 'DESCRIPTOR' when packaging message to dict`
using protobuf. will remove version specification after
https://github.com/ray-project/ray/pull/54910 is merged
### Does this PR introduce _any_ user-facing change?
N/A
### How was this patch tested?
CI passed with existing test.
- vLLM version: v0.10.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/0e36abf9931baa070609376debb4fb3772f4a3fe
Signed-off-by: MengqingCao <cmq0113@163.com >
2025-07-30 22:49:20 +08:00
Yikun Jiang
5b579ddafe
Upgrade CANN to 8.2.RC1 (A3) ( #2043 )
...
### What this PR does / why we need it?
Upgrade CANN to 8.2.RC1
### Does this PR introduce _any_ user-facing change?
Yes, A3 image are using 8.2.rc1
### How was this patch tested?
CI passed
- vLLM version: v0.10.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/de509ae8eb4467bd789234d909e5c725b8fba326
Signed-off-by: Yikun Jiang <yikunkero@gmail.com >
2025-07-26 23:10:27 +08:00
Yikun Jiang
17a430f7b8
Upgrade vLLM to v0.10.0 ( #1927 )
...
### What this PR does / why we need it?
- Upgrade to v0.10.0
- Drop v0.9.2 version compatibility
- Add patch for
`vllm_ascend/patch/worker/patch_common/patch_sampler_gather_logprobs.py`
as workaround of
https://github.com/vllm-project/vllm/commit/f3a683b7c9df8b251092e48e53d58220bb920f2c
for v0.10.0 and also add e2e test `test_models_prompt_logprobs`
- Pin transformers<4.54.0 as workaround of
https://github.com/vllm-project/vllm-ascend/issues/2034
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
- Test locally:
`VLLM_USE_MODELSCOPE=true pytest -sv
tests/e2e/singlecard/test_offline_inference.py::test_models_prompt_logprobs`
- CI passed
- vLLM version: v0.9.2
- vLLM main:
https://github.com/vllm-project/vllm/commit/7728dd77bb802e1876012eb264df4d2fa2fc6f3c
---------
Signed-off-by: Yikun Jiang <yikunkero@gmail.com >
2025-07-26 15:43:29 +08:00
Icey
875a920d4a
[Platform] Add support for Altlas A3 series ( #1794 )
...
### What this PR does / why we need it?
Add support for Ascend A3 and remove latest tag
### Does this PR introduce _any_ user-facing change?
User can run vLLM on Altlas A3 series
### How was this patch tested?
CI passed with:
- remove latest tag test:
https://github.com/wxsIcey/wxs-vllm-ascend/actions/runs/16267635040/job/45926924765
- E2E image build for A3
- CI test on A3 with e2e test and longterm test
- Unit test missing because need a real A3 hardware to have a test
Closes: https://github.com/vllm-project/vllm-ascend/issues/1696
- vLLM version: v0.9.2
- vLLM main:
https://github.com/vllm-project/vllm/commit/d0dc4cfca48c2734da18ec42d6bba1346cbfc400
---------
Signed-off-by: Icey <1790571317@qq.com >
2025-07-17 11:13:02 +08:00