wangxiyuan
cc2cd42ad3
Upgrade CANN to 8.3.rc1 ( #3945 )
...
### What this PR does / why we need it?
This PR upgrade CANN from 8.2rc1 to 8.3rc1 and remove the CANN version
check logic.
TODO: we notice that UT runs failed with CANN 8.3 image. So the base
image for UT is still 8.2. We'll fix it later.
- vLLM version: v0.11.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/83f478bb19489b41e9d208b47b4bb5a95ac171ac
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2025-11-03 20:21:07 +08:00
wangxiyuan
6922947033
[Misc] Limit ray version ( #3660 )
...
We notice that with ray>2.48.0, the npu card count is not correct from
ray. This is a know bug. Let's limit ray version to <2.48.0 now.
- vLLM version: v0.11.0rc3
- vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.0
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2025-10-25 09:36:44 +08:00
wangxiyuan
a43e2f61e1
[CI] Update vLLM to v0.11.0 ( #3315 )
...
### What this PR does / why we need it?
There are 3 step to upgrade vllm-ascend to newest vllm. We'll create 3
PR
- [x] Upgrade vllm to v0.11.0 to make CI happy first .
- [ ] Move deepseek v3.2 to vllm way
- [ ] Then we'll add a new PR to add vllm main support.
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
- vLLM version: v0.11.0
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2025-10-09 10:41:19 +08:00
Yikun Jiang
5503a3142f
Bump version to v0.11.0rc3 ( #3213 )
...
### What this PR does / why we need it?
Bump version to v0.11.0rc2 and prepare vLLM Ascend v0.11.0rc0
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
CI passed
- vLLM version: v0.10.2
- vLLM main:
https://github.com/vllm-project/vllm/commit/releases/v0.11.0
---------
Signed-off-by: Yikun Jiang <yikunkero@gmail.com >
2025-09-29 21:48:06 +08:00
Yikun Jiang
0747a6e68c
Bump vLLM version to v0.10.2 ( #2914 )
...
### What this PR does / why we need it?
Bump vLLM version to v0.10.2
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
CI passed
- vLLM version: v0.10.2rc3
- vLLM main:
https://github.com/vllm-project/vllm/commit/15b8fef453b373b84406207a947005a4d9d68acc
Signed-off-by: Yikun Jiang <yikunkero@gmail.com >
2025-09-14 06:57:59 +08:00
Yikun Jiang
f97a64ba7f
Bump vLLM version to v0.10.2rc3 ( #2911 )
...
### What this PR does / why we need it?
Bump vLLM version to v0.10.2rc3
https://github.com/vllm-project/vllm/compare/v0.10.2rc2...v0.10.2rc3
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
CI passed
- vLLM version: v0.10.2rc2
- vLLM main:
https://github.com/vllm-project/vllm/commit/15b8fef453b373b84406207a947005a4d9d68acc
Signed-off-by: Yikun Jiang <yikunkero@gmail.com >
2025-09-13 19:15:48 +08:00
Yikun Jiang
8ece6956e7
Revert "Upgrade CANN version to 8.3.rc1.alpha001 ( #2903 )" ( #2909 )
...
### What this PR does / why we need it?
This reverts commit 339fceb89c .
### Does this PR introduce _any_ user-facing change?
Yes, use 8.2rc1 image by default
### How was this patch tested?
CI passed
- vLLM version: v0.10.2rc2
- vLLM main:
https://github.com/vllm-project/vllm/commit/cfa3234a5b8a6ec4f65ceb080bdc232eaee9b080
Signed-off-by: Yikun Jiang <yikunkero@gmail.com >
2025-09-13 16:21:54 +08:00
Yikun Jiang
339fceb89c
Upgrade CANN version to 8.3.rc1.alpha001 ( #2903 )
...
### What this PR does / why we need it?
Upgrade CANN version to 8.3.rc1.alpha001
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
- vLLM version: v0.10.2rc2
- vLLM main:
https://github.com/vllm-project/vllm/commit/89e08d6d180c76019daa5aa1bbf7759dfaedde2e
Signed-off-by: Yikun Jiang <yikunkero@gmail.com >
2025-09-13 12:10:21 +08:00
Yikun Jiang
138e932630
Bump vLLM version to v0.10.2rc2 ( #2902 )
...
### What this PR does / why we need it?
Upgrade vLLM version to 0.10.2rc2
### Does this PR introduce _any_ user-facing change?
Yes, image will use 0.10.2rc2 vLLM
### How was this patch tested?
- vLLM version: main
- vLLM main:
https://github.com/vllm-project/vllm/commit/f17c075884009a3bfb7c66cb0897719b8e18f196
Signed-off-by: Yikun Jiang <yikunkero@gmail.com >
2025-09-13 11:39:48 +08:00
Mengqing Cao
edf1f600ad
[CI] Remove compatibility maintenance for vllm v0.10.1 and v0.10.1.1 ( #2840 )
...
### What this PR does / why we need it?
Remove compatibility maintenance for vllm v0.10.1 and v0.10.1.1
### Does this PR introduce _any_ user-facing change?
branch main of vllm-ascend will not be compatible with vllm v0.10.1 and
v0.10.1.1
### How was this patch tested?
CI passed with existing test.
- vLLM version: v0.10.1.1
- vLLM main:
https://github.com/vllm-project/vllm/commit/6fb27881634d89c2e70e9e5fbad1b918c0d916cf
---------
Signed-off-by: MengqingCao <cmq0113@163.com >
2025-09-10 08:43:10 +08:00
Icey
af62af3cc5
[Image] Upgrade openEuler to 24.03 ( #2631 )
...
### What this PR does / why we need it?
Upgrade openEuler to 24.03
### Does this PR introduce _any_ user-facing change?
N/A
### How was this patch tested?
CI passed with new added/existing test.
- vLLM version: v0.10.1.1
- vLLM main:
https://github.com/vllm-project/vllm/commit/4071c76cf3cff46e14630f1e66cbf006b6eb51d3
---------
Signed-off-by: Icey <1790571317@qq.com >
2025-09-02 20:09:09 +08:00
Mengqing Cao
b0403f8d8a
[CI] fix ci ( #2464 )
...
### What this PR does / why we need it?
1. use action/checkout@v5 instead of v4
2. remove dbo test case because there is issue with it and will be
refactored later
3. make vllm-ascend compatible with vllm v0.10.1.1 and add CI for it
4. fix sampler api changes introduced by
https://github.com/vllm-project/vllm/pull/22387
6. fix qwen3 moe config changes intruoduced by
https://github.com/vllm-project/vllm/pull/20562
7. fix kvcache block changes introduced by
https://github.com/vllm-project/vllm/pull/23262
### Does this PR introduce _any_ user-facing change?
N/A
### How was this patch tested?
CI passed with existing test.
- vLLM version: v0.10.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/0c6e40bbaa4707528286a1e7bf17c90c88a1d920
---------
Signed-off-by: MengqingCao <cmq0113@163.com >
2025-08-22 07:30:48 +08:00
Mengqing Cao
75e28d0356
[Build][Ray] Fix protobuf version in Dockerfile ( #2028 )
...
### What this PR does / why we need it?
Fix protobuf version in Dockerfile to resolve `AttributeError: 'str'
object has no attribute 'DESCRIPTOR' when packaging message to dict`
using protobuf. will remove version specification after
https://github.com/ray-project/ray/pull/54910 is merged
### Does this PR introduce _any_ user-facing change?
N/A
### How was this patch tested?
CI passed with existing test.
- vLLM version: v0.10.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/0e36abf9931baa070609376debb4fb3772f4a3fe
Signed-off-by: MengqingCao <cmq0113@163.com >
2025-07-30 22:49:20 +08:00
Yikun Jiang
5b579ddafe
Upgrade CANN to 8.2.RC1 (A3) ( #2043 )
...
### What this PR does / why we need it?
Upgrade CANN to 8.2.RC1
### Does this PR introduce _any_ user-facing change?
Yes, A3 image are using 8.2.rc1
### How was this patch tested?
CI passed
- vLLM version: v0.10.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/de509ae8eb4467bd789234d909e5c725b8fba326
Signed-off-by: Yikun Jiang <yikunkero@gmail.com >
2025-07-26 23:10:27 +08:00
Yikun Jiang
17a430f7b8
Upgrade vLLM to v0.10.0 ( #1927 )
...
### What this PR does / why we need it?
- Upgrade to v0.10.0
- Drop v0.9.2 version compatibility
- Add patch for
`vllm_ascend/patch/worker/patch_common/patch_sampler_gather_logprobs.py`
as workaround of
https://github.com/vllm-project/vllm/commit/f3a683b7c9df8b251092e48e53d58220bb920f2c
for v0.10.0 and also add e2e test `test_models_prompt_logprobs`
- Pin transformers<4.54.0 as workaround of
https://github.com/vllm-project/vllm-ascend/issues/2034
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
- Test locally:
`VLLM_USE_MODELSCOPE=true pytest -sv
tests/e2e/singlecard/test_offline_inference.py::test_models_prompt_logprobs`
- CI passed
- vLLM version: v0.9.2
- vLLM main:
https://github.com/vllm-project/vllm/commit/7728dd77bb802e1876012eb264df4d2fa2fc6f3c
---------
Signed-off-by: Yikun Jiang <yikunkero@gmail.com >
2025-07-26 15:43:29 +08:00
Icey
875a920d4a
[Platform] Add support for Altlas A3 series ( #1794 )
...
### What this PR does / why we need it?
Add support for Ascend A3 and remove latest tag
### Does this PR introduce _any_ user-facing change?
User can run vLLM on Altlas A3 series
### How was this patch tested?
CI passed with:
- remove latest tag test:
https://github.com/wxsIcey/wxs-vllm-ascend/actions/runs/16267635040/job/45926924765
- E2E image build for A3
- CI test on A3 with e2e test and longterm test
- Unit test missing because need a real A3 hardware to have a test
Closes: https://github.com/vllm-project/vllm-ascend/issues/1696
- vLLM version: v0.9.2
- vLLM main:
https://github.com/vllm-project/vllm/commit/d0dc4cfca48c2734da18ec42d6bba1346cbfc400
---------
Signed-off-by: Icey <1790571317@qq.com >
2025-07-17 11:13:02 +08:00