Ronald
77305df398
implement batch invariant with ascendc ( #6590 )
...
### What this PR does / why we need it?
there are batch invariant ops implemented by triton and ascendc, this pr
aims to choose which kind of ops to be used to enable batch invariant.
#5487
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
- vLLM version: v0.15.0
- vLLM main:
d7e17aaacdronaldautomobile@163.com >
2026-02-10 14:15:26 +08:00
SILONG ZENG
329961b375
[Lint]Style: Convert vllm-ascend/ to ruff format(Batch #2 ) ( #5977 )
...
### What this PR does / why we need it?
**Scope of Changes**:
| File Path |
| :--- |
| `vllm_ascend/attention/attention_mask.py` |
| `vllm_ascend/attention/attention_v1.py` |
| `vllm_ascend/attention/context_parallel/attention_cp.py` |
| `vllm_ascend/attention/context_parallel/common_cp.py` |
| `vllm_ascend/attention/context_parallel/mla_cp.py` |
| `vllm_ascend/attention/utils.py` |
| `vllm_ascend/batch_invariant.py` |
| `vllm_ascend/device/device_op.py` |
| `vllm_ascend/device_allocator/camem.py` |
| `vllm_ascend/envs.py` |
- vLLM version: v0.13.0
- vLLM main:
2c24bc69962609716663@qq.com >
2026-01-19 08:59:46 +08:00
Ronald
6ea2afe5fa
[Feature] implement basic framework for batch invariant ( #5517 )
...
### What this PR does / why we need it?
This PR implement the basic framework for batch invariant, please see
https://github.com/vllm-project/vllm-ascend/issues/5487 .
### Does this PR introduce _any_ user-facing change?
we reuse the function `vllm_is_batch_invariant` in vllm to judge if
batch invariant is enabled.
- vLLM version: v0.13.0
- vLLM main:
45c1ca1ca1ronaldautomobile@163.com >
Signed-off-by: Lord_of_Ironhill <suiweiyi@huawei.com >
Signed-off-by: zjchenn <zjchenn@gmail.com >
Signed-off-by: wangx700 <wangxin700@huawei.com >
Co-authored-by: Lord_of_Ironhill <suiweiyi@huawei.com >
Co-authored-by: zjchenn <zjchenn@gmail.com >
Co-authored-by: wangx700 <wangxin700@huawei.com >
2026-01-07 09:11:26 +08:00
