xc-llm-ascend

Files

LHXuuu 0415e694cd [Quantization] Support compressed tensors moe w8a8 int8 dynamic weight (#5718 )

### What this PR does / why we need it?
While using the LLM Compressor quantization tool from the VLLM community
to generate quantized weights, the VLLM Ascend engine needs to be
adapted to support the compressed tensors quantization format.

1. Support Moe model W8A8 Int8 dynamic weight.
2. Specify W4A16 quantization configuration.

Co-authored-by: menogrey 1299267905@qq.com
Co-authored-by: kunpengW-code 1289706727@qq.com

### Does this PR introduce _any_ user-facing change?
No

- vLLM version: v0.13.0
- vLLM main:
2f4e6548ef

---------

Signed-off-by: LHXuuu <scut_xlh@163.com>
Signed-off-by: menogrey <1299267905@qq.com>
Signed-off-by: Wang Kunpeng <1289706727@qq.com>
Co-authored-by: menogrey <1299267905@qq.com>
Co-authored-by: Wang Kunpeng <1289706727@qq.com>

2026-01-14 09:17:26 +08:00

ISSUE_TEMPLATE

[Doc] Update doc url link (#5781 )

2026-01-12 11:21:31 +08:00

workflows

[Quantization] Support compressed tensors moe w8a8 int8 dynamic weight (#5718 )

2026-01-14 09:17:26 +08:00

actionlint.yaml

[CI] lint and ut use self_hosted runner (#5652 )

2026-01-09 14:26:14 +08:00

dependabot.yml

[CI] Add dependabot support and labeler workflow (#162 )