xc-llm-ascend

Files

22dimensions 00e0243561 enable online serving quantization (#877 )

For online serving, "ascend" quantization method is not a choice
natively, so we need to add "ascend" quantization method to quantization
methods list and the user can enable quantization using "vllm serve
--quantization ascend" command.

---------

Signed-off-by: 22dimensions <waitingwind@foxmail.com>

2025-05-17 17:36:04 +08:00

__init__.py

[Core] Cherry pick from 0.7.1 to keep the main code newest (#127 )

2025-02-21 17:07:37 +08:00

func_wrapper.py

[quantization] Support w8a8 quantization (#580 )

2025-04-20 18:14:05 +08:00

quant_config.py

enable online serving quantization (#877 )

2025-05-17 17:36:04 +08:00

quantizer.py

[quantization] Support w8a8 quantization (#580 )