EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

[Feature] Add quant description file for new quant model generated by modelslim (#719)

Browse Source 
### What this PR does / why we need it?
After discussed with MindStudio about the quantization model format, we
decide to support another quant format which may used in new modelslim
tool, in which case, `quantization_config` may be removed from the
`config.json` file and `quant_model_description.json` will be used for
quantization configuration.
### Does this PR introduce _any_ user-facing change?
Yes, using the latest quantization format

### How was this patch tested?
Test locally

Signed-off-by: ganyi <pleaplusone.gy@gmail.com>
This commit is contained in:
Pleaplusone
2025-04-30 16:51:56 +08:00
committed by GitHub
parent affca6f348
commit 3a628891ab
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
vllm_ascend/quantization/quant_config.py
View File

@@ -67,7 +67,7 @@ class AscendQuantConfig(QuantizationConfig):
@classmethod @classmethod
def get_config_filenames(cls) -> List[str]: def get_config_filenames(cls) -> List[str]:
return [] return ["quant_model_description.json"]
@classmethod @classmethod
def from_config(cls, config: Dict[str, Any]) -> "AscendQuantConfig": def from_config(cls, config: Dict[str, Any]) -> "AscendQuantConfig":