Huihui-Qwen3-4B-Thinking-2507-abliterated-w4g128/quantization_config.json at main - Huihui-Qwen3-4B-Thinking-2507-abliterated-w4g128 - Gitea: Git with a cup of tea

huihui-ai/Huihui-Qwen3-4B-Thinking-2507-abliterated-w4g128

Files

ModelHub XC 34efb9e58b 初始化项目，由ModelHub XC社区提供模型

Model: huihui-ai/Huihui-Qwen3-4B-Thinking-2507-abliterated-w4g128
Source: Original Platform

2026-08-17 11:57:18 +08:00

12 lines

242 B

JSON

Raw Permalink Blame History

 {
   "bits": 4,
   "group_size": 128,
   "sym": true,
   "data_type": "int",
   "scale_dtype": "None",
   "iters": 1000,
   "nsamples": 512,
   "autoround_version": "0.9.2",
   "quant_method": "auto-round",
   "packing_format": "auto_round:auto_gptq"
 }