Qwen3-4B-Instruct-2507-4bit-GPTQ/quantization_config.json at 51c6cc7475e889222e51c8c3fc388d124651c6ac - Qwen3-4B-Instruct-2507-4bit-GPTQ - Gitea: Git with a cup of tea

pramjana/Qwen3-4B-Instruct-2507-4bit-GPTQ

Files

ModelHub XC 51c6cc7475 初始化项目，由ModelHub XC社区提供模型

Model: pramjana/Qwen3-4B-Instruct-2507-4bit-GPTQ
Source: Original Platform

2026-10-06 07:45:19 +08:00

12 lines

232 B

JSON

Raw Blame History

 {
   "bits": 4,
   "group_size": 128,
   "sym": true,
   "data_type": "int",
   "autoround_version": "0.8.0",
   "provider": "auto-round",
   "quant_method": "gptq",
   "desc_act": false,
   "true_sequential": false,
   "damp_percent": 0.01
 }