dolphin-2.2.1-mistral-7B-GPTQ/quantize_config.json at main - dolphin-2.2.1-mistral-7B-GPTQ - Gitea: Git with a cup of tea

TheBloke/dolphin-2.2.1-mistral-7B-GPTQ

Files

ModelHub XC 21fe3faab4 初始化项目，由ModelHub XC社区提供模型

Model: TheBloke/dolphin-2.2.1-mistral-7B-GPTQ
Source: Original Platform

2026-09-05 18:30:13 +08:00

8 lines

134 B

JSON

Raw Permalink Blame History

 {
     "bits": 4,
     "group_size": 128,
     "damp_percent": 0.01,
     "desc_act": true,
     "sym": true,
     "true_sequential": true
 }