Yarn-Mistral-7B-128k-GPTQ/quantize_config.json at main - Yarn-Mistral-7B-128k-GPTQ - Gitea: Git with a cup of tea

TheBloke/Yarn-Mistral-7B-128k-GPTQ

Files

ModelHub XC 05905204ba 初始化项目，由ModelHub XC社区提供模型

Model: TheBloke/Yarn-Mistral-7B-128k-GPTQ
Source: Original Platform

2026-09-17 21:38:25 +08:00

8 lines

134 B

JSON

Raw Permalink Blame History

 {
     "bits": 4,
     "group_size": 128,
     "damp_percent": 0.01,
     "desc_act": true,
     "sym": true,
     "true_sequential": true
 }