SciPhi-Self-RAG-Mistral-7B-32k-GPTQ/quantize_config.json at main - SciPhi-Self-RAG-Mistral-7B-32k-GPTQ - Gitea: Git with a cup of tea

TheBloke/SciPhi-Self-RAG-Mistral-7B-32k-GPTQ

Files

ModelHub XC 42c2aa3386 初始化项目，由ModelHub XC社区提供模型

Model: TheBloke/SciPhi-Self-RAG-Mistral-7B-32k-GPTQ
Source: Original Platform

2026-10-10 17:35:16 +08:00

8 lines

134 B

JSON

Raw Permalink Blame History

 {
     "bits": 4,
     "group_size": 128,
     "damp_percent": 0.01,
     "desc_act": true,
     "sym": true,
     "true_sequential": true
 }