Files
vicuna-13b-v1.3.0-GPTQ/quantize_config.json
ModelHub XC c5c4621ae4 初始化项目,由ModelHub XC社区提供模型
Model: TheBloke/vicuna-13b-v1.3.0-GPTQ
Source: Original Platform
2026-09-15 11:04:12 +08:00

9 lines
158 B
JSON

{
"bits": 4,
"group_size": 128,
"damp_percent": 0.01,
"desc_act": false,
"sym": true,
"true_sequential": true,
"model_file_base_name": "model"
}