acai66/Qwen2.5-0.5B-Instruct-meow-GPTQ
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: acai66/Qwen2.5-0.5B-Instruct-meow-GPTQ
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-06 08:23:14 +08:00
commit b35eeea57e
14 changed files with 909550 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

19
quantize_config.json Normal file
View File

@@ -0,0 +1,19 @@
{
"bits": 8,
"dataset": "AI-ModelScope/alpaca-gpt4-data-zh#2000,AI-ModelScope/alpaca-gpt4-data-en#2000",
"group_size": 128,
"damp_percent": 0.1,
"desc_act": false,
"sym": true,
"true_sequential": true,
"quant_method": "gptq",
"modules_in_block_to_quantize": null,
"checkpoint_format": "gptq",
"meta": {
"quantizer": [
"optimum:1.24.0",
"auto_gptq:0.7.1"
]
},
"block_name_to_quantize": "model.layers"
}