Files
TinyLlama-1.1B-Chat-v1.0-pr…/recipe.yaml
ModelHub XC 8eb589696d 初始化项目,由ModelHub XC社区提供模型
Model: RedHatAI/TinyLlama-1.1B-Chat-v1.0-pruned2.4
Source: Original Platform
2026-05-06 22:36:51 +08:00

11 lines
237 B
YAML

test_stage:
obcq_modifiers:
SparseGPTModifier:
sparsity: 0.5
block_size: 128
sequential_update: false
quantize: false
percdamp: 0.01
mask_structure: '2:4'
targets: ['re:model.layers.\d*$']