Files
QwQ-32B-Preview-quantized.w8a8/recipe.yaml

8 lines
147 B
YAML
Raw Normal View History

DEFAULT_stage:
DEFAULT_modifiers:
GPTQModifier:
targets: [Linear]
dampening_frac: 0.1
ignore: [lm_head]
scheme: W8A8