Files
QwQ-32B-Preview-FP8-dynamic/recipe.yaml

7 lines
136 B
YAML
Raw Normal View History

DEFAULT_stage:
DEFAULT_modifiers:
QuantizationModifier:
ignore: [lm_head]
targets: [Linear]
scheme: FP8_DYNAMIC