Files
PLLuM-12B-instruct-FP8-Dynamic/recipe.yaml

7 lines
136 B
YAML
Raw Normal View History

default_stage:
default_modifiers:
QuantizationModifier:
targets: [Linear]
ignore: [lm_head]
scheme: FP8_DYNAMIC