Files
Qwen2.5-VL-3B-Instruct-FP8-…/recipe.yaml

7 lines
158 B
YAML
Raw Normal View History

DEFAULT_stage:
DEFAULT_modifiers:
QuantizationModifier:
ignore: ['re:.*lm_head', 're:visual.*']
targets: [Linear]
scheme: FP8_DYNAMIC