Files
Qwen2.5-0.5B-Instruct-quant…/flashrl_config.yaml

7 lines
239 B
YAML
Raw Permalink Normal View History

configs:
- distributed_executor_backend: external_launcher
fn: int8
load_format: auto
model: LiyuanLucasLiu/Qwen2-0.5B-Instruct-quantized.w8a8-RedHatAI
profile: LiyuanLucasLiu/Qwen2-0.5B-Instruct-quantized.w8a8-RedHatAI/profile.pt