---
base_model: unsloth/Llama-3.2-1B
tags:
- text-generation-inference
- transformers
- unsloth
- llama
license: apache-2.0
language:
- en
- ko
datasets:
- choco-conoz/llm-twin-preference-dataset
---

# DPO finetuned  model

- **Developed by:** choco-conoz
- **License:** apache-2.0
- **DPO Finetuned from model :** unsloth/Llama-3.2-1B