Files
TwinLlama-3.2-1B-DPO/README.md

20 lines
336 B
Markdown
Raw Permalink Normal View History

---
base_model: unsloth/Llama-3.2-1B
tags:
- text-generation-inference
- transformers
- unsloth
- llama
license: apache-2.0
language:
- en
- ko
datasets:
- choco-conoz/llm-twin-preference-dataset
---
# DPO finetuned model
- **Developed by:** choco-conoz
- **License:** apache-2.0
- **DPO Finetuned from model :** unsloth/Llama-3.2-1B