TwinLlama-3.2-1B-DPO/README.md

base_model, tags, license, language, datasets

base_model	tags	license	language	datasets
unsloth/Llama-3.2-1B	text-generation-inference transformers unsloth llama	apache-2.0	en ko	choco-conoz/llm-twin-preference-dataset

DPO finetuned model

• Developed by: choco-conoz
• License: apache-2.0
• DPO Finetuned from model : unsloth/Llama-3.2-1B