wz-qwen25-3b-roleplay-dpo-v3/README.md

base_model, tags, license, language

base_model	tags	license	language
unsloth/qwen2.5-3b-instruct-unsloth-bnb-4bit	text-generation-inference transformers unsloth qwen2	apache-2.0	en

Uploaded finetuned model

• Developed by: icedsoylatte
• License: apache-2.0
• Finetuned from model : unsloth/qwen2.5-3b-instruct-unsloth-bnb-4bit

This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.