dpo-qwen-cot-merged/README.md

base_model, tags, license, language

base_model	tags	license	language
unsloth/qwen3-4b-instruct-2507-unsloth-bnb-4bit	text-generation-inference transformers unsloth qwen3	apache-2.0	en

Uploaded finetuned model

• Developed by: sibutosi2010
• License: apache-2.0
• Finetuned from model : unsloth/qwen3-4b-instruct-2507-unsloth-bnb-4bit

This qwen3 model was trained 2x faster with Unsloth and Huggingface's TRL library.