Qwen2.5-1.5B-Indonesian-Assistant/README.md

base_model, tags, license, language

base_model	tags	license	language
unsloth/qwen2.5-1.5b-unsloth-bnb-4bit	text-generation-inference transformers unsloth qwen2	apache-2.0	en

Uploaded finetuned model

• Developed by: kendrickfff
• License: apache-2.0
• Finetuned from model : unsloth/qwen2.5-1.5b-unsloth-bnb-4bit

Qwen2.5-1.5B Indonesian Assistant (SFT)

Training Method

• Type: Supervised Fine-Tuning (SFT)
• Base Model: Qwen/Qwen2.5-1.5B
• Dataset: Ichsan2895/alpaca-gpt4-indonesian
• LoRA rank: 16
• Epochs: 2 experiments (3 epochs each)

This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.