初始化项目，由ModelHub XC社区提供模型

Model: takami2022/qwen3-4b-dpo-v2
Source: Original Platform

README.md

@@ -0,0 +1,31 @@
+---
+base_model: takami2022/qwen3-4b-dpo-v1
+datasets:
+- u-10bei/dpo-dataset-qwen-cot
+language:
+- en
+license: apache-2.0
+library_name: transformers
+pipeline_tag: text-generation
+tags:
+- dpo
+- unsloth
+- qwen
+- alignment
+---
+
+# qwen3-4b-dpo-v2
+
+DPO v1（0.7703）をベースにBeta=0.05で再学習したモデル。
+
+## Training Configuration
+- **Base model**: takami2022/qwen3-4b-dpo-v1
+- **Method**: DPO (Direct Preference Optimization)
+- **Epochs**: 1
+- **Learning rate**: 1e-07
+- **Beta**: 0.05 (前回0.1→0.05に変更)
+- **Max sequence length**: 1024
+- **LoRA Config**: r=16, alpha=32 (merged into base)
+
+
+