Files
alignment_model_test/README.md
ModelHub XC 8a4c20d6c7 初始化项目,由ModelHub XC社区提供模型
Model: 4season/alignment_model_test
Source: Original Platform
2026-07-18 03:49:09 +08:00

14 lines
320 B
Markdown

---
license: apache-2.0
language:
- en
---
# 4season/model_eval_test
# **Introduction**
This model is test version, alignment-tuned model.
We utilize state-of-the-art instruction fine-tuning methods including direct preference optimization (DPO).
After DPO training, we linearly merged models to boost performance.