初始化项目,由ModelHub XC社区提供模型
Model: 4season/alignment-model-test9 Source: Original Platform
This commit is contained in:
14
README.md
Normal file
14
README.md
Normal file
@@ -0,0 +1,14 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
language:
|
||||
- en
|
||||
---
|
||||
|
||||
# 4season/model_eval_test
|
||||
|
||||
|
||||
# **Introduction**
|
||||
This model is test version, alignment-tuned model.
|
||||
|
||||
We utilize state-of-the-art instruction fine-tuning methods including direct preference optimization (DPO).
|
||||
After DPO training, we linearly merged models to boost performance.
|
||||
Reference in New Issue
Block a user