初始化项目,由ModelHub XC社区提供模型
Model: walebadr/Mistral-7B-v0.1-DPO Source: Original Platform
This commit is contained in:
7
README.md
Normal file
7
README.md
Normal file
@@ -0,0 +1,7 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
---
|
||||
|
||||
Mistral-7b-v0.1-DPO is a finetuned adapter from the original Mistral-7b model. In this adaptor, I am finetuning the LM head in addition to the regular modules that are normally finetuned. Below is the list of the finetuned modules:
|
||||
'k_proj', 'gate_proj', 'v_proj', 'up_proj', 'q_proj', 'o_proj', 'down_proj', 'lm_head'
|
||||
|
||||
Reference in New Issue
Block a user