walebadr/Mistral-7B-v0.1-DPO
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
main
Mistral-7B-v0.1-DPO/README.md
ModelHub XC 232a66cd2b 初始化项目，由ModelHub XC社区提供模型 
Model: walebadr/Mistral-7B-v0.1-DPO
Source: Original Platform
2026-05-11 11:34:11 +08:00

349 B
Raw Permalink Blame History

license
license
apache-2.0

Mistral-7b-v0.1-DPO is a finetuned adapter from the original Mistral-7b model. In this adaptor, I am finetuning the LM head in addition to the regular modules that are normally finetuned. Below is the list of the finetuned modules: 'k_proj', 'gate_proj', 'v_proj', 'up_proj', 'q_proj', 'o_proj', 'down_proj', 'lm_head'