初始化项目,由ModelHub XC社区提供模型
Model: openaccess-ai-collective/DPOpenHermes-11B Source: Original Platform
This commit is contained in:
26
README.md
Normal file
26
README.md
Normal file
@@ -0,0 +1,26 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
datasets:
|
||||
- teknium/openhermes
|
||||
- argilla/ultrafeedback-binarized-preferences
|
||||
- Intel/orca_dpo_pairs
|
||||
language:
|
||||
- en
|
||||
library_name: transformers
|
||||
---
|
||||
# DPOpenHermes 11B
|
||||
|
||||
This is a mergekit merge of DPOpenHermes-7B from seperate versions of it.
|
||||
|
||||
```
|
||||
slices:
|
||||
- sources:
|
||||
- model: openaccess-ai-collective/DPOpenHermes-7B
|
||||
revision: dpo-v0
|
||||
layer_range: [0, 24]
|
||||
- sources:
|
||||
- model: openaccess-ai-collective/DPOpenHermes-7B
|
||||
layer_range: [8, 32]
|
||||
merge_method: passthrough
|
||||
dtype: bfloat16
|
||||
```
|
||||
Reference in New Issue
Block a user