0e7f4ae5f65f76edb4daf31f5e077c7560304be7
Model: chargoddard/servile-harpsichord-cdpo Source: Original Platform
license, datasets
| license | datasets | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| cc-by-nc-4.0 |
|
Trained on a different random sampling of the same datasets used by loyal-piano-m7, then with cDPO on a blend of RLHF datasets.
Several intermediate checkpoints (of cDPO training) are on branches.
Uses the Alpaca prompt format.
Description