Mistral-Small-Gutenberg-Doppel-22B/README.md

license, license_name, license_link, library_name, base_model, datasets

license	license_name	license_link	library_name	base_model	datasets
other	mrl	https://mistral.ai/licenses/MRL-0.1.md	transformers	mistralai/Mistral-Small-Instruct-2409	jondurbin/gutenberg-dpo-v0.1 nbeerbower/gutenberg2-dpo

Mistral-Small-Gutenberg-Doppel-22B

mistralai/Mistral-Small-Instruct-2409 finetuned on jondurbin/gutenberg-dpo-v0.1 and nbeerbower/gutenberg2-dpo.

Method

ORPO tuned with an A40 on RunPod (plz sponsor me) for 3 epochs.

Fine-tune Llama 3 with ORPO