Model: OpenSourceEnjoyer/Nous-Hermes-2-Mistral-7B-DPO-SFT-GGUF-Q8 Source: Original Platform
This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.