wenqiglantz

MistralTrinity-7B-slerp-dpo

wenqiglantz/MistralTrinity-7B-slerp-dpo

MistralTrinity-7B-slerp-dpo is a text generation model from wenqiglantz. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

Inspired by @mlabonne's blog post Fine-tune a Mistral-7b model with Direct Preference Optimization, this model was fine-tuned with DPO (Direct Preference Optimization) on base model MistralTrinity-7B-slerp, which is a…