walebadr

Mistral-7B-v0.1-DPO

walebadr/Mistral-7B-v0.1-DPO

Mistral-7B-v0.1-DPO is a text generation model from walebadr. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

Mistral-7b-v0.1-DPO is a finetuned adapter from the original Mistral-7b model. In this adaptor, I am finetuning the LM head in addition to the regular modules that are normally finetuned. Below is the list of the fine…