sabersaleh

Llama2-7B-RDPO

sabersaleh/Llama2-7B-RDPO

Llama2-7B-RDPO is a machine learning model from sabersaleh. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.

This model is aligned using the AlpacaFarm dataset, fine-tuned through the RDPO loss. The alignment process started from the Supervised Fine-Tuned (SFT) version of LLaMA 2 7B. The optimization process was conducted wi…