zhezi12138

alpaca-7b-iter-2-mixp

zhezi12138/alpaca-7b-iter-2-mixp

alpaca-7b-iter-2-mixp is a machine learning model from zhezi12138. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.

This model is for the reproduction of results on Safe-RLHF dataset of paper "The crucial role of samplers in online direct preference optimization". Iteration 2 of DPO-mixp algorithm, trained on https://huggingface.co…