adlee238

cs329x-hw1-dpo

adlee238/cs329x-hw1-dpo

cs329x-hw1-dpo is a machine learning model from adlee238. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.

DPO performed on "mistralai/Mistral-7B-Instruct-v0.2", with learning rate = 0.00005, batch size = 4, and epochs = 2.