DJfastmusic

assn2-DPO

DJfastmusic/assn2-DPO

assn2-DPO is a machine learning model from DJfastmusic. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Merged full model for CAS4133 Assignment 2. Source adapter: /root/CAS4133-assn2/checkpoints/dpofrombestsftpref Base model: /root/CAS4133-assn2/checkpoints/sftlrsweep/bestsftmergedhf