cduoduo

TCMConverse-4B-SFT-DPO-Alignment

cduoduo/TCMConverse-4B-SFT-DPO-Alignment

TCMConverse-4B-SFT-DPO-Alignment is a machine learning model from cduoduo. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.

基于cduoduo/TCMConverse-4B-SFT, 在llamafactory框架上,使用DPO算法进行偏好对齐后的模型。