Downloads · 30 days
9
10% of all-time downloads
LoneStriker/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-4.0bpw-h6-exl2
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-4.0bpw-h6-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
DPO Trainer with dataset jondurbin/truthy-dpo-v0.1 to improve [TomGrc/FusionNet7Bx2MoE14B]
Downloads · 30 days
9
10% of all-time downloads
All-time downloads
87
Public
Repo size
6.7 GB
Likes
1
Public
Click a slice to open those files.
.safetensors6.7 GB · 100%
From the Hugging Face model README
DPO Trainer TRL supports the DPO Trainer for training language models from preference data, as described in the paper Direct Preference Optimization: Your Language Model is Secretly a Reward Model by Rafailov et al., 2023.