Downloads · 30 days
7
11% of all-time downloads
LoneStriker/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-8.0bpw-h8-exl2
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-8.0bpw-h8-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
DPO Trainer with dataset jondurbin/truthy-dpo-v0.1 to improve [TomGrc/FusionNet7Bx2MoE14B]
Downloads · 30 days
7
11% of all-time downloads
All-time downloads
65
Public
Repo size
13 GB
Likes
0
Public
Click a slice to open those files.
.safetensors13 GB · 100%
From the Hugging Face model README
DPO Trainer TRL supports the DPO Trainer for training language models from preference data, as described in the paper Direct Preference Optimization: Your Language Model is Secretly a Reward Model by Rafailov et al., 2023.