Downloads · 30 days
10
17% of all-time downloads
LoneStriker/TomGrc_FusionNet_34Bx2_MoE_v0.1_DPO_f16-3.0bpw-h6-exl2
TomGrc_FusionNet_34Bx2_MoE_v0.1_DPO_f16-3.0bpw-h6-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
this is a DPO fine-tuned MoE model for TomGrc/FusionNet34Bx2MoEv0.1
Downloads · 30 days
10
17% of all-time downloads
All-time downloads
59
Public
Repo size
23.7 GB
Likes
0
Public
Click a slice to open those files.
.safetensors23.7 GB · 100%
From the Hugging Face model README
this is a DPO fine-tuned MoE model for TomGrc/FusionNet_34Bx2_MoE_v0.1
DPO Trainer
TRL supports the DPO Trainer for training language models from preference data, as described in the paper Direct Preference Optimization: Your Language Model is Secretly a Reward Model by Rafailov et al., 2023.
Metrics Metrics