Downloads · 30 days
73
1% of all-time downloads
Truthful_DPO_TomGrc_FusionNet_34Bx2_MoE
cloudyu/Truthful_DPO_TomGrc_FusionNet_34Bx2_MoE
Truthful_DPO_TomGrc_FusionNet_34Bx2_MoE is a text generation model from cloudyu. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
DPO Trainer with dataset jondurbin/truthy-dpo-v0.1 to improve [TomGrc/FusionNet34Bx2MoE]
All-time downloads
13.3K
Public
Parameters
60.8B
122 GB on disk
Likes
4
Public
Repo makeup
Click a slice to open those files.
.safetensors122 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- mixtral
- Access
- Public
- Created
- Jan 25, 2024
- Updated
- Jan 25, 2024
- SHA
- d8464216
Try a prompt
Model card
From the Hugging Face model README
- DPO Trainer with dataset jondurbin/truthy-dpo-v0.1 to improve [TomGrc/FusionNet_34Bx2_MoE]
DPO Trainer TRL supports the DPO Trainer for training language models from preference data, as described in the paper Direct Preference Optimization: Your Language Model is Secretly a Reward Model by Rafailov et al., 2023.
* Metrics improved by DPO
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- mit
- Created
- Jan 25, 2024
- Updated
- Jan 25, 2024