Downloads · 30 days
9.1K
3% of all-time downloads
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B
yunconglong/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B is a text generation model from yunconglong. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
DPO Trainer with dataset jondurbin/truthy-dpo-v0.1 to improve [TomGrc/FusionNet7Bx2MoE14B]
All-time downloads
309K
Public
Parameters
12.9B
25.8 GB on disk
Likes
53
Public
Repo makeup
Click a slice to open those files.
.safetensors25.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- mixtral
- Access
- Public
- Created
- Jan 21, 2024
- Updated
- Feb 28, 2024
- SHA
- dd66c98f
Try a prompt
Model card
From the Hugging Face model README
- DPO Trainer with dataset jondurbin/truthy-dpo-v0.1 to improve [TomGrc/FusionNet_7Bx2_MoE_14B]
DPO Trainer TRL supports the DPO Trainer for training language models from preference data, as described in the paper Direct Preference Optimization: Your Language Model is Secretly a Reward Model by Rafailov et al., 2023.
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- mit
- Created
- Jan 21, 2024
- Updated
- Feb 28, 2024