Downloads · 30 days
8.7K
4% of all-time downloads
MoE_13B_DPO
yunconglong/MoE_13B_DPO
MoE_13B_DPO is a text generation model from yunconglong. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
DPO Trainer with dataset Intel/orcadpopairs to improve [yunconglong/TruthfulDPOTomGrcFusionNet7Bx2MoE13B]
All-time downloads
201K
Public
Parameters
12.9B
25.8 GB on disk
Likes
7
Public
Repo makeup
Click a slice to open those files.
.safetensors25.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- mixtral
- Access
- Public
- Created
- Jan 28, 2024
- Updated
- Jan 28, 2024
- SHA
- d8d6a47f
Try a prompt
Model card
From the Hugging Face model README
- DPO Trainer with dataset Intel/orca_dpo_pairs to improve [yunconglong/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B]
DPO Trainer TRL supports the DPO Trainer for training language models from preference data, as described in the paper Direct Preference Optimization: Your Language Model is Secretly a Reward Model by Rafailov et al., 2023.
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- other
- Created
- Jan 28, 2024
- Updated
- Jan 28, 2024