Downloads · 30 days
71
1% of all-time downloads
TomGrc_FusionNet_34Bx2_MoE_v0.1_full_linear_DPO
cloudyu/TomGrc_FusionNet_34Bx2_MoE_v0.1_full_linear_DPO
TomGrc_FusionNet_34Bx2_MoE_v0.1_full_linear_DPO is a text generation model from cloudyu. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
this is another DPO all-linear-parameter-fine-tuned MoE model for TomGrc/FusionNet34Bx2MoEv0.1
All-time downloads
11.7K
Public
Parameters
60.8B
122 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors122 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mixtral
- Access
- Public
- Created
- Feb 4, 2024
- Updated
- Jun 27, 2024
- SHA
- 8f41adcb
Try a prompt
Model card
From the Hugging Face model README
this is another DPO all-linear-parameter-fine-tuned MoE model for TomGrc/FusionNet_34Bx2_MoE_v0.1
it's trained on a H100 for one hour
DPO Trainer
TRL supports the DPO Trainer for training language models from preference data, as described in the paper Direct Preference Optimization: Your Language Model is Secretly a Reward Model by Rafailov et al., 2023.
Metrics not test!
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- apache-2.0
- Created
- Feb 4, 2024
- Updated
- Jun 27, 2024