Downloads · 30 days
199
5% of all-time downloads
RichardErkhov/yunconglong_-_Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-gguf
yunconglong_-_Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
199
5% of all-time downloads
All-time downloads
4.2K
Public
Repo size
146 GB
Likes
1
Public
Click a slice to open those files.
.gguf169 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B - GGUF
license: mit tags:
DPO Trainer TRL supports the DPO Trainer for training language models from preference data, as described in the paper Direct Preference Optimization: Your Language Model is Secretly a Reward Model by Rafailov et al., 2023.