Downloads · 30 days
54
0% of all-time downloads
jae24/openhermes_dpo_norobot_0201
openhermes_dpo_norobot_0201 is a text generation model from jae24. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This variant of the model has undergone reinforcement learning (RL) fine-tuning and is based on teknium/OpenHermes-2.5-Mistral-7B. The fine-tuning process utilized a preference dataset derived from HuggingFace's no ro…
Downloads · 30 days
54
0% of all-time downloads
All-time downloads
34.1K
Public
Parameters
7.2B
29 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors29 GB · 100%
From the Hugging Face model README
This variant of the model has undergone reinforcement learning (RL) fine-tuning and is based on teknium/OpenHermes-2.5-Mistral-7B. The fine-tuning process utilized a preference dataset derived from HuggingFace's no robots dataset, incorporating Differential Privacy Optimization (DPO) techniques.