Downloads · 30 days
190
15% of all-time downloads
RichardErkhov/jae24_-_openhermes_dpo_norobot_0201-gguf
jae24_-_openhermes_dpo_norobot_0201-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
190
15% of all-time downloads
All-time downloads
1.3K
Public
Repo size
82.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf95.2 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
openhermes_dpo_norobot_0201 - GGUF
This variant of the model has undergone reinforcement learning (RL) fine-tuning and is based on teknium/OpenHermes-2.5-Mistral-7B. The fine-tuning process utilized a preference dataset derived from HuggingFace's no robots dataset, incorporating Differential Privacy Optimization (DPO) techniques.