Downloads · 30 days
769
8% of all-time downloads
RichardErkhov/NicholasCorrado_-_zephyr-7b-uf-rlced-conifer-dpo-2e-gguf
NicholasCorrado_-_zephyr-7b-uf-rlced-conifer-dpo-2e-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
769
8% of all-time downloads
All-time downloads
10.2K
Public
Repo size
82.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf95.2 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
zephyr-7b-uf-rlced-conifer-dpo-2e - GGUF
library_name: transformers license: apache-2.0 base_model: alignment-handbook/zephyr-7b-sft-full tags:
This model is a fine-tuned version of alignment-handbook/zephyr-7b-sft-full on the data/uf_rlced_conifer dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.1587 | 1.3879 | 1000 | 0.2471 | -3.9472 | -12.0338 | 0.8910 | 8.0866 | -1613.5016 | -779.3055 | 4.5606 | 2.4398 |