Downloads · 30 days
4
6% of all-time downloads
sfulay/zephyr-7b-dpo-full-ultrabin-2
zephyr-7b-dpo-full-ultrabin-2 is a text generation model from sfulay. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
4
6% of all-time downloads
All-time downloads
66
Public
Parameters
7.2B
14.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors14.5 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of alignment-handbook/zephyr-7b-sft-full on the HuggingFaceH4/ultrafeedback_binarized dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.5737 | 0.2092 | 100 | 0.5691 | -0.6944 | -1.2209 | 0.7227 | 0.5264 | -384.7459 | -332.0635 | -1.3889 | -1.5290 |
| 0.5456 | 0.4184 | 200 | 0.5217 | -0.8959 | -1.6744 | 0.7812 | 0.7785 | -430.1032 | -352.2071 | -0.6808 | -1.2567 |
| 0.4938 | 0.6276 | 300 | 0.5073 | -0.9394 | -1.8266 | 0.7695 | 0.8872 | -445.3213 | -356.5596 | -0.2199 | -0.9537 |
| 0.5014 | 0.8368 | 400 | 0.5015 | -1.0166 | -1.9608 | 0.7656 | 0.9442 | -458.7432 | -364.2830 | 0.1887 | -0.6221 |