Downloads · 30 days
13
16% of all-time downloads
amazingvince/zephyr-smol_llama-100m-dpo-1-epoch
zephyr-smol_llama-100m-dpo-1-epoch is a text generation model from amazingvince. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
13
16% of all-time downloads
All-time downloads
82
Public
Parameters
101M
203 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors203 MB · 99%
From the Hugging Face model README
This model is a fine-tuned version of amazingvince/zephyr-smol_llama-100m-sft-full on the None dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.6597 | 0.26 | 1000 | 0.5887 | -0.0788 | -0.5504 | 0.6700 | 0.4715 | -448.0441 | -589.0577 | -4.7945 | -5.0906 |
| 0.5306 | 0.52 | 2000 | 0.5740 | 0.0053 | -0.5021 | 0.6840 | 0.5074 | -447.5612 | -588.2166 | -4.8585 | -5.1486 |
| 0.6036 | 0.77 | 3000 | 0.5676 | 0.0550 | -0.4785 | 0.6890 | 0.5335 | -447.3253 | -587.7193 | -4.9388 | -5.2343 |