Downloads · 30 days
22
50% of all-time downloads
hZzy/qwen2.5-0.5b-expo-DPO-EXPERIMENT-1K-5e6
qwen2.5-0.5b-expo-DPO-EXPERIMENT-1K-5e6 is a machine learning model from hZzy. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
22
50% of all-time downloads
All-time downloads
44
Public
Parameters
494M
2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2 GB · 99%
From the Hugging Face model README
This model is a fine-tuned version of hZzy/qwen2.5-0.5b-sft-news-IFT on the hZzy/train_pairwise dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Logps | Logits | Objective | Dpo Loss | Regularize | Ranking Simple | Ranking Idealized | Ranking Idealized Expo |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 932.0532 | 0.2834 | 50 | 928.5909 | -90.5890 | -1.5321 | 972.7211 | 972.7211 | 972.7211 | 0.5103 | 0.5093 | 0.5093 |
| 1035.9887 | 0.5668 | 100 | 1589.5358 | -80.1508 | -1.3577 | 1629.7952 | 1629.7952 | 1629.7952 | 0.5145 | 0.5093 | 0.5093 |
| 835.8459 | 0.8503 | 150 | 1554.2150 | -79.1304 | -1.1902 | 1554.7245 | 1554.7245 | 1554.7245 | 0.5238 | 0.5093 | 0.5093 |
| 353.4232 | 1.1337 | 200 | 1601.4404 | -77.8605 | -1.1493 | 1618.9882 | 1618.9882 | 1618.9882 | 0.5279 | 0.5093 | 0.5093 |
| 363.333 | 1.4171 | 250 | 1571.6953 | -78.8053 | -1.0661 | 1577.6245 | 1577.6245 | 1577.6245 | 0.5227 | 0.5093 | 0.5093 |
| 267.0769 | 1.7005 | 300 | 1533.1350 | -79.3922 | -1.0587 | 1538.6410 | 1538.6410 | 1538.6410 | 0.5227 | 0.5093 | 0.5093 |
| 287.4463 | 1.9839 | 350 | 1521.1865 | -79.1168 | -1.0707 | 1520.4884 | 1520.4884 | 1520.4884 | 0.5258 | 0.5093 | 0.5093 |