Downloads · 30 days
19
53% of all-time downloads
hZzy/qwen2.5-0.5b-expo-DPO-ES2-0.1
qwen2.5-0.5b-expo-DPO-ES2-0.1 is a machine learning model from hZzy. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
19
53% of all-time downloads
All-time downloads
36
Public
Parameters
494M
59.3 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2 GB · 99%
From the Hugging Face model README
This model is a fine-tuned version of hZzy/qwen2.5-0.5b-sft-news-IFT on the hZzy/train_pairwise dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Logps | Logits | Objective | Dpo Loss | Regularize | Ranking Simple | Ranking Idealized | Ranking Idealized Expo | Wo Beta |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.689 | 0.1417 | 50 | 0.6875 | -90.0815 | -1.4869 | 0.6892 | 0.6892 | 0.6892 | 0.5259 | 0.6030 | 0.5223 | 7.8857 |
| 0.6673 | 0.2834 | 100 | 0.6808 | -90.9674 | -1.6164 | 0.6836 | 0.6836 | 0.6836 | 0.5331 | 0.6030 | 0.5223 | 7.8643 |
| 0.6376 | 0.4251 | 150 | 0.6785 | -94.6386 | -1.6873 | 0.6833 | 0.6833 | 0.6833 | 0.5342 | 0.6030 | 0.5223 | 8.1745 |
| 0.5955 | 0.5668 | 200 | 0.6808 | -100.2786 | -1.8583 | 0.6818 | 0.6818 | 0.6818 | 0.5342 | 0.6030 | 0.5223 | 7.9037 |
| 0.5623 | 0.7085 | 250 | 0.6757 | -97.3034 | -1.9407 | 0.6757 | 0.6757 | 0.6757 | 0.5362 | 0.6030 | 0.5223 | 7.9161 |
| 0.5255 | 0.8503 | 300 | 0.7037 | -102.4820 | -2.0313 | 0.7119 | 0.7119 | 0.7119 | 0.5352 | 0.6030 | 0.5223 | 8.7956 |
| 0.4939 | 0.9920 | 350 | 0.6897 | -102.1435 | -1.9358 | 0.6916 | 0.6916 | 0.6916 | 0.5419 | 0.6030 | 0.5223 | 8.3961 |