Downloads · 30 days
8
11% of all-time downloads
YuchenLi01/generatedSoftQwen2.5MathRM72Bth0.5pair4NoGT_Qwen2.5-1.5BInstruct_dpo_ebs32_lr1e-06_beta1.5_42
generatedSoftQwen2.5MathRM72Bth0.5pair4NoGT_Qwen2.5-1.5BInstruct_dpo_ebs32_lr1e-06_beta1.5_42 is a text generation model from YuchenLi01. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
8
11% of all-time downloads
All-time downloads
70
Public
Parameters
1.5B
12.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.1 GB · 99%
From the Hugging Face model README
This model is a fine-tuned version of Qwen/Qwen2.5-1.5B-Instruct on the YuchenLi01/MATH_Qwen2.5-1.5BInstruct_Soft_DPO_Qwen2.5MathRM72B_th0.5_pair4NoGT dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.7857 | 0.0287 | 20 | 0.7730 | -0.0254 | 0.0161 | 0.4573 | -0.0415 | -47.5090 | -37.3075 | -2.1620 | -2.3022 |
| 0.754 | 0.0573 | 40 | 0.7500 | -0.0784 | -0.0940 | 0.4634 | 0.0156 | -47.5824 | -37.3428 | -2.1620 | -2.3031 |
| 0.6401 | 0.0860 | 60 | 0.7003 | -0.0309 | -0.1976 | 0.5549 | 0.1667 | -47.6515 | -37.3112 | -2.1634 | -2.3050 |
| 0.6033 | 0.1146 | 80 | 0.6599 | 0.0487 | -0.3326 | 0.6463 | 0.3813 | -47.7414 | -37.2581 | -2.1808 | -2.3259 |
| 0.5485 | 0.1433 | 100 | 0.6604 | 0.3201 | -0.1418 | 0.6524 | 0.4618 | -47.6142 | -37.0772 | -2.1861 | -2.3316 |
| 0.5212 | 0.1719 | 120 | 0.6580 | 0.1918 | -0.4709 | 0.6646 | 0.6627 | -47.8337 | -37.1627 | -2.1868 | -2.3358 |
| 0.6509 | 0.2006 | 140 | 0.6540 | 0.3420 | -0.4621 | 0.7073 | 0.8041 | -47.8277 | -37.0626 | -2.1926 | -2.3422 |
| 0.6996 | 0.2292 | 160 | 0.6515 | -0.1797 | -1.1073 | 0.7195 | 0.9276 | -48.2579 | -37.4104 | -2.1657 | -2.3162 |
| 0.5452 | 0.2579 | 180 | 0.6479 | 0.2192 | -0.7485 | 0.7134 | 0.9677 | -48.0187 | -37.1444 | -2.1890 | -2.3413 |
| 0.8415 | 0.2865 | 200 | 0.6617 | 0.3444 | -0.6019 | 0.6951 | 0.9464 | -47.9210 | -37.0609 | -2.1997 | -2.3532 |
| 0.5955 | 0.3152 | 220 | 0.6693 | -0.4383 | -1.3724 | 0.7317 | 0.9340 | -48.4346 | -37.5828 | -2.1521 | -2.3058 |
| 0.4975 | 0.3438 | 240 | 0.6795 | -0.6168 | -1.6937 | 0.7134 | 1.0769 | -48.6488 | -37.7018 | -2.1452 | -2.2997 |
| 0.9274 | 0.3725 | 260 | 0.6697 | 0.2241 | -0.8122 | 0.6890 | 1.0363 | -48.0612 | -37.1412 | -2.1788 | -2.3349 |
| 0.7342 | 0.4011 | 280 | 0.6604 | -0.0125 | -0.9373 | 0.6646 | 0.9248 | -48.1445 | -37.2989 | -2.1682 | -2.3244 |
| 0.761 | 0.4298 | 300 | 0.6585 | -0.2293 | -1.3096 | 0.6707 | 1.0803 | -48.3927 | -37.4434 | -2.1593 | -2.3168 |
| 0.7153 | 0.4585 | 320 | 0.6539 | -0.1530 | -1.4194 | 0.7378 | 1.2663 | -48.4660 | -37.3926 | -2.1610 | -2.3176 |
| 0.8464 | 0.4871 | 340 | 0.6518 | -0.0749 | -1.2749 | 0.7378 | 1.2000 | -48.3696 | -37.3405 | -2.1594 | -2.3156 |
| 0.7231 | 0.5158 | 360 | 0.6507 | 0.1713 | -1.0610 | 0.7134 | 1.2323 | -48.2270 | -37.1764 | -2.1744 | -2.3319 |
| 0.5431 | 0.5444 | 380 | 0.6530 | 0.2333 | -1.1015 | 0.7439 | 1.3348 | -48.2541 | -37.1350 | -2.1784 | -2.3353 |
| 0.8668 | 0.5731 | 400 | 0.6531 | 0.4726 | -0.8368 | 0.7439 | 1.3095 | -48.0776 | -36.9755 | -2.1912 | -2.3481 |
| 0.8956 | 0.6017 | 420 | 0.6606 | 0.2692 | -1.0003 | 0.7073 | 1.2695 | -48.1866 | -37.1111 | -2.1855 | -2.3426 |
| 0.7418 | 0.6304 | 440 | 0.6367 | 0.4000 | -0.9216 | 0.7256 | 1.3216 | -48.1341 | -37.0239 | -2.1876 | -2.3444 |
| 0.5725 | 0.6590 | 460 | 0.6360 | 0.3063 | -0.9173 | 0.7256 | 1.2236 | -48.1312 | -37.0864 | -2.1835 | -2.3409 |
| 0.8224 | 0.6877 | 480 | 0.6382 | 0.2549 | -0.9561 | 0.7195 | 1.2110 | -48.1571 | -37.1206 | -2.1743 | -2.3303 |
| 0.7215 | 0.7163 | 500 | 0.6314 | 0.1521 | -1.1189 | 0.6951 | 1.2710 | -48.2657 | -37.1892 | -2.1737 | -2.3304 |
| 0.6525 | 0.7450 | 520 | 0.6396 | 0.2025 | -0.9892 | 0.75 | 1.1918 | -48.1792 | -37.1556 | -2.1770 | -2.3338 |
| 0.6595 | 0.7736 | 540 | 0.6396 | 0.1156 | -1.0422 | 0.7012 | 1.1578 | -48.2145 | -37.2135 | -2.1696 | -2.3266 |
| 0.9259 | 0.8023 | 560 | 0.6359 | 0.0387 | -1.1889 | 0.7256 | 1.2276 | -48.3123 | -37.2648 | -2.1645 | -2.3211 |
| 0.7536 | 0.8309 | 580 | 0.6472 | -0.0399 | -1.2274 | 0.7012 | 1.1875 | -48.3380 | -37.3172 | -2.1685 | -2.3267 |
| 0.5473 | 0.8596 | 600 | 0.6344 | -0.1490 | -1.3048 | 0.7073 | 1.1558 | -48.3895 | -37.3899 | -2.1566 | -2.3135 |
| 0.6837 | 0.8883 | 620 | 0.6437 | -0.1367 | -1.3381 | 0.6890 | 1.2014 | -48.4118 | -37.3817 | -2.1589 | -2.3156 |
| 0.8114 | 0.9169 | 640 | 0.6238 | -0.1124 | -1.2500 | 0.7073 | 1.1377 | -48.3531 | -37.3655 | -2.1563 | -2.3134 |
| 0.6425 | 0.9456 | 660 | 0.6270 | -0.0254 | -1.3102 | 0.7134 | 1.2848 | -48.3931 | -37.3075 | -2.1679 | -2.3261 |
| 0.5297 | 0.9742 | 680 | 0.6459 | 0.0089 | -1.2548 | 0.7134 | 1.2637 | -48.3562 | -37.2846 | -2.1671 | -2.3251 |