Downloads · 30 days
12
11% of all-time downloads
YuchenLi01/generatedSoftQwen2.5MathRM72Bth0.5pair4NoGT_Qwen2.5-1.5BInstruct_dpo_ebs32_lr5e-07_beta1.5_42
generatedSoftQwen2.5MathRM72Bth0.5pair4NoGT_Qwen2.5-1.5BInstruct_dpo_ebs32_lr5e-07_beta1.5_42 is a text generation model from YuchenLi01. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
12
11% of all-time downloads
All-time downloads
113
Public
Parameters
1.5B
12.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.1 GB · 99%
From the Hugging Face model README
This model is a fine-tuned version of Qwen/Qwen2.5-1.5B-Instruct on the YuchenLi01/MATH_Qwen2.5-1.5BInstruct_Soft_DPO_Qwen2.5MathRM72B_th0.5_pair4NoGT dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.7925 | 0.0287 | 20 | 0.7479 | -0.0243 | -0.0303 | 0.4817 | 0.0060 | -47.5059 | -37.3214 | -2.1660 | -2.3070 |
| 0.7551 | 0.0573 | 40 | 0.7564 | -0.0200 | -0.0526 | 0.5549 | 0.0326 | -47.5207 | -37.3185 | -2.1631 | -2.3033 |
| 0.6397 | 0.0860 | 60 | 0.7312 | -0.1018 | -0.1506 | 0.5427 | 0.0488 | -47.5861 | -37.3731 | -2.1588 | -2.2989 |
| 0.7048 | 0.1146 | 80 | 0.6988 | -0.0202 | -0.1872 | 0.5793 | 0.1670 | -47.6105 | -37.3186 | -2.1685 | -2.3109 |
| 0.5828 | 0.1433 | 100 | 0.6774 | -0.0316 | -0.1670 | 0.5610 | 0.1354 | -47.5970 | -37.3262 | -2.1667 | -2.3090 |
| 0.741 | 0.1719 | 120 | 0.6519 | 0.0279 | -0.3657 | 0.6220 | 0.3936 | -47.7295 | -37.2866 | -2.1696 | -2.3137 |
| 0.6694 | 0.2006 | 140 | 0.6418 | 0.1229 | -0.3234 | 0.6890 | 0.4462 | -47.7013 | -37.2233 | -2.1703 | -2.3148 |
| 0.5577 | 0.2292 | 160 | 0.6455 | 0.0912 | -0.4653 | 0.6890 | 0.5564 | -47.7959 | -37.2444 | -2.1748 | -2.3205 |
| 0.6467 | 0.2579 | 180 | 0.6139 | 0.2052 | -0.3274 | 0.7012 | 0.5326 | -47.7039 | -37.1684 | -2.1798 | -2.3269 |
| 0.6865 | 0.2865 | 200 | 0.6292 | 0.2555 | -0.3161 | 0.6463 | 0.5716 | -47.6964 | -37.1348 | -2.1842 | -2.3320 |
| 0.5909 | 0.3152 | 220 | 0.6153 | 0.0174 | -0.6073 | 0.6585 | 0.6248 | -47.8906 | -37.2936 | -2.1681 | -2.3167 |
| 0.7063 | 0.3438 | 240 | 0.6213 | -0.1507 | -0.7479 | 0.6585 | 0.5972 | -47.9843 | -37.4057 | -2.1580 | -2.3066 |
| 0.7565 | 0.3725 | 260 | 0.6241 | 0.0455 | -0.6892 | 0.6829 | 0.7347 | -47.9451 | -37.2748 | -2.1657 | -2.3156 |
| 0.6681 | 0.4011 | 280 | 0.6108 | 0.1455 | -0.5807 | 0.6829 | 0.7262 | -47.8728 | -37.2082 | -2.1665 | -2.3168 |
| 0.5876 | 0.4298 | 300 | 0.6114 | 0.0983 | -0.5400 | 0.6646 | 0.6382 | -47.8457 | -37.2397 | -2.1741 | -2.3259 |
| 0.7059 | 0.4585 | 320 | 0.6047 | 0.0382 | -0.7097 | 0.6890 | 0.7479 | -47.9588 | -37.2797 | -2.1629 | -2.3133 |
| 0.6021 | 0.4871 | 340 | 0.6202 | 0.0555 | -0.7724 | 0.7073 | 0.8280 | -48.0006 | -37.2682 | -2.1644 | -2.3158 |
| 0.5708 | 0.5158 | 360 | 0.6076 | 0.1324 | -0.5942 | 0.6707 | 0.7266 | -47.8818 | -37.2170 | -2.1689 | -2.3200 |
| 0.5523 | 0.5444 | 380 | 0.6120 | 0.1938 | -0.6275 | 0.7073 | 0.8213 | -47.9040 | -37.1760 | -2.1678 | -2.3184 |
| 0.8479 | 0.5731 | 400 | 0.5979 | 0.2950 | -0.5474 | 0.7073 | 0.8423 | -47.8506 | -37.1086 | -2.1809 | -2.3331 |
| 0.8039 | 0.6017 | 420 | 0.6104 | 0.2868 | -0.5889 | 0.6951 | 0.8756 | -47.8783 | -37.1140 | -2.1776 | -2.3291 |
| 0.5752 | 0.6304 | 440 | 0.5963 | 0.3108 | -0.5117 | 0.7012 | 0.8225 | -47.8268 | -37.0980 | -2.1749 | -2.3258 |
| 0.5337 | 0.6590 | 460 | 0.6011 | 0.3224 | -0.5141 | 0.6951 | 0.8365 | -47.8284 | -37.0903 | -2.1821 | -2.3341 |
| 0.597 | 0.6877 | 480 | 0.6051 | 0.3016 | -0.4973 | 0.7012 | 0.7989 | -47.8172 | -37.1041 | -2.1797 | -2.3314 |
| 0.6255 | 0.7163 | 500 | 0.5997 | 0.3201 | -0.5827 | 0.7134 | 0.9028 | -47.8741 | -37.0918 | -2.1707 | -2.3214 |
| 0.6337 | 0.7450 | 520 | 0.5977 | 0.2967 | -0.5270 | 0.7378 | 0.8238 | -47.8370 | -37.1074 | -2.1773 | -2.3289 |
| 0.493 | 0.7736 | 540 | 0.5949 | 0.3696 | -0.4880 | 0.6890 | 0.8576 | -47.8110 | -37.0588 | -2.1737 | -2.3252 |
| 0.7694 | 0.8023 | 560 | 0.6014 | 0.3068 | -0.4593 | 0.6768 | 0.7661 | -47.7919 | -37.1007 | -2.1781 | -2.3298 |
| 0.6091 | 0.8309 | 580 | 0.6049 | 0.2684 | -0.5330 | 0.6768 | 0.8013 | -47.8410 | -37.1263 | -2.1741 | -2.3262 |
| 0.5935 | 0.8596 | 600 | 0.5873 | 0.3368 | -0.5813 | 0.7012 | 0.9181 | -47.8732 | -37.0807 | -2.1785 | -2.3314 |
| 0.6741 | 0.8883 | 620 | 0.5997 | 0.3136 | -0.5989 | 0.7073 | 0.9125 | -47.8849 | -37.0961 | -2.1720 | -2.3232 |
| 0.7467 | 0.9169 | 640 | 0.5937 | 0.3441 | -0.5028 | 0.7012 | 0.8469 | -47.8209 | -37.0758 | -2.1752 | -2.3268 |
| 0.6389 | 0.9456 | 660 | 0.5962 | 0.2512 | -0.6032 | 0.7073 | 0.8545 | -47.8878 | -37.1377 | -2.1732 | -2.3252 |
| 0.5792 | 0.9742 | 680 | 0.6060 | 0.2746 | -0.5718 | 0.6829 | 0.8464 | -47.8669 | -37.1221 | -2.1718 | -2.3237 |