Downloads · 30 days
9
15% of all-time downloads
YuchenLi01/generatedSoftQwen2.5MathRM72Bth0.5pair4NoGT_Qwen2.5-1.5BInstruct_dpo_ebs32_lr1e-07_beta0.9_42
generatedSoftQwen2.5MathRM72Bth0.5pair4NoGT_Qwen2.5-1.5BInstruct_dpo_ebs32_lr1e-07_beta0.9_42 is a text generation model from YuchenLi01. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
9
15% of all-time downloads
All-time downloads
60
Public
Parameters
1.5B
12.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.1 GB · 99%
From the Hugging Face model README
This model is a fine-tuned version of Qwen/Qwen2.5-1.5B-Instruct on the YuchenLi01/MATH_Qwen2.5-1.5BInstruct_Soft_DPO_Qwen2.5MathRM72B_th0.5_pair4NoGT dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.6753 | 0.0287 | 20 | 0.7224 | 0.0167 | -0.0118 | 0.5549 | 0.0285 | -47.4988 | -37.2866 | -2.1640 | -2.3048 |
| 0.7087 | 0.0573 | 40 | 0.7144 | -0.0326 | -0.0332 | 0.4878 | 0.0006 | -47.5225 | -37.3414 | -2.1649 | -2.3058 |
| 0.7332 | 0.0860 | 60 | 0.7159 | -0.0398 | -0.0125 | 0.4695 | -0.0273 | -47.4995 | -37.3494 | -2.1657 | -2.3063 |
| 0.6873 | 0.1146 | 80 | 0.7101 | -0.0197 | -0.0370 | 0.5244 | 0.0172 | -47.5267 | -37.3271 | -2.1654 | -2.3061 |
| 0.6902 | 0.1433 | 100 | 0.7010 | -0.0068 | -0.0061 | 0.4817 | -0.0007 | -47.4924 | -37.3128 | -2.1657 | -2.3061 |
| 0.6744 | 0.1719 | 120 | 0.7095 | -0.0160 | -0.0304 | 0.5183 | 0.0144 | -47.5195 | -37.3230 | -2.1595 | -2.2993 |
| 0.7775 | 0.2006 | 140 | 0.7024 | 0.0184 | -0.0632 | 0.5854 | 0.0817 | -47.5559 | -37.2847 | -2.1626 | -2.3026 |
| 0.6785 | 0.2292 | 160 | 0.7022 | -0.0076 | -0.0628 | 0.6098 | 0.0552 | -47.5555 | -37.3137 | -2.1672 | -2.3084 |
| 0.7216 | 0.2579 | 180 | 0.6993 | -0.0048 | -0.0503 | 0.5366 | 0.0455 | -47.5416 | -37.3106 | -2.1661 | -2.3069 |
| 0.6791 | 0.2865 | 200 | 0.6975 | -0.0024 | -0.0326 | 0.5488 | 0.0302 | -47.5219 | -37.3078 | -2.1716 | -2.3137 |
| 0.7469 | 0.3152 | 220 | 0.6902 | 0.0024 | -0.0493 | 0.5244 | 0.0518 | -47.5405 | -37.3025 | -2.1647 | -2.3057 |
| 0.7663 | 0.3438 | 240 | 0.6940 | -0.0133 | -0.0739 | 0.5366 | 0.0606 | -47.5679 | -37.3200 | -2.1629 | -2.3044 |
| 0.7391 | 0.3725 | 260 | 0.6876 | -0.0453 | -0.0940 | 0.5549 | 0.0487 | -47.5901 | -37.3555 | -2.1601 | -2.3012 |
| 0.7087 | 0.4011 | 280 | 0.6867 | -0.0181 | -0.1061 | 0.5732 | 0.0880 | -47.6035 | -37.3253 | -2.1568 | -2.2975 |
| 0.6278 | 0.4298 | 300 | 0.6851 | -0.0785 | -0.1145 | 0.5732 | 0.0360 | -47.6129 | -37.3924 | -2.1580 | -2.2992 |
| 0.6686 | 0.4585 | 320 | 0.6774 | -0.0998 | -0.1811 | 0.5793 | 0.0813 | -47.6869 | -37.4161 | -2.1584 | -2.2999 |
| 0.6847 | 0.4871 | 340 | 0.6794 | -0.0856 | -0.1863 | 0.6098 | 0.1007 | -47.6927 | -37.4003 | -2.1616 | -2.3043 |
| 0.6087 | 0.5158 | 360 | 0.6842 | -0.0985 | -0.1984 | 0.5854 | 0.1000 | -47.7062 | -37.4146 | -2.1544 | -2.2964 |
| 0.7111 | 0.5444 | 380 | 0.6766 | -0.0900 | -0.2100 | 0.6220 | 0.1200 | -47.7190 | -37.4051 | -2.1535 | -2.2948 |
| 0.7064 | 0.5731 | 400 | 0.6786 | -0.0935 | -0.2192 | 0.6037 | 0.1257 | -47.7293 | -37.4091 | -2.1564 | -2.2983 |
| 0.7012 | 0.6017 | 420 | 0.6716 | -0.0944 | -0.2105 | 0.5305 | 0.1162 | -47.7196 | -37.4100 | -2.1614 | -2.3044 |
| 0.6687 | 0.6304 | 440 | 0.6637 | -0.1026 | -0.2058 | 0.5915 | 0.1033 | -47.7144 | -37.4191 | -2.1597 | -2.3027 |
| 0.6781 | 0.6590 | 460 | 0.6714 | -0.0944 | -0.2301 | 0.6098 | 0.1357 | -47.7414 | -37.4101 | -2.1591 | -2.3015 |
| 0.638 | 0.6877 | 480 | 0.6666 | -0.0969 | -0.2443 | 0.6585 | 0.1475 | -47.7572 | -37.4128 | -2.1513 | -2.2931 |
| 0.6373 | 0.7163 | 500 | 0.6681 | -0.1242 | -0.2144 | 0.5793 | 0.0902 | -47.7239 | -37.4432 | -2.1595 | -2.3023 |
| 0.6619 | 0.7450 | 520 | 0.6674 | -0.1092 | -0.1900 | 0.5610 | 0.0808 | -47.6968 | -37.4266 | -2.1591 | -2.3019 |
| 0.6416 | 0.7736 | 540 | 0.6615 | -0.0805 | -0.2083 | 0.6280 | 0.1278 | -47.7171 | -37.3946 | -2.1540 | -2.2960 |
| 0.7249 | 0.8023 | 560 | 0.6685 | -0.0840 | -0.2232 | 0.6098 | 0.1393 | -47.7337 | -37.3985 | -2.1646 | -2.3089 |
| 0.5748 | 0.8309 | 580 | 0.6580 | -0.0920 | -0.2867 | 0.6341 | 0.1947 | -47.8043 | -37.4074 | -2.1573 | -2.3007 |
| 0.688 | 0.8596 | 600 | 0.6655 | -0.1084 | -0.2640 | 0.6280 | 0.1556 | -47.7790 | -37.4256 | -2.1543 | -2.2971 |
| 0.6646 | 0.8883 | 620 | 0.6602 | -0.0985 | -0.2408 | 0.5854 | 0.1423 | -47.7533 | -37.4146 | -2.1551 | -2.2976 |
| 0.749 | 0.9169 | 640 | 0.6720 | -0.1231 | -0.2331 | 0.5488 | 0.1100 | -47.7447 | -37.4420 | -2.1614 | -2.3053 |
| 0.6976 | 0.9456 | 660 | 0.6632 | -0.0726 | -0.2180 | 0.5793 | 0.1455 | -47.7279 | -37.3858 | -2.1560 | -2.2988 |
| 0.6452 | 0.9742 | 680 | 0.6678 | -0.1067 | -0.2159 | 0.5915 | 0.1092 | -47.7256 | -37.4237 | -2.1592 | -2.3026 |