Downloads · 30 days
8
14% of all-time downloads
YuchenLi01/generatedSoftQwen2.5MathRM72Bth0.5pair4NoGT_Qwen2.5-1.5BInstruct_dpo_ebs32_lr1e-07_beta0.4_42
generatedSoftQwen2.5MathRM72Bth0.5pair4NoGT_Qwen2.5-1.5BInstruct_dpo_ebs32_lr1e-07_beta0.4_42 is a text generation model from YuchenLi01. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
8
14% of all-time downloads
All-time downloads
57
Public
Parameters
1.5B
12.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.1 GB · 99%
From the Hugging Face model README
This model is a fine-tuned version of Qwen/Qwen2.5-1.5B-Instruct on the YuchenLi01/MATH_Qwen2.5-1.5BInstruct_Soft_DPO_Qwen2.5MathRM72B_th0.5_pair4NoGT dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Logits/chosen | Logits/rejected | Logps/chosen | Logps/rejected | Validation Loss | Rewards/accuracies | Rewards/chosen | Rewards/margins | Rewards/rejected |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.6951 | 0.0287 | 20 | -2.3018 | -2.1613 | -37.3107 | -47.5347 | 0.6997 | 0.4939 | -0.0081 | -0.0021 | -0.0060 |
| 0.6687 | 0.0573 | 40 | -2.3011 | -2.1612 | -37.3262 | -47.5249 | 0.6976 | 0.4878 | -0.0143 | -0.0122 | -0.0021 |
| 0.7009 | 0.0860 | 60 | -2.3005 | -2.1606 | -37.2829 | -47.4900 | 0.6989 | 0.4939 | 0.0031 | -0.0088 | 0.0119 |
| 0.7068 | 0.1146 | 80 | -2.3008 | -2.1606 | -37.3283 | -47.5281 | 0.6971 | 0.4634 | -0.0151 | -0.0117 | -0.0034 |
| 0.6983 | 0.1433 | 100 | -2.2998 | -2.1602 | -37.2790 | -47.4977 | 0.6954 | 0.4878 | 0.0046 | -0.0042 | 0.0088 |
| 0.6704 | 0.1719 | 120 | -2.3032 | -2.1630 | -37.2967 | -47.5195 | 0.6962 | 0.4512 | -0.0024 | -0.0025 | 0.0001 |
| 0.7039 | 0.2006 | 140 | -2.3015 | -2.1617 | -37.3151 | -47.4707 | 0.6984 | 0.4390 | -0.0098 | -0.0294 | 0.0196 |
| 0.7106 | 0.2292 | 160 | -2.3004 | -2.1600 | -37.3092 | -47.5093 | 0.6947 | 0.4451 | -0.0075 | -0.0116 | 0.0042 |
| 0.6997 | 0.2579 | 180 | -2.3030 | -2.1622 | -37.2972 | -47.5294 | 0.6935 | 0.5122 | -0.0027 | 0.0012 | -0.0039 |
| 0.7218 | 0.2865 | 200 | -2.3052 | -2.1647 | -37.2818 | -47.5453 | 0.6908 | 0.5061 | 0.0035 | 0.0137 | -0.0102 |
| 0.6928 | 0.3152 | 220 | 0.6858 | 0.0093 | -0.0170 | 0.5427 | 0.0263 | -47.5622 | -37.2673 | -2.1630 | -2.3039 |
| 0.6624 | 0.3438 | 240 | 0.6891 | -0.0226 | -0.0193 | 0.5061 | -0.0033 | -47.5680 | -37.3471 | -2.1647 | -2.3067 |
| 0.7147 | 0.3725 | 260 | 0.6869 | -0.0165 | -0.0277 | 0.5305 | 0.0111 | -47.5889 | -37.3319 | -2.1655 | -2.3069 |
| 0.7082 | 0.4011 | 280 | 0.6836 | -0.0127 | -0.0344 | 0.5610 | 0.0217 | -47.6057 | -37.3222 | -2.1576 | -2.2984 |
| 0.6911 | 0.4298 | 300 | 0.6817 | -0.0359 | -0.0548 | 0.5122 | 0.0189 | -47.6567 | -37.3803 | -2.1576 | -2.2993 |
| 0.6726 | 0.4585 | 320 | 0.6814 | -0.0292 | -0.0532 | 0.5183 | 0.0240 | -47.6526 | -37.3636 | -2.1595 | -2.3010 |
| 0.6824 | 0.4871 | 340 | 0.6771 | -0.0320 | -0.0868 | 0.6037 | 0.0548 | -47.7368 | -37.3705 | -2.1564 | -2.2984 |
| 0.697 | 0.5158 | 360 | 0.6819 | -0.0524 | -0.0799 | 0.5610 | 0.0275 | -47.7194 | -37.4216 | -2.1567 | -2.2986 |
| 0.6673 | 0.5444 | 380 | 0.6757 | -0.0706 | -0.0994 | 0.5488 | 0.0288 | -47.7682 | -37.4671 | -2.1541 | -2.2961 |
| 0.7216 | 0.5731 | 400 | 0.6746 | -0.0413 | -0.0978 | 0.5976 | 0.0565 | -47.7641 | -37.3938 | -2.1567 | -2.2987 |
| 0.6333 | 0.6017 | 420 | 0.6707 | -0.0650 | -0.1054 | 0.5549 | 0.0405 | -47.7833 | -37.4530 | -2.1556 | -2.2982 |
| 0.6684 | 0.6304 | 440 | 0.6757 | -0.0596 | -0.0964 | 0.5305 | 0.0368 | -47.7607 | -37.4395 | -2.1565 | -2.2992 |
| 0.6725 | 0.6590 | 460 | 0.6718 | -0.0467 | -0.1103 | 0.5976 | 0.0636 | -47.7954 | -37.4073 | -2.1602 | -2.3031 |
| 0.6679 | 0.6877 | 480 | 0.6743 | -0.0549 | -0.1192 | 0.5854 | 0.0643 | -47.8176 | -37.4277 | -2.1577 | -2.3012 |
| 0.6789 | 0.7163 | 500 | 0.6696 | -0.0523 | -0.1212 | 0.5915 | 0.0690 | -47.8228 | -37.4212 | -2.1638 | -2.3083 |
| 0.6619 | 0.7450 | 520 | 0.6690 | -0.0581 | -0.1227 | 0.5915 | 0.0646 | -47.8263 | -37.4358 | -2.1585 | -2.3013 |
| 0.6311 | 0.7736 | 540 | 0.6691 | -0.0646 | -0.1098 | 0.5793 | 0.0453 | -47.7943 | -37.4520 | -2.1587 | -2.3019 |
| 0.6912 | 0.8023 | 560 | 0.6717 | -0.0638 | -0.1111 | 0.5610 | 0.0473 | -47.7974 | -37.4501 | -2.1555 | -2.2981 |
| 0.6587 | 0.8309 | 580 | 0.6706 | -0.0536 | -0.1245 | 0.5915 | 0.0709 | -47.8309 | -37.4245 | -2.1588 | -2.3026 |
| 0.6628 | 0.8596 | 600 | 0.6693 | -0.0669 | -0.1096 | 0.5793 | 0.0427 | -47.7936 | -37.4578 | -2.1548 | -2.2974 |
| 0.6637 | 0.8883 | 620 | 0.6740 | -0.0616 | -0.1220 | 0.5488 | 0.0604 | -47.8246 | -37.4445 | -2.1579 | -2.3014 |
| 0.6381 | 0.9169 | 640 | 0.6689 | -0.0499 | -0.1074 | 0.5915 | 0.0575 | -47.7881 | -37.4152 | -2.1552 | -2.2975 |
| 0.6934 | 0.9456 | 660 | 0.6699 | -0.0674 | -0.1171 | 0.5854 | 0.0497 | -47.8125 | -37.4591 | -2.1580 | -2.3017 |
| 0.69 | 0.9742 | 680 | 0.6675 | -0.0555 | -0.1238 | 0.6159 | 0.0683 | -47.8293 | -37.4294 | -2.1568 | -2.2994 |