Downloads · 30 days
6
11% of all-time downloads
YuchenLi01/generatedSoftQwen2.5MathPRM72BMoreNoGT_Qwen2.5-1.5BInstruct_dpo_ebs32_lr5e-07_beta0.4_42
generatedSoftQwen2.5MathPRM72BMoreNoGT_Qwen2.5-1.5BInstruct_dpo_ebs32_lr5e-07_beta0.4_42 is a text generation model from YuchenLi01. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
6
11% of all-time downloads
All-time downloads
57
Public
Parameters
1.5B
21.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.1 GB · 99%
From the Hugging Face model README
This model is a fine-tuned version of Qwen/Qwen2.5-1.5B-Instruct on the YuchenLi01/MATH_Qwen2.5-1.5BInstruct_Soft_DPO_Qwen2.5MathPRM72B_MoreNoGT dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.7033 | 0.0151 | 20 | 0.7003 | 0.0046 | -0.0023 | 0.4966 | 0.0069 | -45.6971 | -39.3432 | -2.2676 | -2.3744 |
| 0.7182 | 0.0302 | 40 | 0.6980 | -0.0061 | -0.0025 | 0.5034 | -0.0036 | -45.6976 | -39.3699 | -2.2655 | -2.3719 |
| 0.7255 | 0.0453 | 60 | 0.6940 | -0.0081 | -0.0127 | 0.5 | 0.0046 | -45.7231 | -39.3750 | -2.2628 | -2.3692 |
| 0.6908 | 0.0604 | 80 | 0.6946 | -0.0328 | -0.0406 | 0.5169 | 0.0077 | -45.7927 | -39.4367 | -2.2570 | -2.3636 |
| 0.6945 | 0.0755 | 100 | 0.6905 | -0.0700 | -0.0781 | 0.5135 | 0.0081 | -45.8866 | -39.5297 | -2.2510 | -2.3579 |
| 0.6633 | 0.0906 | 120 | 0.6791 | -0.1371 | -0.1833 | 0.5743 | 0.0462 | -46.1496 | -39.6973 | -2.2375 | -2.3456 |
| 0.6783 | 0.1057 | 140 | 0.6685 | -0.2414 | -0.2990 | 0.5709 | 0.0576 | -46.4390 | -39.9582 | -2.2215 | -2.3309 |
| 0.6663 | 0.1208 | 160 | 0.6600 | -0.3085 | -0.4138 | 0.6182 | 0.1053 | -46.7258 | -40.1259 | -2.2090 | -2.3198 |
| 0.6267 | 0.1360 | 180 | 0.6494 | -0.3873 | -0.5245 | 0.625 | 0.1372 | -47.0026 | -40.3228 | -2.1959 | -2.3083 |
| 0.6675 | 0.1511 | 200 | 0.6408 | -0.3742 | -0.5414 | 0.6723 | 0.1673 | -47.0449 | -40.2901 | -2.1975 | -2.3108 |
| 0.5976 | 0.1662 | 220 | 0.6360 | -0.3183 | -0.4938 | 0.6284 | 0.1754 | -46.9258 | -40.1505 | -2.2149 | -2.3297 |
| 0.6237 | 0.1813 | 240 | 0.6289 | -0.2506 | -0.4531 | 0.6385 | 0.2025 | -46.8240 | -39.9812 | -2.2239 | -2.3386 |
| 0.6652 | 0.1964 | 260 | 0.6242 | -0.2810 | -0.4885 | 0.6554 | 0.2076 | -46.9127 | -40.0571 | -2.2303 | -2.3465 |
| 0.5528 | 0.2115 | 280 | 0.6190 | -0.2905 | -0.5201 | 0.6453 | 0.2296 | -46.9915 | -40.0808 | -2.2328 | -2.3502 |
| 0.5824 | 0.2266 | 300 | 0.6137 | -0.2687 | -0.5307 | 0.6723 | 0.2620 | -47.0181 | -40.0265 | -2.2371 | -2.3558 |
| 0.6621 | 0.2417 | 320 | 0.6086 | -0.2982 | -0.6178 | 0.6791 | 0.3197 | -47.2359 | -40.1001 | -2.2366 | -2.3565 |
| 0.5479 | 0.2568 | 340 | 0.6053 | -0.2955 | -0.6115 | 0.6689 | 0.3161 | -47.2202 | -40.0933 | -2.2425 | -2.3627 |
| 0.5145 | 0.2719 | 360 | 0.6002 | -0.3154 | -0.6574 | 0.6655 | 0.3420 | -47.3349 | -40.1432 | -2.2457 | -2.3675 |
| 0.573 | 0.2870 | 380 | 0.5934 | -0.3112 | -0.6809 | 0.6689 | 0.3697 | -47.3935 | -40.1326 | -2.2511 | -2.3735 |
| 0.581 | 0.3021 | 400 | 0.5924 | -0.2674 | -0.6619 | 0.6926 | 0.3945 | -47.3461 | -40.0231 | -2.2569 | -2.3795 |
| 0.6143 | 0.3172 | 420 | 0.5832 | -0.2503 | -0.6633 | 0.6824 | 0.4130 | -47.3496 | -39.9805 | -2.2662 | -2.3895 |
| 0.5916 | 0.3323 | 440 | 0.5788 | -0.3041 | -0.7508 | 0.6926 | 0.4466 | -47.5683 | -40.1150 | -2.2576 | -2.3808 |
| 0.5879 | 0.3474 | 460 | 0.5775 | -0.3086 | -0.7588 | 0.6757 | 0.4502 | -47.5884 | -40.1260 | -2.2511 | -2.3746 |
| 0.5115 | 0.3625 | 480 | 0.5757 | -0.3601 | -0.8423 | 0.6892 | 0.4822 | -47.7972 | -40.2549 | -2.2422 | -2.3660 |
| 0.6289 | 0.3776 | 500 | 0.5724 | -0.3753 | -0.8725 | 0.6892 | 0.4972 | -47.8726 | -40.2928 | -2.2424 | -2.3676 |
| 0.5719 | 0.3927 | 520 | 0.5671 | -0.3709 | -0.9016 | 0.6993 | 0.5307 | -47.9453 | -40.2819 | -2.2382 | -2.3638 |
| 0.6288 | 0.4079 | 540 | 0.5665 | -0.2982 | -0.8504 | 0.6959 | 0.5523 | -47.8175 | -40.1001 | -2.2548 | -2.3808 |
| 0.5127 | 0.4230 | 560 | 0.5637 | -0.3104 | -0.8975 | 0.7027 | 0.5871 | -47.9352 | -40.1307 | -2.2563 | -2.3827 |
| 0.4284 | 0.4381 | 580 | 0.5600 | -0.3551 | -0.9401 | 0.7027 | 0.5850 | -48.0417 | -40.2425 | -2.2512 | -2.3781 |
| 0.5243 | 0.4532 | 600 | 0.5551 | -0.3152 | -0.9416 | 0.6926 | 0.6264 | -48.0454 | -40.1427 | -2.2581 | -2.3851 |
| 0.6616 | 0.4683 | 620 | 0.5541 | -0.3150 | -0.9392 | 0.7027 | 0.6242 | -48.0394 | -40.1422 | -2.2611 | -2.3884 |
| 0.6297 | 0.4834 | 640 | 0.5525 | -0.2586 | -0.9025 | 0.7196 | 0.6438 | -47.9475 | -40.0012 | -2.2740 | -2.4016 |
| 0.6808 | 0.4985 | 660 | 0.5502 | -0.2965 | -0.9631 | 0.6926 | 0.6666 | -48.0990 | -40.0959 | -2.2628 | -2.3909 |
| 0.5353 | 0.5136 | 680 | 0.5486 | -0.3485 | -1.0023 | 0.7095 | 0.6538 | -48.1972 | -40.2259 | -2.2587 | -2.3874 |
| 0.539 | 0.5287 | 700 | 0.5476 | -0.3661 | -1.0367 | 0.6993 | 0.6706 | -48.2830 | -40.2698 | -2.2585 | -2.3881 |
| 0.4013 | 0.5438 | 720 | 0.5453 | -0.4023 | -1.0902 | 0.7128 | 0.6879 | -48.4169 | -40.3604 | -2.2498 | -2.3791 |
| 0.5562 | 0.5589 | 740 | 0.5415 | -0.3945 | -1.0905 | 0.7095 | 0.6961 | -48.4177 | -40.3408 | -2.2523 | -2.3813 |
| 0.5544 | 0.5740 | 760 | 0.5409 | -0.4088 | -1.1076 | 0.6959 | 0.6988 | -48.4604 | -40.3767 | -2.2470 | -2.3766 |
| 0.5809 | 0.5891 | 780 | 0.5417 | -0.4001 | -1.1025 | 0.7027 | 0.7024 | -48.4477 | -40.3549 | -2.2540 | -2.3846 |
| 0.397 | 0.6042 | 800 | 0.5393 | -0.3618 | -1.0662 | 0.6959 | 0.7043 | -48.3568 | -40.2592 | -2.2517 | -2.3817 |
| 0.4548 | 0.6193 | 820 | 0.5381 | -0.3309 | -1.0533 | 0.6892 | 0.7224 | -48.3246 | -40.1819 | -2.2600 | -2.3907 |
| 0.525 | 0.6344 | 840 | 0.5369 | -0.2863 | -1.0185 | 0.7230 | 0.7322 | -48.2376 | -40.0704 | -2.2652 | -2.3957 |
| 0.5139 | 0.6495 | 860 | 0.5349 | -0.2988 | -1.0277 | 0.7128 | 0.7289 | -48.2607 | -40.1016 | -2.2740 | -2.4050 |
| 0.4067 | 0.6647 | 880 | 0.5363 | -0.3147 | -1.0460 | 0.7128 | 0.7313 | -48.3063 | -40.1413 | -2.2735 | -2.4051 |
| 0.4624 | 0.6798 | 900 | 0.5326 | -0.2782 | -1.0348 | 0.7162 | 0.7566 | -48.2783 | -40.0501 | -2.2769 | -2.4084 |
| 0.5342 | 0.6949 | 920 | 0.5343 | -0.2946 | -1.0345 | 0.7128 | 0.7398 | -48.2775 | -40.0912 | -2.2722 | -2.4030 |
| 0.4489 | 0.7100 | 940 | 0.5334 | -0.2873 | -1.0315 | 0.7095 | 0.7441 | -48.2700 | -40.0729 | -2.2758 | -2.4068 |
| 0.584 | 0.7251 | 960 | 0.5308 | -0.2673 | -1.0195 | 0.7264 | 0.7522 | -48.2401 | -40.0229 | -2.2776 | -2.4089 |
| 0.3874 | 0.7402 | 980 | 0.5320 | -0.2839 | -1.0383 | 0.7128 | 0.7543 | -48.2870 | -40.0645 | -2.2774 | -2.4087 |
| 0.936 | 0.7553 | 1000 | 0.5300 | -0.2841 | -1.0540 | 0.7128 | 0.7699 | -48.3263 | -40.0649 | -2.2778 | -2.4089 |
| 0.4904 | 0.7704 | 1020 | 0.5288 | -0.2762 | -1.0422 | 0.7095 | 0.7660 | -48.2968 | -40.0452 | -2.2794 | -2.4103 |
| 0.5106 | 0.7855 | 1040 | 0.5268 | -0.2817 | -1.0518 | 0.7162 | 0.7701 | -48.3209 | -40.0589 | -2.2784 | -2.4093 |
| 0.4281 | 0.8006 | 1060 | 0.5280 | -0.2981 | -1.0670 | 0.7230 | 0.7689 | -48.3589 | -40.0998 | -2.2753 | -2.4065 |
| 0.4574 | 0.8157 | 1080 | 0.5280 | -0.3024 | -1.0718 | 0.7297 | 0.7695 | -48.3710 | -40.1106 | -2.2786 | -2.4098 |
| 0.6234 | 0.8308 | 1100 | 0.5273 | -0.3079 | -1.0759 | 0.7128 | 0.7679 | -48.3810 | -40.1245 | -2.2720 | -2.4032 |
| 0.4874 | 0.8459 | 1120 | 0.5269 | -0.3017 | -1.0821 | 0.7061 | 0.7804 | -48.3966 | -40.1090 | -2.2717 | -2.4026 |
| 0.6614 | 0.8610 | 1140 | 0.5244 | -0.3120 | -1.0845 | 0.7162 | 0.7725 | -48.4026 | -40.1346 | -2.2769 | -2.4080 |
| 0.5131 | 0.8761 | 1160 | 0.5271 | -0.3124 | -1.0878 | 0.6993 | 0.7755 | -48.4110 | -40.1356 | -2.2775 | -2.4090 |
| 0.799 | 0.8912 | 1180 | 0.5268 | -0.3164 | -1.0867 | 0.7196 | 0.7702 | -48.4080 | -40.1458 | -2.2746 | -2.4057 |
| 0.6439 | 0.9063 | 1200 | 0.5277 | -0.3064 | -1.0850 | 0.7162 | 0.7786 | -48.4037 | -40.1205 | -2.2754 | -2.4067 |
| 0.5469 | 0.9215 | 1220 | 0.5252 | -0.3056 | -1.0953 | 0.7196 | 0.7897 | -48.4295 | -40.1186 | -2.2754 | -2.4069 |
| 0.4788 | 0.9366 | 1240 | 0.5271 | -0.3270 | -1.0834 | 0.7095 | 0.7564 | -48.3999 | -40.1722 | -2.2733 | -2.4042 |
| 0.5101 | 0.9517 | 1260 | 0.5239 | -0.2998 | -1.0810 | 0.7196 | 0.7811 | -48.3937 | -40.1042 | -2.2737 | -2.4045 |
| 0.5103 | 0.9668 | 1280 | 0.5241 | -0.3124 | -1.0873 | 0.7264 | 0.7749 | -48.4095 | -40.1356 | -2.2737 | -2.4047 |
| 0.5847 | 0.9819 | 1300 | 0.5244 | -0.3142 | -1.0984 | 0.7196 | 0.7842 | -48.4373 | -40.1401 | -2.2737 | -2.4046 |
| 0.6099 | 0.9970 | 1320 | 0.5251 | -0.3061 | -1.0845 | 0.7128 | 0.7784 | -48.4025 | -40.1199 | -2.2745 | -2.4056 |