Downloads · 30 days
11
2% of all-time downloads
namezz/lvm-math-0402-a-qwen2.5-7b-instruct-b-qwen2.5-1.5b-instruct
lvm-math-0402-a-qwen2.5-7b-instruct-b-qwen2.5-1.5b-instruct is a text generation model from namezz. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
11
2% of all-time downloads
All-time downloads
514
Public
Parameters
1.5B
3.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.1 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of Qwen/Qwen2.5-1.5B-Instruct on the 7b_math_95k_16_train dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Token Mean Mae | Token Mean Relerr | Token Mean Rmse | Token Mean Seq Mean Mae | Token Mean Seq Mean Relerr | Token Mean Seq Mean Rmse |
|---|---|---|---|---|---|---|---|---|---|
| 0.0077 | 0.0337 | 50 | 0.0077 | 987642360.3538 | 0.3872 | 662927.6290 | 112437.8352 | 0.4125 | 4380.4839 |
| 0.0067 | 0.0675 | 100 | 0.0067 | 940136051.5484 | 0.3297 | 645687.0855 | 107039.8442 | 0.3374 | 4104.9607 |
| 0.0060 | 0.1012 | 150 | 0.0062 | 897576271.5326 | 0.3256 | 615063.0352 | 102123.7987 | 0.3406 | 3953.0738 |
| 0.0063 | 0.1350 | 200 | 0.0061 | 892034477.4310 | 0.3358 | 611980.7275 | 101443.7125 | 0.3529 | 3925.7777 |
| 0.0058 | 0.1687 | 250 | 0.0060 | 871536232.7564 | 0.3394 | 594117.3877 | 99173.7150 | 0.3621 | 3867.6651 |
| 0.0057 | 0.2025 | 300 | 0.0059 | 884873139.0324 | 0.3161 | 614297.6818 | 100571.4297 | 0.3275 | 3875.2859 |
| 0.0055 | 0.2362 | 350 | 0.0058 | 856431060.8396 | 0.3151 | 590158.3466 | 97374.1915 | 0.3279 | 3803.3827 |
| 0.0058 | 0.2700 | 400 | 0.0058 | 878555555.4488 | 0.3028 | 610017.5726 | 100042.0331 | 0.3073 | 3837.3734 |
| 0.0053 | 0.3037 | 450 | 0.0062 | 917637450.0879 | 0.2948 | 634813.8347 | 104482.7579 | 0.2906 | 3972.2672 |
| 0.0056 | 0.3374 | 500 | 0.0056 | 847559567.6143 | 0.3088 | 586356.7457 | 96408.4291 | 0.3228 | 3735.7527 |
| 0.0051 | 0.3712 | 550 | 0.0056 | 845039862.2596 | 0.3008 | 585666.6256 | 96030.8933 | 0.3124 | 3726.0601 |
| 0.0053 | 0.4049 | 600 | 0.0057 | 844112786.8500 | 0.3271 | 575769.2940 | 96047.1885 | 0.3508 | 3734.8805 |
| 0.0054 | 0.4387 | 650 | 0.0057 | 844032184.5695 | 0.3380 | 582320.0115 | 95705.2844 | 0.3582 | 3728.5648 |
| 0.0056 | 0.4724 | 700 | 0.0055 | 845084075.3658 | 0.2930 | 592126.3298 | 95881.3033 | 0.2996 | 3706.6844 |
| 0.0050 | 0.5062 | 750 | 0.0055 | 847773513.5452 | 0.2980 | 595337.7183 | 96093.6195 | 0.3084 | 3697.4997 |
| 0.0050 | 0.5399 | 800 | 0.0055 | 848515689.2646 | 0.2974 | 594078.3320 | 96340.6451 | 0.3075 | 3697.8672 |
| 0.0049 | 0.5737 | 850 | 0.0055 | 838509831.7130 | 0.3160 | 585433.2717 | 95016.1631 | 0.3326 | 3686.6064 |
| 0.0048 | 0.6074 | 900 | 0.0055 | 834035439.2688 | 0.3126 | 578941.1737 | 94686.4492 | 0.3303 | 3667.3715 |
| 0.0048 | 0.6411 | 950 | 0.0054 | 831834185.8293 | 0.2994 | 579299.9503 | 94580.5924 | 0.3100 | 3661.7944 |
| 0.0048 | 0.6749 | 1000 | 0.0054 | 825075980.8186 | 0.3031 | 569252.2283 | 93834.7155 | 0.3190 | 3662.2320 |
| 0.0050 | 0.7086 | 1050 | 0.0054 | 835341684.0127 | 0.2987 | 583695.2355 | 94850.7769 | 0.3141 | 3643.0350 |
| 0.0048 | 0.7424 | 1100 | 0.0054 | 825431297.6956 | 0.2987 | 574605.8951 | 93680.7515 | 0.3114 | 3643.7346 |
| 0.0046 | 0.7761 | 1150 | 0.0053 | 823065368.2300 | 0.2990 | 572995.7818 | 93528.1479 | 0.3129 | 3625.8153 |
| 0.0047 | 0.8099 | 1200 | 0.0053 | 826715561.5116 | 0.3030 | 576498.6306 | 93764.2539 | 0.3161 | 3626.1664 |
| 0.0045 | 0.8436 | 1250 | 0.0053 | 833226554.0372 | 0.2900 | 585093.4622 | 94611.2701 | 0.2991 | 3644.9702 |
| 0.0050 | 0.8774 | 1300 | 0.0053 | 834332252.4990 | 0.2928 | 580667.5237 | 94884.1214 | 0.3008 | 3657.4198 |
| 0.0046 | 0.9111 | 1350 | 0.0053 | 828123172.2391 | 0.2957 | 579922.5106 | 94007.1098 | 0.3102 | 3626.5820 |
| 0.0048 | 0.9448 | 1400 | 0.0053 | 821269960.3290 | 0.2935 | 572750.1390 | 93277.8941 | 0.3056 | 3609.6257 |
| 0.0047 | 0.9786 | 1450 | 0.0053 | 817212443.3414 | 0.3052 | 566243.9410 | 92857.2276 | 0.3229 | 3618.4643 |
| 0.0044 | 1.0121 | 1500 | 0.0053 | 825739411.3485 | 0.2926 | 577845.2585 | 93734.0046 | 0.3054 | 3618.1323 |
| 0.0041 | 1.0459 | 1550 | 0.0054 | 822944021.9256 | 0.3101 | 574726.6426 | 93356.5403 | 0.3295 | 3619.1136 |
| 0.0042 | 1.0796 | 1600 | 0.0053 | 818709731.3287 | 0.2938 | 574758.8440 | 92919.6920 | 0.3062 | 3605.5070 |
| 0.0041 | 1.1134 | 1650 | 0.0053 | 815641881.1765 | 0.2958 | 567327.0428 | 92700.4433 | 0.3119 | 3605.5972 |
| 0.0041 | 1.1471 | 1700 | 0.0052 | 818604628.7318 | 0.2887 | 574166.3668 | 93037.6550 | 0.3000 | 3592.1027 |
| 0.0038 | 1.1809 | 1750 | 0.0053 | 815389636.7231 | 0.2955 | 568022.0576 | 92698.4800 | 0.3092 | 3595.1089 |
| 0.0041 | 1.2146 | 1800 | 0.0052 | 816846028.2645 | 0.2893 | 572246.2556 | 92857.7255 | 0.3020 | 3589.1285 |
| 0.0043 | 1.2484 | 1850 | 0.0053 | 834488712.5223 | 0.2819 | 583325.1740 | 95068.7107 | 0.2864 | 3646.9913 |
| 0.0039 | 1.2821 | 1900 | 0.0052 | 812524677.6822 | 0.2960 | 568963.0243 | 92310.7843 | 0.3108 | 3579.7530 |
| 0.0040 | 1.3158 | 1950 | 0.0052 | 808809739.7125 | 0.2899 | 563706.1959 | 92069.7202 | 0.3024 | 3578.3774 |
| 0.0038 | 1.3496 | 2000 | 0.0052 | 813187017.1890 | 0.2875 | 569254.4036 | 92441.3348 | 0.2995 | 3580.1147 |
| 0.0041 | 1.3833 | 2050 | 0.0052 | 810021383.3424 | 0.2905 | 565443.5339 | 92101.1210 | 0.3041 | 3567.4393 |
| 0.0040 | 1.4171 | 2100 | 0.0052 | 813370811.9652 | 0.2895 | 570898.3506 | 92401.1214 | 0.3030 | 3564.6152 |
| 0.0038 | 1.4508 | 2150 | 0.0052 | 807132878.5538 | 0.2922 | 563674.0869 | 91774.9223 | 0.3050 | 3561.9018 |
| 0.0039 | 1.4846 | 2200 | 0.0052 | 813342384.0471 | 0.2865 | 572500.0324 | 92399.0685 | 0.2986 | 3564.0035 |
| 0.0038 | 1.5183 | 2250 | 0.0052 | 806710195.4346 | 0.2898 | 566304.3507 | 91625.1861 | 0.3046 | 3552.0700 |
| 0.0039 | 1.5521 | 2300 | 0.0052 | 806639586.8651 | 0.2890 | 567423.2237 | 91641.3086 | 0.3018 | 3557.6537 |
| 0.0036 | 1.5858 | 2350 | 0.0052 | 807245489.3111 | 0.2874 | 565414.2838 | 91757.1664 | 0.3001 | 3553.8878 |
| 0.0043 | 1.6196 | 2400 | 0.0051 | 807795196.5460 | 0.2891 | 567827.9474 | 91751.2340 | 0.3027 | 3552.5620 |
| 0.0043 | 1.6533 | 2450 | 0.0051 | 808538041.7285 | 0.2867 | 569576.1842 | 91807.2001 | 0.2988 | 3554.0637 |
| 0.0040 | 1.6870 | 2500 | 0.0052 | 805308926.5417 | 0.2907 | 563665.2724 | 91595.4409 | 0.3058 | 3551.7098 |
| 0.0039 | 1.7208 | 2550 | 0.0051 | 804048051.7904 | 0.2878 | 564254.5624 | 91317.1308 | 0.3011 | 3547.7730 |
| 0.0041 | 1.7545 | 2600 | 0.0051 | 805872841.6573 | 0.2869 | 565586.4018 | 91589.8325 | 0.2994 | 3547.0783 |
| 0.0039 | 1.7883 | 2650 | 0.0051 | 804682491.1715 | 564492.8473 | 91453.4449 | 3544.4498 | 0.2869 | 0.2997 |
| 0.0040 | 1.8220 | 2700 | 0.0051 | 806687908.4377 | 567467.9451 | 91620.3917 | 3545.4089 | 0.2856 | 0.2981 |
| 0.0040 | 1.8558 | 2750 | 0.0051 | 805782767.8034 | 566112.3373 | 91517.2361 | 3544.5204 | 0.2885 | 0.3021 |
| 0.0037 | 1.8895 | 2800 | 0.0051 | 805907335.5908 | 566681.6620 | 91565.8603 | 3544.3340 | 0.2859 | 0.2986 |
| 0.0036 | 1.9233 | 2850 | 0.0051 | 805597385.1617 | 566242.0625 | 91526.1054 | 3543.2324 | 0.2866 | 0.2997 |
| 0.0038 | 1.9570 | 2900 | 0.0051 | 805995931.9923 | 566930.7629 | 91554.6135 | 3543.0375 | 0.2863 | 0.2993 |
| 0.0038 | 1.9907 | 2950 | 0.0051 | 806091574.2393 | 567042.0963 | 91562.9049 | 3543.3133 | 0.2861 | 0.2990 |