Downloads · 30 days
7
14% of all-time downloads
yalhessi/lemexp-task5-template_deriv_full-deepseek-coder-1.3b-base-r16-alllinear-18ep-8bit
lemexp-task5-template_deriv_full-deepseek-coder-1.3b-base-r16-alllinear-18ep-8bit is a machine learning model from yalhessi. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as other.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
7
14% of all-time downloads
All-time downloads
51
Public
Repo size
585 MB
Likes
0
Public
Click a slice to open those files.
.safetensors585 MB · 100%
From the Hugging Face model README
This model is a fine-tuned version of deepseek-ai/deepseek-coder-1.3b-base on the None dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| No log | 0.2001 | 360 | 0.4667 |
| 0.677 | 0.4002 | 720 | 0.3310 |
| 0.32 | 0.6003 | 1080 | 0.2973 |
| 0.32 | 0.8004 | 1440 | 0.2694 |
| 0.2726 | 1.0006 | 1800 | 0.2627 |
| 0.2437 | 1.2007 | 2160 | 0.2355 |
| 0.2224 | 1.4008 | 2520 | 0.2325 |
| 0.2224 | 1.6009 | 2880 | 0.2193 |
| 0.2183 | 1.8010 | 3240 | 0.2149 |
| 0.2099 | 2.0011 | 3600 | 0.2115 |
| 0.2099 | 2.2012 | 3960 | 0.2088 |
| 0.1932 | 2.4013 | 4320 | 0.2082 |
| 0.1893 | 2.6014 | 4680 | 0.2012 |
| 0.1887 | 2.8016 | 5040 | 0.1861 |
| 0.1887 | 3.0017 | 5400 | 0.1983 |
| 0.1848 | 3.2018 | 5760 | 0.1958 |
| 0.1719 | 3.4019 | 6120 | 0.1922 |
| 0.1719 | 3.6020 | 6480 | 0.1935 |
| 0.1725 | 3.8021 | 6840 | 0.1876 |
| 0.1705 | 4.0022 | 7200 | 0.1840 |
| 0.1648 | 4.2023 | 7560 | 0.1827 |
| 0.1648 | 4.4024 | 7920 | 0.1784 |
| 0.158 | 4.6026 | 8280 | 0.1732 |
| 0.1556 | 4.8027 | 8640 | 0.1734 |
| 0.1558 | 5.0028 | 9000 | 0.1745 |
| 0.1558 | 5.2029 | 9360 | 0.1709 |
| 0.1416 | 5.4030 | 9720 | 0.1713 |
| 0.143 | 5.6031 | 10080 | 0.1707 |
| 0.143 | 5.8032 | 10440 | 0.1712 |
| 0.147 | 6.0033 | 10800 | 0.1648 |
| 0.1385 | 6.2034 | 11160 | 0.1684 |
| 0.1327 | 6.4036 | 11520 | 0.1637 |
| 0.1327 | 6.6037 | 11880 | 0.1616 |
| 0.1333 | 6.8038 | 12240 | 0.1612 |
| 0.1318 | 7.0039 | 12600 | 0.1679 |
| 0.1318 | 7.2040 | 12960 | 0.1666 |
| 0.1182 | 7.4041 | 13320 | 0.1631 |
| 0.1234 | 7.6042 | 13680 | 0.1609 |
| 0.1231 | 7.8043 | 14040 | 0.1517 |
| 0.1231 | 8.0044 | 14400 | 0.1559 |
| 0.1182 | 8.2046 | 14760 | 0.1611 |
| 0.1086 | 8.4047 | 15120 | 0.1595 |
| 0.1086 | 8.6048 | 15480 | 0.1544 |
| 0.1101 | 8.8049 | 15840 | 0.1536 |
| 0.1118 | 9.0050 | 16200 | 0.1517 |
| 0.102 | 9.2051 | 16560 | 0.1543 |
| 0.102 | 9.4052 | 16920 | 0.1522 |
| 0.0995 | 9.6053 | 17280 | 0.1492 |
| 0.1003 | 9.8054 | 17640 | 0.1520 |
| 0.1007 | 10.0056 | 18000 | 0.1481 |
| 0.1007 | 10.2057 | 18360 | 0.1499 |
| 0.0858 | 10.4058 | 18720 | 0.1532 |
| 0.0909 | 10.6059 | 19080 | 0.1441 |
| 0.0909 | 10.8060 | 19440 | 0.1439 |
| 0.0904 | 11.0061 | 19800 | 0.1498 |
| 0.0846 | 11.2062 | 20160 | 0.1513 |
| 0.0789 | 11.4063 | 20520 | 0.1465 |
| 0.0789 | 11.6064 | 20880 | 0.1449 |
| 0.0826 | 11.8066 | 21240 | 0.1441 |
| 0.0813 | 12.0067 | 21600 | 0.1497 |
| 0.0813 | 12.2068 | 21960 | 0.1497 |
| 0.0707 | 12.4069 | 22320 | 0.1489 |
| 0.0707 | 12.6070 | 22680 | 0.1497 |
| 0.0727 | 12.8071 | 23040 | 0.1516 |
| 0.0727 | 13.0072 | 23400 | 0.1498 |
| 0.0704 | 13.2073 | 23760 | 0.1536 |
| 0.0631 | 13.4074 | 24120 | 0.1519 |
| 0.0631 | 13.6076 | 24480 | 0.1515 |
| 0.0646 | 13.8077 | 24840 | 0.1487 |
| 0.0649 | 14.0078 | 25200 | 0.1558 |
| 0.0591 | 14.2079 | 25560 | 0.1615 |
| 0.0591 | 14.4080 | 25920 | 0.1621 |
| 0.0573 | 14.6081 | 26280 | 0.1593 |
| 0.0581 | 14.8082 | 26640 | 0.1555 |
| 0.0576 | 15.0083 | 27000 | 0.1603 |
| 0.0576 | 15.2084 | 27360 | 0.1701 |
| 0.0514 | 15.4086 | 27720 | 0.1677 |
| 0.0521 | 15.6087 | 28080 | 0.1664 |
| 0.0521 | 15.8088 | 28440 | 0.1681 |
| 0.0518 | 16.0089 | 28800 | 0.1720 |
| 0.05 | 16.2090 | 29160 | 0.1783 |
| 0.0475 | 16.4091 | 29520 | 0.1800 |
| 0.0475 | 16.6092 | 29880 | 0.1778 |
| 0.0481 | 16.8093 | 30240 | 0.1792 |
| 0.0482 | 17.0094 | 30600 | 0.1781 |
| 0.0482 | 17.2096 | 30960 | 0.1902 |
| 0.0451 | 17.4097 | 31320 | 0.1904 |
| 0.0448 | 17.6098 | 31680 | 0.1911 |
| 0.045 | 17.8099 | 32040 | 0.1915 |