Downloads · 30 days
5
19% of all-time downloads
xiulinyang/gpt2_small_baby_100M_32768_42_b
gpt2_small_baby_100M_32768_42_b is a machine learning model from xiulinyang. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
5
19% of all-time downloads
All-time downloads
26
Public
Repo size
33.6 GB
Likes
0
Public
Click a slice to open those files.
.bin443 MB · 100%
From the Hugging Face model README
This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|---|---|---|---|---|
| 5.9648 | 0.23 | 2000 | 5.9017 | 0.2037 |
| 4.8442 | 0.45 | 4000 | 5.2072 | 0.2252 |
| 4.3792 | 0.68 | 6000 | 4.7653 | 0.2584 |
| 4.0368 | 0.91 | 8000 | 4.4561 | 0.2802 |
| 3.8039 | 1.13 | 10000 | 4.2374 | 0.2978 |
| 3.6261 | 1.36 | 12000 | 4.0755 | 0.3104 |
| 3.495 | 1.59 | 14000 | 3.9491 | 0.3214 |
| 3.3784 | 1.81 | 16000 | 3.8435 | 0.3319 |
| 3.269 | 2.04 | 18000 | 3.7608 | 0.3400 |
| 3.1892 | 2.27 | 20000 | 3.6803 | 0.3459 |
| 3.1198 | 2.49 | 22000 | 3.6280 | 0.3519 |
| 3.0714 | 2.72 | 24000 | 3.5796 | 0.3557 |
| 3.0263 | 2.94 | 26000 | 3.5374 | 0.3604 |
| 2.9688 | 3.17 | 28000 | 3.5100 | 0.3645 |
| 2.9306 | 3.4 | 30000 | 3.4733 | 0.3675 |
| 2.9205 | 3.62 | 32000 | 3.4501 | 0.3693 |
| 2.8966 | 3.85 | 34000 | 3.4286 | 0.3715 |
| 2.8468 | 4.08 | 36000 | 3.4078 | 0.3742 |
| 2.8262 | 4.3 | 38000 | 3.3894 | 0.3764 |
| 2.8168 | 4.53 | 40000 | 3.3791 | 0.3776 |
| 2.8052 | 4.76 | 42000 | 3.3549 | 0.3799 |
| 2.7853 | 4.98 | 44000 | 3.3376 | 0.3823 |
| 2.7225 | 5.21 | 46000 | 3.3339 | 0.3845 |
| 2.7168 | 5.44 | 48000 | 3.3083 | 0.3868 |
| 2.7155 | 5.66 | 50000 | 3.2973 | 0.3884 |
| 2.7008 | 5.89 | 52000 | 3.2729 | 0.3897 |
| 2.6325 | 6.12 | 54000 | 3.2794 | 0.3912 |
| 2.6522 | 6.34 | 56000 | 3.2725 | 0.3917 |
| 2.6428 | 6.57 | 58000 | 3.2547 | 0.3936 |
| 2.6353 | 6.8 | 60000 | 3.2462 | 0.3947 |
| 2.6203 | 7.02 | 62000 | 3.2451 | 0.3956 |
| 2.5749 | 7.25 | 64000 | 3.2396 | 0.3963 |
| 2.5814 | 7.47 | 66000 | 3.2341 | 0.3973 |
| 2.5719 | 7.7 | 68000 | 3.2254 | 0.3980 |
| 2.5818 | 7.93 | 70000 | 3.2205 | 0.3992 |
| 2.5196 | 8.15 | 72000 | 3.2188 | 0.4001 |
| 2.5236 | 8.38 | 74000 | 3.2166 | 0.4003 |
| 2.5294 | 8.61 | 76000 | 3.2105 | 0.4012 |
| 2.5265 | 8.83 | 78000 | 3.2025 | 0.4017 |
| 2.4952 | 9.06 | 80000 | 3.2049 | 0.4027 |
| 2.474 | 9.29 | 82000 | 3.2065 | 0.4026 |
| 2.48 | 9.51 | 84000 | 3.1991 | 0.4034 |
| 2.4883 | 9.74 | 86000 | 3.1899 | 0.4041 |
| 2.4753 | 9.97 | 88000 | 3.1851 | 0.4047 |
| 2.43 | 10.19 | 90000 | 3.1897 | 0.4051 |
| 2.4356 | 10.42 | 92000 | 3.1881 | 0.4055 |
| 2.4415 | 10.65 | 94000 | 3.1830 | 0.4060 |
| 2.4332 | 10.87 | 96000 | 3.1813 | 0.4065 |
| 2.405 | 11.1 | 98000 | 3.1815 | 0.4066 |
| 2.4107 | 11.33 | 100000 | 3.1802 | 0.4068 |