Downloads · 30 days
33
54% of all-time downloads
xiulinyang/gpt2_mini_baby_10M_32768_42_b
gpt2_mini_baby_10M_32768_42_b is a machine learning model from xiulinyang. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
33
54% of all-time downloads
All-time downloads
61
Public
Repo size
3.7 GB
Likes
0
Public
Click a slice to open those files.
.bin119 MB · 98%
From the Hugging Face model README
This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|---|---|---|---|---|
| 6.1602 | 2.27 | 2000 | 6.4583 | 0.1756 |
| 4.4777 | 4.54 | 4000 | 5.4968 | 0.2164 |
| 4.1374 | 6.81 | 6000 | 5.1655 | 0.2262 |
| 3.9276 | 9.08 | 8000 | 4.9212 | 0.2431 |
| 3.7426 | 11.35 | 10000 | 4.7328 | 0.2585 |
| 3.5843 | 13.62 | 12000 | 4.5811 | 0.2692 |
| 3.4472 | 15.89 | 14000 | 4.4550 | 0.2797 |
| 3.3255 | 18.16 | 16000 | 4.3533 | 0.2880 |
| 3.2227 | 20.43 | 18000 | 4.2824 | 0.2925 |
| 3.125 | 22.7 | 20000 | 4.2194 | 0.2998 |
| 3.0435 | 24.97 | 22000 | 4.1778 | 0.3029 |
| 2.9657 | 27.24 | 24000 | 4.1461 | 0.3063 |
| 2.8985 | 29.51 | 26000 | 4.1237 | 0.3079 |
| 2.841 | 31.78 | 28000 | 4.1092 | 0.3104 |
| 2.783 | 34.05 | 30000 | 4.1066 | 0.3119 |
| 2.7304 | 36.32 | 32000 | 4.1088 | 0.3126 |
| 2.6886 | 38.59 | 34000 | 4.1068 | 0.3136 |
| 2.6459 | 40.86 | 36000 | 4.1213 | 0.3132 |
| 2.6004 | 43.13 | 38000 | 4.1297 | 0.3140 |
| 2.5701 | 45.4 | 40000 | 4.1558 | 0.3147 |