Downloads · 30 days
4
13% of all-time downloads
xiulinyang/gpt2_small_baby_30M_32768_42_b
gpt2_small_baby_30M_32768_42_b is a machine learning model from xiulinyang. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
4
13% of all-time downloads
All-time downloads
30
Public
Repo size
17.7 GB
Likes
0
Public
Click a slice to open those files.
.bin443 MB · 100%
From the Hugging Face model README
This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|---|---|---|---|---|
| 5.4638 | 0.73 | 2000 | 5.9982 | 0.1968 |
| 4.4398 | 1.46 | 4000 | 5.3414 | 0.2166 |
| 4.076 | 2.19 | 6000 | 4.9258 | 0.2458 |
| 3.8013 | 2.93 | 8000 | 4.6161 | 0.2665 |
| 3.5909 | 3.66 | 10000 | 4.4015 | 0.2829 |
| 3.4328 | 4.39 | 12000 | 4.2356 | 0.2960 |
| 3.3196 | 5.12 | 14000 | 4.1137 | 0.3066 |
| 3.2216 | 5.85 | 16000 | 4.0166 | 0.3143 |
| 3.1195 | 6.58 | 18000 | 3.9346 | 0.3226 |
| 3.0285 | 7.32 | 20000 | 3.8726 | 0.3290 |
| 2.9835 | 8.05 | 22000 | 3.8231 | 0.3339 |
| 2.9282 | 8.78 | 24000 | 3.7795 | 0.3379 |
| 2.8575 | 9.51 | 26000 | 3.7440 | 0.3404 |
| 2.8131 | 10.24 | 28000 | 3.7327 | 0.3435 |
| 2.8094 | 10.97 | 30000 | 3.6909 | 0.3459 |
| 2.7583 | 11.7 | 32000 | 3.6850 | 0.3468 |
| 2.6977 | 12.44 | 34000 | 3.6824 | 0.3486 |
| 2.6683 | 13.17 | 36000 | 3.6749 | 0.3492 |
| 2.6733 | 13.9 | 38000 | 3.6543 | 0.3514 |
| 2.6241 | 14.63 | 40000 | 3.6639 | 0.3522 |
| 2.5519 | 15.36 | 42000 | 3.6707 | 0.3528 |
| 2.5608 | 16.09 | 44000 | 3.6685 | 0.3539 |
| 2.529 | 16.83 | 46000 | 3.6557 | 0.3546 |
| 2.4679 | 17.56 | 48000 | 3.6766 | 0.3542 |
| 2.4154 | 18.29 | 50000 | 3.6831 | 0.3549 |
| 2.4448 | 19.02 | 52000 | 3.6850 | 0.3548 |