Downloads · 30 days
7
25% of all-time downloads
xiulinyang/gpt2_small_baby_50M_32768_42_b
gpt2_small_baby_50M_32768_42_b is a machine learning model from xiulinyang. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
7
25% of all-time downloads
All-time downloads
28
Public
Repo size
23 GB
Likes
0
Public
Click a slice to open those files.
.bin443 MB · 100%
From the Hugging Face model README
This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|---|---|---|---|---|
| 5.5098 | 0.43 | 2000 | 6.0041 | 0.1966 |
| 4.5136 | 0.87 | 4000 | 5.3357 | 0.2160 |
| 4.1528 | 1.3 | 6000 | 4.9188 | 0.2461 |
| 3.873 | 1.73 | 8000 | 4.6125 | 0.2674 |
| 3.6756 | 2.17 | 10000 | 4.3973 | 0.2828 |
| 3.5372 | 2.6 | 12000 | 4.2307 | 0.2955 |
| 3.414 | 3.03 | 14000 | 4.1145 | 0.3046 |
| 3.3076 | 3.47 | 16000 | 3.9993 | 0.3142 |
| 3.2206 | 3.9 | 18000 | 3.9217 | 0.3221 |
| 3.1316 | 4.33 | 20000 | 3.8494 | 0.3297 |
| 3.0801 | 4.77 | 22000 | 3.7897 | 0.3338 |
| 3.0118 | 5.2 | 24000 | 3.7587 | 0.3377 |
| 2.9899 | 5.64 | 26000 | 3.7123 | 0.3419 |
| 2.9423 | 6.07 | 28000 | 3.6812 | 0.3450 |
| 2.9036 | 6.5 | 30000 | 3.6469 | 0.3476 |
| 2.8945 | 6.94 | 32000 | 3.6289 | 0.3513 |
| 2.8387 | 7.37 | 34000 | 3.6075 | 0.3528 |
| 2.8333 | 7.8 | 36000 | 3.5883 | 0.3547 |
| 2.7703 | 8.24 | 38000 | 3.5787 | 0.3555 |
| 2.7885 | 8.67 | 40000 | 3.5651 | 0.3581 |
| 2.7439 | 9.1 | 42000 | 3.5533 | 0.3587 |
| 2.721 | 9.54 | 44000 | 3.5422 | 0.3605 |
| 2.7212 | 9.97 | 46000 | 3.5248 | 0.3632 |
| 2.6565 | 10.4 | 48000 | 3.5213 | 0.3638 |
| 2.6667 | 10.84 | 50000 | 3.5142 | 0.3658 |
| 2.5989 | 11.27 | 52000 | 3.5224 | 0.3662 |
| 2.6198 | 11.7 | 54000 | 3.5014 | 0.3674 |
| 2.5693 | 12.14 | 56000 | 3.5085 | 0.3666 |
| 2.5642 | 12.57 | 58000 | 3.4999 | 0.3686 |
| 2.5849 | 13.0 | 60000 | 3.4964 | 0.3697 |
| 2.5225 | 13.44 | 62000 | 3.5059 | 0.3691 |
| 2.5397 | 13.87 | 64000 | 3.4948 | 0.3716 |
| 2.4662 | 14.3 | 66000 | 3.5136 | 0.3699 |
| 2.4942 | 14.74 | 68000 | 3.5003 | 0.3709 |
| 2.4463 | 15.17 | 70000 | 3.5129 | 0.3704 |