Downloads · 30 days
8
20% of all-time downloads
xiulinyang/gpt2_small_baby_10M_32768_42
gpt2_small_baby_10M_32768_42 is a machine learning model from xiulinyang. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
8
20% of all-time downloads
All-time downloads
40
Public
Repo size
9.7 GB
Likes
0
Public
Click a slice to open those files.
.bin443 MB · 100%
From the Hugging Face model README
This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|---|---|---|---|---|
| 5.2324 | 2.24 | 2000 | 6.0501 | 0.1956 |
| 4.1973 | 4.48 | 4000 | 5.4151 | 0.2116 |
| 3.8408 | 6.73 | 6000 | 5.0060 | 0.2386 |
| 3.5463 | 8.97 | 8000 | 4.7067 | 0.2606 |
| 3.3279 | 11.21 | 10000 | 4.5077 | 0.2742 |
| 3.1551 | 13.45 | 12000 | 4.3553 | 0.2853 |
| 3.0122 | 15.7 | 14000 | 4.2608 | 0.2925 |
| 2.8841 | 17.94 | 16000 | 4.1747 | 0.3003 |
| 2.7582 | 20.18 | 18000 | 4.1518 | 0.3040 |
| 2.6468 | 22.42 | 20000 | 4.1281 | 0.3067 |
| 2.5459 | 24.66 | 22000 | 4.1279 | 0.3061 |
| 2.4394 | 26.91 | 24000 | 4.1510 | 0.3055 |
| 2.3264 | 29.15 | 26000 | 4.2307 | 0.3021 |
| 2.2241 | 31.39 | 28000 | 4.2824 | 0.3002 |