Downloads · 30 days
7
29% of all-time downloads
xiulinyang/gpt2_xs_baby_10M_32768_42
gpt2_xs_baby_10M_32768_42 is a machine learning model from xiulinyang. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
7
29% of all-time downloads
All-time downloads
24
Public
Repo size
4 GB
Likes
0
Public
Click a slice to open those files.
.bin144 MB · 98%
From the Hugging Face model README
This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|---|---|---|---|---|
| 6.0768 | 2.24 | 2000 | 6.5142 | 0.1768 |
| 4.432 | 4.48 | 4000 | 5.6332 | 0.2033 |
| 4.0882 | 6.73 | 6000 | 5.2923 | 0.2139 |
| 3.8608 | 8.97 | 8000 | 5.0331 | 0.2319 |
| 3.6469 | 11.21 | 10000 | 4.8163 | 0.2488 |
| 3.4725 | 13.45 | 12000 | 4.6409 | 0.2622 |
| 3.33 | 15.7 | 14000 | 4.5123 | 0.2714 |
| 3.2073 | 17.94 | 16000 | 4.3995 | 0.2794 |
| 3.0984 | 20.18 | 18000 | 4.3198 | 0.2869 |
| 3.0076 | 22.42 | 20000 | 4.2557 | 0.2932 |
| 2.9328 | 24.66 | 22000 | 4.1973 | 0.2982 |
| 2.8567 | 26.91 | 24000 | 4.1756 | 0.3004 |
| 2.7879 | 29.15 | 26000 | 4.1478 | 0.3037 |
| 2.7241 | 31.39 | 28000 | 4.1393 | 0.3049 |
| 2.6714 | 33.63 | 30000 | 4.1277 | 0.3072 |
| 2.6216 | 35.87 | 32000 | 4.1242 | 0.3082 |
| 2.565 | 38.12 | 34000 | 4.1447 | 0.3073 |
| 2.5252 | 40.36 | 36000 | 4.1594 | 0.3080 |
| 2.4836 | 42.6 | 38000 | 4.1796 | 0.3065 |