Downloads · 30 days
6
24% of all-time downloads
xiulinyang/gpt2_xs_baby_30M_32768_42
gpt2_xs_baby_30M_32768_42 is a machine learning model from xiulinyang. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
6
24% of all-time downloads
All-time downloads
25
Public
Repo size
7.9 GB
Likes
0
Public
Click a slice to open those files.
.bin144 MB · 98%
From the Hugging Face model README
This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|---|---|---|---|---|
| 6.2609 | 0.73 | 2000 | 6.4615 | 0.1792 |
| 4.6772 | 1.46 | 4000 | 5.5726 | 0.2077 |
| 4.3217 | 2.19 | 6000 | 5.2274 | 0.2191 |
| 4.0971 | 2.93 | 8000 | 4.9498 | 0.2387 |
| 3.8884 | 3.66 | 10000 | 4.7289 | 0.2566 |
| 3.7213 | 4.39 | 12000 | 4.5478 | 0.2689 |
| 3.5926 | 5.12 | 14000 | 4.3985 | 0.2794 |
| 3.4859 | 5.85 | 16000 | 4.2785 | 0.2878 |
| 3.3886 | 6.58 | 18000 | 4.1845 | 0.2959 |
| 3.2973 | 7.32 | 20000 | 4.1090 | 0.3033 |
| 3.2369 | 8.05 | 22000 | 4.0408 | 0.3105 |
| 3.1756 | 8.78 | 24000 | 3.9837 | 0.3169 |
| 3.1092 | 9.51 | 26000 | 3.9291 | 0.3209 |
| 3.063 | 10.24 | 28000 | 3.9007 | 0.3248 |
| 3.043 | 10.97 | 30000 | 3.8566 | 0.3285 |
| 3.0029 | 11.7 | 32000 | 3.8334 | 0.3300 |
| 2.9591 | 12.44 | 34000 | 3.8123 | 0.3327 |
| 2.9252 | 13.17 | 36000 | 3.7905 | 0.3343 |
| 2.9226 | 13.9 | 38000 | 3.7661 | 0.3370 |
| 2.8907 | 14.63 | 40000 | 3.7565 | 0.3393 |
| 2.8473 | 15.36 | 42000 | 3.7416 | 0.3406 |
| 2.843 | 16.09 | 44000 | 3.7322 | 0.3421 |
| 2.8191 | 16.83 | 46000 | 3.7160 | 0.3437 |
| 2.7906 | 17.56 | 48000 | 3.7073 | 0.3447 |
| 2.7619 | 18.29 | 50000 | 3.7031 | 0.3459 |
| 2.7717 | 19.02 | 52000 | 3.6915 | 0.3472 |
| 2.746 | 19.75 | 54000 | 3.6832 | 0.3481 |
| 2.7161 | 20.48 | 56000 | 3.6789 | 0.3488 |
| 2.7137 | 21.21 | 58000 | 3.6801 | 0.3497 |
| 2.7068 | 21.95 | 60000 | 3.6727 | 0.3503 |
| 2.6914 | 22.68 | 62000 | 3.6743 | 0.3510 |
| 2.665 | 23.41 | 64000 | 3.6725 | 0.3509 |
| 2.6695 | 24.14 | 66000 | 3.6680 | 0.3514 |
| 2.6615 | 24.87 | 68000 | 3.6643 | 0.3525 |
| 2.6405 | 25.6 | 70000 | 3.6737 | 0.3527 |
| 2.6218 | 26.34 | 72000 | 3.6703 | 0.3529 |
| 2.6357 | 27.07 | 74000 | 3.6653 | 0.3530 |