Downloads · 30 days
5
20% of all-time downloads
xiulinyang/gpt2_xs_baby_50M_32768_42
gpt2_xs_baby_50M_32768_42 is a machine learning model from xiulinyang. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
5
20% of all-time downloads
All-time downloads
25
Public
Repo size
10.9 GB
Likes
0
Public
Click a slice to open those files.
.bin144 MB · 98%
From the Hugging Face model README
This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|---|---|---|---|---|
| 6.3137 | 0.43 | 2000 | 6.4929 | 0.1772 |
| 4.7466 | 0.87 | 4000 | 5.5888 | 0.2077 |
| 4.3983 | 1.3 | 6000 | 5.2282 | 0.2189 |
| 4.1643 | 1.73 | 8000 | 4.9517 | 0.2389 |
| 3.9651 | 2.17 | 10000 | 4.7270 | 0.2564 |
| 3.8154 | 2.6 | 12000 | 4.5382 | 0.2697 |
| 3.6806 | 3.03 | 14000 | 4.3959 | 0.2797 |
| 3.5738 | 3.47 | 16000 | 4.2737 | 0.2887 |
| 3.4807 | 3.9 | 18000 | 4.1777 | 0.2962 |
| 3.3959 | 4.33 | 20000 | 4.0950 | 0.3046 |
| 3.3265 | 4.77 | 22000 | 4.0238 | 0.3110 |
| 3.2592 | 5.2 | 24000 | 3.9607 | 0.3162 |
| 3.2194 | 5.64 | 26000 | 3.9135 | 0.3218 |
| 3.1663 | 6.07 | 28000 | 3.8674 | 0.3247 |
| 3.1281 | 6.5 | 30000 | 3.8415 | 0.3281 |
| 3.106 | 6.94 | 32000 | 3.8069 | 0.3315 |
| 3.0646 | 7.37 | 34000 | 3.7888 | 0.3336 |
| 3.0451 | 7.8 | 36000 | 3.7546 | 0.3360 |
| 3.0021 | 8.24 | 38000 | 3.7365 | 0.3374 |
| 3.0043 | 8.67 | 40000 | 3.7177 | 0.3396 |
| 2.97 | 9.1 | 42000 | 3.7026 | 0.3415 |
| 2.9494 | 9.54 | 44000 | 3.6883 | 0.3430 |
| 2.9426 | 9.97 | 46000 | 3.6628 | 0.3453 |
| 2.9049 | 10.4 | 48000 | 3.6608 | 0.3461 |
| 2.9057 | 10.84 | 50000 | 3.6475 | 0.3480 |
| 2.8704 | 11.27 | 52000 | 3.6358 | 0.3495 |
| 2.877 | 11.7 | 54000 | 3.6212 | 0.3502 |
| 2.8476 | 12.14 | 56000 | 3.6184 | 0.3513 |
| 2.8413 | 12.57 | 58000 | 3.6067 | 0.3525 |
| 2.8539 | 13.0 | 60000 | 3.5974 | 0.3540 |
| 2.821 | 13.44 | 62000 | 3.5977 | 0.3534 |
| 2.8276 | 13.87 | 64000 | 3.5857 | 0.3555 |
| 2.7861 | 14.3 | 66000 | 3.5879 | 0.3551 |
| 2.8017 | 14.74 | 68000 | 3.5739 | 0.3568 |
| 2.7825 | 15.17 | 70000 | 3.5760 | 0.3572 |
| 2.7802 | 15.6 | 72000 | 3.5710 | 0.3575 |
| 2.778 | 16.04 | 74000 | 3.5658 | 0.3587 |
| 2.7587 | 16.47 | 76000 | 3.5615 | 0.3586 |
| 2.7675 | 16.91 | 78000 | 3.5541 | 0.3597 |
| 2.7394 | 17.34 | 80000 | 3.5558 | 0.3598 |
| 2.7452 | 17.77 | 82000 | 3.5533 | 0.3602 |
| 2.7274 | 18.21 | 84000 | 3.5470 | 0.3614 |
| 2.727 | 18.64 | 86000 | 3.5454 | 0.3612 |
| 2.7266 | 19.07 | 88000 | 3.5423 | 0.3614 |
| 2.7145 | 19.51 | 90000 | 3.5400 | 0.3624 |
| 2.7203 | 19.94 | 92000 | 3.5354 | 0.3628 |
| 2.7021 | 20.37 | 94000 | 3.5335 | 0.3630 |
| 2.7046 | 20.81 | 96000 | 3.5330 | 0.3633 |
| 2.6898 | 21.24 | 98000 | 3.5316 | 0.3634 |
| 2.6912 | 21.67 | 100000 | 3.5296 | 0.3637 |