Downloads · 30 days
3
1% of all-time downloads
devika-tiwari/gpt2_small_expandedbabyLM_100M_exp3_conj_ratio_0p50_mix_0p25_43
gpt2_small_expandedbabyLM_100M_exp3_conj_ratio_0p50_mix_0p25_43 is a machine learning model from devika-tiwari. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
3
1% of all-time downloads
All-time downloads
212
Public
Repo size
5.5 GB
Likes
0
Public
Click a slice to open those files.
.bin498 MB · 99%
From the Hugging Face model README
This model is a fine-tuned version of on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 3.667 | 1.0 | 4328 | 4.3338 |
| 3.311 | 2.0 | 8656 | 3.8057 |
| 3.1759 | 3.0 | 12984 | 3.6760 |
| 3.0974 | 4.0 | 17312 | 3.6680 |
| 3.0396 | 5.0 | 21640 | 3.6388 |
| 2.9897 | 6.0 | 25968 | 3.6473 |
| 2.9565 | 7.0 | 30296 | 3.6265 |
| 2.9261 | 8.0 | 34624 | 3.6763 |
| 2.8945 | 9.0 | 38952 | 3.6619 |
| 2.8724 | 10.0 | 43280 | 3.7177 |