Downloads · 30 days
0
kennethge123/imdb-gpt2-a2b2l0.01
imdb-gpt2-a2b2l0.01 is a machine learning model from kennethge123. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for pytorch. The card lists the license as mit.
Trainer Hyperparameters: - lr = 5e-05 - perdevicebatchsize = 8 - gradientaccumulationsteps = 2 - weightdecay = 1e-09 - seed = 42
Downloads · 30 days
0
Access
Public
Updated Mar 23, 2024
Repo size
—
Likes
0
Public
Click a slice to open those files.
Other1.5 KB · 69%
From the Hugging Face model README
Trainer Hyperparameters:
lr = 5e-05per_device_batch_size = 8gradient_accumulation_steps = 2weight_decay = 1e-09seed = 42Regularization Hyperparameters
numerical stability denominator constant = 0.001lambda = 0.01alpha = 2.0beta = 2.0Extended Logs:
| eval_loss | eval_accuracy | epoch |
|---|---|---|
| 19.394 | 0.208 | 0.67 |
| 13.088 | 0.792 | 2.0 |
| 12.683 | 0.792 | 2.67 |
| 12.690 | 0.792 | 4.0 |
| 13.599 | 0.917 | 4.67 |
| 14.317 | 0.708 | 6.0 |
| 13.274 | 0.750 | 6.67 |
| 10.404 | 0.917 | 8.0 |
| 10.809 | 0.917 | 8.67 |
| 12.907 | 0.833 | 10.0 |
| 14.400 | 0.833 | 10.67 |
| 12.761 | 0.833 | 12.0 |
| 12.600 | 0.833 | 12.67 |