Downloads · 30 days
0
asun17904/anliR1-gpt2-alum
anliR1-gpt2-alum is a machine learning model from asun17904. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for pytorch. The card lists the license as mit.
Downloads · 30 days
0
Access
Public
Updated Jan 30, 2024
Repo size
996 MB
Likes
0
Public
Click a slice to open those files.
.bin498 MB · 100%
From the Hugging Face model README
Dataset: ANLI Round: None
Trainer Hyperparameters:
lr = 5e-05per_device_batch_size = 8gradient_accumulation_steps = 2weight_decay = 1e-09seed = 42Regularization Hyperparameters
numerical stability denominator constant = 1.0lambda = 1.0alpha = 1.0beta = 1.0Extended Logs:
| eval_loss | eval_accuracy | epoch |
|---|---|---|
| 1.099 | 0.393 | 1.0 |
| 1.103 | 0.405 | 2.0 |
| 1.088 | 0.419 | 3.0 |
| 1.083 | 0.433 | 4.0 |
| 1.091 | 0.429 | 5.0 |
| 1.096 | 0.424 | 6.0 |
| 1.094 | 0.431 | 7.0 |
| 1.091 | 0.434 | 8.0 |
| 1.089 | 0.433 | 9.0 |
| 1.095 | 0.429 | 10.0 |
| 1.090 | 0.440 | 11.0 |
| 1.089 | 0.440 | 12.0 |
| 1.093 | 0.437 | 13.0 |
| 1.092 | 0.440 | 14.0 |
| 1.086 | 0.446 | 15.0 |
| 1.095 | 0.442 | 16.0 |
| 1.093 | 0.431 | 17.0 |
| 1.090 | 0.437 | 18.0 |
| 1.091 | 0.436 | 19.0 |
Test Accuracy: 0.438