Downloads · 30 days
0
asun17904/anliR2-gpt2-alum
anliR2-gpt2-alum is a machine learning model from asun17904. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for pytorch. The card lists the license as mit.
Downloads · 30 days
0
Access
Public
Updated Feb 1, 2024
Repo size
3 GB
Likes
0
Public
Click a slice to open those files.
.bin498 MB · 100%
From the Hugging Face model README
Dataset: ANLI Round: None
Trainer Hyperparameters:
lr = 5e-05per_device_batch_size = 8gradient_accumulation_steps = 2weight_decay = 1e-09seed = 42Regularization Hyperparameters
numerical stability denominator constant = 1.0lambda = 1.0alpha = 1.0beta = 1.0Extended Logs:
| eval_loss | eval_accuracy | epoch |
|---|---|---|
| 1.125 | 0.381 | 1.0 |
| 1.109 | 0.407 | 2.0 |
| 1.104 | 0.421 | 3.0 |
| 1.090 | 0.429 | 4.0 |
| 1.083 | 0.436 | 5.0 |
| 1.099 | 0.425 | 6.0 |
| 1.069 | 0.452 | 7.0 |
| 1.081 | 0.453 | 8.0 |
| 1.087 | 0.442 | 9.0 |
| 1.084 | 0.445 | 10.0 |
| 1.082 | 0.452 | 11.0 |
| 1.087 | 0.447 | 12.0 |
| 1.076 | 0.459 | 13.0 |
| 1.082 | 0.446 | 14.0 |
Test Accuracy: 0.452