Downloads · 30 days
0
asun17904/glue-mnli-bert-base-uncased-regularized-l2
glue-mnli-bert-base-uncased-regularized-l2 is a machine learning model from asun17904. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for pytorch. The card lists the license as mit.
Downloads · 30 days
0
Access
Public
Updated Jan 25, 2024
Repo size
11.4 GB
Likes
0
Public
Click a slice to open those files.
.bin438 MB · 100%
From the Hugging Face model README
Dataset: GLUE
Trainer Hyperparameters:
lr = 5e-05per_device_batch_size = 16gradient_accumulation_steps = 1weight_decay = 1e-09seed = 42Regularization Hyperparameters
numerical stability denominator constant = 0.01lambda = 0.02alpha = 2.0beta = 1.0Extended Logs:
| eval_loss | eval_accuracy | epoch |
|---|---|---|
| 24.363 | 0.790 | 1.0 |
| 23.650 | 0.813 | 2.0 |