anliR3-gpt2

asun17904/anliR3-gpt2

anliR3-gpt2 is a machine learning model from asun17904. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for pytorch. The card lists the license as mit.

Downloads · 30 days

Access

Public

Updated Jan 29, 2024

Repo size

5 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin498 MB · 100%

At a glance

Library: pytorch
License: mit
Access: Public
Created: Jan 28, 2024
Updated: Jan 29, 2024
SHA: 3fe476df

Model card

From the Hugging Face model README

Knowledge Continuity Regularized Network

Dataset: ANLI Round: None

Trainer Hyperparameters:

lr = 5e-05
per_device_batch_size = 8
gradient_accumulation_steps = 2
weight_decay = 1e-09
seed = 42

Regularization Hyperparameters

numerical stability denominator constant = 1.0
lambda = 0.0
alpha = 1.0
beta = 1.0

Extended Logs:

eval_loss	eval_accuracy	epoch
1.102	0.429	1.0
1.076	0.451	2.0
1.092	0.443	3.0
1.092	0.441	4.0
1.098	0.438	5.0
1.104	0.437	6.0
1.094	0.443	7.0
1.095	0.448	8.0
1.110	0.434	9.0

Library: pytorch
License: mit
Languages: en
Created: Jan 28, 2024
Updated: Jan 29, 2024