anliR2-gpt2

asun17904/anliR2-gpt2

anliR2-gpt2 is a machine learning model from asun17904. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for pytorch. The card lists the license as mit.

Downloads · 30 days

Access

Public

Updated Jan 28, 2024

Repo size

4.5 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin498 MB · 100%

At a glance

Library: pytorch
License: mit
Access: Public
Created: Jan 28, 2024
Updated: Jan 28, 2024
SHA: 9c3d3ca4

Model card

From the Hugging Face model README

Knowledge Continuity Regularized Network

Dataset: ANLI Round: None

Trainer Hyperparameters:

lr = 5e-05
per_device_batch_size = 8
gradient_accumulation_steps = 2
weight_decay = 1e-09
seed = 42

Regularization Hyperparameters

numerical stability denominator constant = 1.0
lambda = 0.0
alpha = 1.0
beta = 1.0

Extended Logs:

eval_loss	eval_accuracy	epoch
1.147	0.382	1.0
1.141	0.388	2.0
1.117	0.417	3.0
1.136	0.404	4.0
1.141	0.392	5.0
1.132	0.406	6.0
1.107	0.432	7.0
1.108	0.427	8.0
1.118	0.417	9.0
1.109	0.429	10.0
1.100	0.440	11.0
1.104	0.441	12.0
1.099	0.442	13.0
1.095	0.444	14.0
1.110	0.432	15.0
1.105	0.439	16.0
1.097	0.448	17.0
1.096	0.444	18.0
1.097	0.449	19.0

Library: pytorch
License: mit
Languages: en
Created: Jan 28, 2024
Updated: Jan 28, 2024