FineTune_Vit5_LR0_00001

thesunshine36/FineTune_Vit5_LR0_00001

FineTune_Vit5_LR0_00001 is a machine learning model from thesunshine36. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.

probably proofread and complete it, then remove this comment. --

Downloads · 30 days

20% of all-time downloads

All-time downloads

Public

Repo size

1.1 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.h51.1 GB · 100%

At a glance

Library: transformers
License: mit
Model type: t5
Access: Public
Created: Feb 4, 2023
Updated: Feb 4, 2023
SHA: d50d8f88

Model card

From the Hugging Face model README

FineTune_Vit5_LR0_00001

This model is a fine-tuned version of VietAI/vit5-base on an unknown dataset. It achieves the following results on the evaluation set:

Train Loss: 0.9405
Validation Loss: 0.7156
Train Rouge1: 48.1785
Train Rouge2: 25.7772
Train Rougel: 39.5071
Train Rougelsum: 39.5644
Train Gen Len: 14.0508
Epoch: 0

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

optimizer: {'name': 'Adam', 'learning_rate': 1e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False}
training_precision: float32

Training results

Train Loss	Validation Loss	Train Rouge1	Train Rouge2	Train Rougel	Train Rougelsum	Train Gen Len	Epoch
0.9405	0.7156	48.1785	25.7772	39.5071	39.5644	14.0508	0

Framework versions

Transformers 4.26.0
TensorFlow 2.9.2
Datasets 2.9.0
Tokenizers 0.13.2

Library: transformers
Type: t5
License: mit
Created: Feb 4, 2023
Updated: Feb 4, 2023