mt5-small-v9-sum-fine-tuned

HeshamMamdouh/mt5-small-v9-sum-fine-tuned

mt5-small-v9-sum-fine-tuned is a machine learning model from HeshamMamdouh. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.

probably proofread and complete it, then remove this comment. --

Downloads · 30 days

17% of all-time downloads

All-time downloads

Public

Repo size

559 MB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.h5557 MB · 100%

At a glance

Library: transformers
License: apache-2.0
Model type: mbart
Access: Public
Created: Jul 8, 2023
Updated: Jul 8, 2023
SHA: 7c2484ad

Model card

From the Hugging Face model README

mt5-small-v9-sum-fine-tuned

This model is a fine-tuned version of abdalrahmanshahrour/AraBART-summ on an unknown dataset. It achieves the following results on the evaluation set:

Train Loss: 2.3330
Epoch: 24

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 2e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}
training_precision: float32

Training results

Train Loss	Epoch
3.9662	0
3.6350	1
3.4190	2
3.2912	3
3.2457	4
3.1096	5
3.1070	6
3.0977	7
2.9406	8
2.9457	9
2.8699	10
2.7632	11
2.7631	12
2.7272	13
2.7118	14
2.7004	15
2.6448	16
2.5781	17
2.5131	18
2.5630	19
2.4825	20
2.4222	21
2.3742	22
2.3636	23
2.3330	24

Framework versions

Transformers 4.30.2
TensorFlow 2.13.0
Datasets 2.13.1
Tokenizers 0.13.3

Library: transformers
Type: mbart
License: apache-2.0
Created: Jul 8, 2023
Updated: Jul 8, 2023