mt5-small-v8-sum-fine-tuned

HeshamMamdouh/mt5-small-v8-sum-fine-tuned

mt5-small-v8-sum-fine-tuned is a machine learning model from HeshamMamdouh. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.

probably proofread and complete it, then remove this comment. --

Downloads · 30 days

14% of all-time downloads

All-time downloads

Public

Repo size

559 MB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.h5557 MB · 100%

At a glance

Library: transformers
License: apache-2.0
Model type: mbart
Access: Public
Created: Jul 8, 2023
Updated: Jul 8, 2023
SHA: d4ff8ccf

Model card

From the Hugging Face model README

mt5-small-v8-sum-fine-tuned

This model is a fine-tuned version of abdalrahmanshahrour/AraBART-summ on an unknown dataset. It achieves the following results on the evaluation set:

Train Loss: 1.6114
Epoch: 29

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 2e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}
training_precision: float32

Training results

Train Loss	Epoch
2.4132	0
2.4084	1
2.3948	2
2.3715	3
2.3110	4
2.2797	5
2.2699	6
2.2320	7
2.1178	8
2.1323	9
2.0598	10
2.1086	11
2.0487	12
1.9561	13
2.0067	14
1.8801	15
1.9177	16
1.9594	17
1.8946	18
1.8057	19
1.7603	20
1.7916	21
1.7090	22
1.7502	23
1.7377	24
1.7007	25
1.6427	26
1.6352	27
1.6317	28
1.6114	29

Framework versions

Transformers 4.30.2
TensorFlow 2.13.0
Datasets 2.13.1
Tokenizers 0.13.3

Library: transformers
Type: mbart
License: apache-2.0
Created: Jul 8, 2023
Updated: Jul 8, 2023