arabart-v2-sum-fine-tuned

HeshamMamdouh/arabart-v2-sum-fine-tuned

arabart-v2-sum-fine-tuned is a machine learning model from HeshamMamdouh. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.

probably proofread and complete it, then remove this comment. --

Downloads · 30 days

14% of all-time downloads

All-time downloads

Public

Repo size

557 MB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.h5557 MB · 100%

At a glance

Library: transformers
License: apache-2.0
Model type: mbart
Access: Public
Created: Jul 6, 2023
Updated: Jul 6, 2023
SHA: 679b6b3a

Model card

From the Hugging Face model README

arabart-v2-sum-fine-tuned

This model is a fine-tuned version of abdalrahmanshahrour/AraBART-summ on an unknown dataset. It achieves the following results on the evaluation set:

Train Loss: 2.0702
Validation Loss: 2.6760
Epoch: 19

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 2e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}
training_precision: float32

Training results

Train Loss	Validation Loss	Epoch
2.9033	2.5054	0
2.8269	2.5495	1
2.7380	2.5277	2
2.6357	2.5637	3
2.6693	2.5888	4
2.6560	2.5696	5
2.5431	2.5702	6
2.6064	2.5789	7
2.5252	2.5570	8
2.4553	2.6162	9
2.4159	2.5925	10
2.4123	2.6065	11
2.3180	2.6371	12
2.2778	2.6259	13
2.2570	2.6121	14
2.1909	2.6489	15
2.1705	2.6390	16
2.1008	2.6628	17
2.0684	2.6929	18
2.0702	2.6760	19

Framework versions

Transformers 4.30.2
TensorFlow 2.11.0
Datasets 2.13.1
Tokenizers 0.12.1

Library: transformers
Type: mbart
License: apache-2.0
Created: Jul 6, 2023
Updated: Jul 6, 2023