Fine-tuned-t5-text-summarizer

T5 model is fine tuned on custom dataset

Dataset

https://huggingface.co/datasets/pranjal01/Text-summarizer-dataset

Hypterparameters

evaluation_strategy="epoch",
learning_rate=1e-4,
per_device_train_batch_size=2,
per_device_eval_batch_size=2,
weight_decay=0.01,
save_total_limit=3,
num_train_epochs=50,
predict_with_generate=True,
fp16=True,
push_to_hub=True,

Training Result

Inference

test_text= " summarize: Why is this deal historic?
It is just another club for Lionel Messi to go to and show his skills but it is indeed
historic for the MLS and American Football as a whole. This will bring them the most eyeballs
they have ever seen. The social media following of Inter Miami has risen by more than 300% and
the ticket price for all the matches of Inter Miami have gone from $50 to $10,000 . The amount
of worldwide attention that the MLS will get from this one signing will be humongous.
Lionel Messi will bring fans to the Stadiums and Inter Miami will have to move
from their 18,000 seater stadium to the Hard Rock Café Stadium which has a capacity of 70,000 because
that is the standard of Messi. The sponsors that both Inter Miami and the league will get are
unfathomable. It is like Michael Jordan playing in the Spanish Basketball League. All the celebrities
will line up to watch him play and new TV and streaming deals will be made with all the countries around
the world like India."

Summary: The sponsors that both Inter Miami and the league will get are unfathomable.Lionel Messi will bring fans to the Stadiums and Inter Miami
will have to move from their 18,000 seater stadium to the Hard Rock Café Stadium which has a capacity of 70,000 because that is the standard of Messi.
The social media following of Inter Miami has risen by more than 300% and the ticket price for all the matches of Inter Miami have gone from $50 to $10,000.
It is just another club for Lionel Messi to go to and show his skills but it is indeed historic for the MLS and American Football as a whole.