Downloads · 30 days
1.1K
5% of all-time downloads
mt5-small-spanish-summarization
josmunpen/mt5-small-spanish-summarization
mt5-small-spanish-summarization is a summarization model from josmunpen. Use it when you need a shorter version of a longer text. It is set up for transformers. The card lists the license as apache-2.0.
This is a mt5-small model finetuned for generating headlines from the body of the news in Spanish.
All-time downloads
20K
Public
Repo size
2.4 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin1.2 GB · 99%
At a glance
- Task
- Summarization
- Library
- transformers
- License
- apache-2.0
- Model type
- mt5
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Nov 3, 2021
- SHA
- 555ac638
Try a prompt
Datasets
Model card
From the Hugging Face model README
mt5-small-spanish-summarization
Model description
This is a mt5-small model finetuned for generating headlines from the body of the news in Spanish.
Training data
The model was trained with 58425 news extracted from the La Razón (31477) and Público (26948) newspapers. These news belong to the following categories: "España", "Cultura", "Economía", "Igualdad" and "Política".
Training procedure
It was trained with Google Colab's GPU Tesla P100-PCIE-16GB for 2 epochs.
Hyperparameters
{evaluation_strategy = "epoch", learning_rate = 2e-4, per_device_train_batch_size = 6, per_device_eval_batch_size = 6, weight_decay = 0.01, save_total_limi t= 3, num_train_epochs = 2, predict_with_generate = True, fp16 = False}
Eval results
| metric | score |
|---|---|
| rouge1 | 44.03 |
| rouge2 | 28.2900 |
| rougeL | 40.54 |
| rougeLsum | 40.5587 |
BibTeX entry and citation info
@inproceedings{ mt5lrpjosmunpen,
year={2020},
}
- Task
- Summarization
- Library
- transformers
- Type
- mt5
- License
- apache-2.0
- Languages
- es
- Created
- Mar 2, 2022
- Updated
- Nov 3, 2021