Downloads · 30 days
25
4% of all-time downloads
alex-atelo/flan-t5-small-finetuned-xlsum-en-accelerate
flan-t5-small-finetuned-xlsum-en-accelerate is a summarization model from alex-atelo. Use it when you need a shorter version of a longer text. It is set up for transformers. The card lists the license as wtfpl.
This model is a fine-tuned version of flan-t5-small on the csebuetnlp/xlsum dataset.
Downloads · 30 days
25
4% of all-time downloads
All-time downloads
594
Public
Parameters
77M
924 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors308 MB · 99%
From the Hugging Face model README
This model is a fine-tuned version of flan-t5-small on the csebuetnlp/xlsum dataset.
A reduced version of the English subset was used, focusing on shorter targets.
It achieves the following results on the evaluation set:
This modelcard aims to be a base template for new models. It has been generated using this raw template.
[More Information Needed]
[More Information Needed]
[More Information Needed]
Model can produce false information when summarizing.
This is very much an initial draft, and is not expected for use in production, use at your own risk.
[More Information Needed]
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
Use the code below to get started with the model.
[More Information Needed]
[More Information Needed]
[More Information Needed]
The following hyperparameters were used during training:
learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 3
Training regime: [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
[More Information Needed]
[More Information Needed]
[More Information Needed]
[More Information Needed]
| Epoch | rouge1 | rouge2 | rougeL | rougeLsum |
|---|---|---|---|---|
| 1.0 | 29.38 | 10.31 | 25.0 | 25.0 |
| 2.0 | 29.87 | 10.46 | 25.41 | 25.41 |
| 3.0 | 29.99 | 10.61 | 25.52 | 25.52 |
[More Information Needed]
[More Information Needed]
Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).
[More Information Needed]
[More Information Needed]
[More Information Needed]
[More Information Needed]
[More Information Needed]
BibTeX:
@inproceedings{hasan-etal-2021-xl,
title = "{XL}-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languages",
author = "Hasan, Tahmid and
Bhattacharjee, Abhik and
Islam, Md. Saiful and
Mubasshir, Kazi and
Li, Yuan-Fang and
Kang, Yong-Bin and
Rahman, M. Sohel and
Shahriyar, Rifat",
booktitle = "Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021",
month = aug,
year = "2021",
address = "Online",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2021.findings-acl.413",
pages = "4693--4703",
}
[More Information Needed]
APA:
[More Information Needed]
[More Information Needed]
[More Information Needed]
[More Information Needed]
[More Information Needed]