Downloads · 30 days
5
1% of all-time downloads
bart-paper-titles-ai
pietrocagnasso/bart-paper-titles-ai
bart-paper-titles-ai is a machine learning model from pietrocagnasso. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
BART model used to generate scientific papers' title given the highlights and the abstract of the paper. This model is specifically tuned for artificial intelligence papers.
All-time downloads
523
Public
Repo size
3.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.2 GB · 100%
At a glance
- Library
- transformers
- Model type
- bart
- Access
- Public
- Created
- Dec 18, 2022
- Updated
- Feb 5, 2023
- SHA
- a48719f3
Model card
From the Hugging Face model README
BART model used to generate scientific papers' title given the highlights and the abstract of the paper. This model is specifically tuned for artificial intelligence papers.
This model is the result of a fine-tuning process done on sshleifer/distilbart-cnn-12-6. We performed a first fine-tuning epoch on CSPubSumm (Ed Collins, et al. "A supervised approach to extractive summarisation of scientific papers."), BIOPubSumm, and AIPubSumm (L. Cagliero, M. La Quatra "Extracting highlights of scientific articles: A supervised summarization approach.").
A second fine-tuning epoch was performed only on AIPubSumm to let the model better understand how artifical intelligence titles are composed.
You can find more details in the GitHub repo.
Usage
This checkpoint should be loaded into BartForConditionalGeneration.from_pretrained. See the
BART docs for more information.
Metrics
We have tested the model on all three the test sets, with the following results:
| Dataset | Rouge-1 F1 | Rouge-2 F1 | Rouge-L F1 | BERTScore F1 |
|---|---|---|---|---|
| AIPubSumm | 0.43325 | 0.22397 | 0.36069 | 0.90644 |
| BIOPubSumm | 0.45472 | 0.24739 | 0.39121 | 0.90131 |
| CSPubSumm | 0.52281 | 0.33140 | 0.46635 | 0.91861 |
- Library
- transformers
- Type
- bart
- Languages
- en
- Created
- Dec 18, 2022
- Updated
- Feb 5, 2023