Downloads · 30 days
5
1% of all-time downloads
bart-paper-titles-bio
pietrocagnasso/bart-paper-titles-bio
bart-paper-titles-bio is a machine learning model from pietrocagnasso. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
BART model used to generate scientific papers' title given the highlights and the abstract of the paper. This model is specifically tuned for biology and medicine papers.
All-time downloads
430
Public
Repo size
3.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.2 GB · 100%
At a glance
- Library
- transformers
- Model type
- bart
- Access
- Public
- Created
- Dec 18, 2022
- Updated
- Feb 5, 2023
- SHA
- 71740074
Model card
From the Hugging Face model README
BART model used to generate scientific papers' title given the highlights and the abstract of the paper. This model is specifically tuned for biology and medicine papers.
This model is the result of a fine-tuning process done on sshleifer/distilbart-cnn-12-6. We performed a first fine-tuning epoch on CSPubSumm (Ed Collins, et al. "A supervised approach to extractive summarisation of scientific papers."), BIOPubSumm, and AIPubSumm (L. Cagliero, M. La Quatra "Extracting highlights of scientific articles: A supervised summarization approach.").
A second fine-tuning epoch was performed only on BIOPubSumm to let the model better understand how biology and medicine titles are composed.
You can find more details in the GitHub repo.
Usage
This checkpoint should be loaded into BartForConditionalGeneration.from_pretrained. See the
BART docs for more information.
Metrics
We have tested the model on all three the test sets, with the following results:
| Dataset | Rouge-1 F1 | Rouge-2 F1 | Rouge-L F1 | BERTScore F1 |
|---|---|---|---|---|
| BIOPubSumm | 0.45979 | 0.25406 | 0.39607 | 0.90272 |
| AIPubSumm | 0.44455 | 0.23214 | 0.35779 | 0.90721 |
| CSPubSumm | 0.49769 | 0.30773 | 0.43376 | 0.91561 |
- Library
- transformers
- Type
- bart
- Languages
- en
- Created
- Dec 18, 2022
- Updated
- Feb 5, 2023