Downloads · 30 days
9
2% of all-time downloads
thext-pce-bio
pietrocagnasso/thext-pce-bio
thext-pce-bio is a text classification model from pietrocagnasso. Use it when you need a label for a piece of text. It is set up for transformers.
Model based on BERT, employed in a regression task to predict the Rouge-2 of a sentence with respect to the highlights of the paper. Starting from the model proposed with the paper morenolq/thext-bio-scibert we perfor…
All-time downloads
451
Public
Repo size
1.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin440 MB · 100%
At a glance
- Task
- Text Classification
- Library
- transformers
- Model type
- bert
- Access
- Public
- Created
- Feb 13, 2023
- Updated
- Feb 13, 2023
- SHA
- b1fd41b8
Try a prompt
Model card
From the Hugging Face model README
Model based on BERT, employed in a regression task to predict the Rouge-2 of a sentence with respect to the highlights of the paper. Starting from the model proposed with the paper morenolq/thext-bio-scibert we performed an additional fine-tuning contextualizing the sentence with our custom context, namely PCE-best. The additional training epoch was performed on BIOPubSumm (L. Cagliero, M. La Quatra "Extracting highlights of scientific articles: A supervised summarization approach.").
You can find more details in the GitHub repo.
Usage
Tis checkpoint should be loaded into BertForSequenceClassification.from_pretrained. See the BERT docs for more information.
Metrics
We tested the model on BIOPubSumm with the following results:
| BIOPubSumm | |
|---|---|
| Rouge-1 F1 | 0.3335 |
| Rouge-2 F1 | 0.1222 |
| Rouge-L F1 | 0.3038 |
- Task
- Text Classification
- Library
- transformers
- Type
- bert
- Languages
- en
- Created
- Feb 13, 2023
- Updated
- Feb 13, 2023