Downloads · 30 days
11
3% of all-time downloads
thext-pce-cs
pietrocagnasso/thext-pce-cs
thext-pce-cs is a text classification model from pietrocagnasso. Use it when you need a label for a piece of text. It is set up for transformers.
Model based on BERT, employed in a regression task to predict the Rouge-2 of a sentence with respect to the highlights of the paper. Starting from the model proposed with the paper morenolq/thext-ai-scibert we perform…
All-time downloads
430
Public
Repo size
1.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin440 MB · 100%
At a glance
- Task
- Text Classification
- Library
- transformers
- Model type
- bert
- Access
- Public
- Created
- Feb 13, 2023
- Updated
- Feb 13, 2023
- SHA
- 0a070837
Try a prompt
Model card
From the Hugging Face model README
Model based on BERT, employed in a regression task to predict the Rouge-2 of a sentence with respect to the highlights of the paper. Starting from the model proposed with the paper morenolq/thext-ai-scibert we performed an additional fine-tuning contextualizing the sentence with our custom context, namely PCE-best. The additional training epoch was performed on CSPubSumm (Ed Collins, et al. "A supervised approach to extractive summarisation of scientific papers.".
You can find more details in the GitHub repo.
Usage
Tis checkpoint should be loaded into BertForSequenceClassification.from_pretrained. See the BERT docs for more information.
Metrics
We tested the model on CSPubSumm with the following results:
| CSPubSumm | |
|---|---|
| Rouge-1 F1 | 0.3738 |
| Rouge-2 F1 | 0.1613 |
| Rouge-L F1 | 0.3443 |
- Task
- Text Classification
- Library
- transformers
- Type
- bert
- Languages
- en
- Created
- Feb 13, 2023
- Updated
- Feb 13, 2023