Downloads · 30 days
88
17% of all-time downloads
Mariamtc/finetuned-twitter-roberta-base-sep2022-tweetcognition
finetuned-twitter-roberta-base-sep2022-tweetcognition is a text classification model from Mariamtc. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as mit.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
88
17% of all-time downloads
All-time downloads
528
Public
Repo size
3 GB
Likes
1
Public
Click a slice to open those files.
.bin499 MB · 100%
From the Hugging Face model README
This model is a fine-tuned version of cardiffnlp/twitter-roberta-base-sep2022 on custom dataset consisting of 2527 recent tweets related to major life events that occur during the lifespan of the users. It achieves the following results on the evaluation set:
A RoBERTa-base model trained on 168.86M tweets until the end of September 2022 (15M tweets increment) finetuned and trained on custom dataset consisting of 2527 recent tweets related to major life events that occur during the lifespan of the users with the scope of performing a specific text xlassification task: classify posts from the Twitter social media platform into a set of 30 distinct classes, each representing a major life event that the author of the post recently experienced. RoBERTa (Robustly Optimized BERT approach) is a state-of-the-art natural language processing (NLP) model developed by Facebook AI.
The scope of this fine-tuned language model is to be used for a specific text classification task: classify posts from the Twitter social media platform into a set of 30 distinct classes, each representing a major life event that the author of the post recently experienced.
The model can be further improved by training on an even larger training dataset with an extended and more diverse set of life events classes.
A fine-tuning process was applied to the original model cardiffnlp/twitter-roberta-base-sep2022 by:
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|---|---|---|---|---|
| 2.0283 | 1.0 | 127 | 1.4553 | 0.8162 |
| 0.9216 | 2.0 | 254 | 0.5951 | 0.8992 |
| 0.4343 | 3.0 | 381 | 0.3544 | 0.9348 |
| 0.2629 | 4.0 | 508 | 0.2613 | 0.9486 |
| 0.1861 | 5.0 | 635 | 0.2433 | 0.9545 |