Downloads · 30 days
8
1% of all-time downloads
seantw/covid-19-vaccination-tweet-stance
covid-19-vaccination-tweet-stance is a text classification model from seantw. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as mit.
This model is a text classifier trained to determine the stance of a tweet towards the COVID-19 vaccination. It is designed to classify tweets into three categories: in-favor, against, and neutral-or-unclear. Note tha…
Downloads · 30 days
8
1% of all-time downloads
All-time downloads
710
Public
Repo size
2.7 GB
Likes
0
Public
Click a slice to open those files.
.bin1.3 GB · 100%
From the Hugging Face model README
This model is a text classifier trained to determine the stance of a tweet towards the COVID-19 vaccination. It is designed to classify tweets into three categories: in-favor, against, and neutral-or-unclear. Note that this classifier only works for tweet that is related to COVID-19 vaccination. For classifying whether a tweet is related to COVID-19 vaccination or not, please refer to covid-19-vaccination-tweet-relevance.
tokenizer = AutoTokenizer.from_pretrained("seantw/covid-19-vaccination-tweet-stance")
model = AutoModel.from_pretrained("seantw/covid-19-vaccination-tweet-stance")
The training corpus consists of 5000 tweets, randomly sampled daily from December 2020 to June 2022. These tweets were labeled by domain experts. These tweets are all related to COVID-19 vaccination.
We have seperated trained another model for classifying whether a tweet is related to COVID-19 vaccination or not. Please refer to covid-19-vaccination-tweet-relevance for more information.
The model's performance metrics on the test set are as follows:
These metrics are based on a test set with a total size of 506 samples.
Note: Because the performance on the "neutral-or-unclear" class is significantly worse than the other two classes, we recommend users to exercise caution when interpreting the label of this "neutral-or-unclear" class. If you are only interested in either the "in-favor" or "against" classes, you can frame this as a binary classification problem and combine the "neutral-or-unclear" class with either the "in-favor" or "against" class.
The confusion matrix of predictions on the test set is as follows:
| Predicted: neutral-or-unclear | Predicted: in-favor | Predicted: against | |
|---|---|---|---|
| True: neutral-or-unclear | 61 | 16 | 14 |
| True: in-favor | 40 | 203 | 14 |
| True: against | 24 | 6 | 128 |
The model is fine-tuned based on COVID-Twitter-BERT v2.
Sean Yun-Shiuan Chuang ([email protected])