Downloads · 30 days
46
2% of all-time downloads
Jawaher/Covid19-fake-news-bert-uncased
Covid19-fake-news-bert-uncased is a fill-mask model from Jawaher. Use it when you need the model to fill a missing word. It is set up for transformers.
Domain adaptation is the process of fine-tuning pre-trained language models (PLMs) on domain-specific datasets to produce predictions that are better suited to the new datasets. Here, we re-train the BERT-base-uncased…
Downloads · 30 days
46
2% of all-time downloads
All-time downloads
2.3K
Public
Repo size
876 MB
Likes
0
Public
Click a slice to open those files.
.bin438 MB · 100%
From the Hugging Face model README
Domain adaptation is the process of fine-tuning pre-trained language models (PLMs) on domain-specific datasets to produce predictions that are better suited to the new datasets. Here, we re-train the BERT-base-uncased model on an unlabelled COVID-19 fake news dataset (Constraint@AAAI2021) using the masked language modeling (MLM) objective, where 15% of input text is masked, and the model is expected to predict the masked tokens.