Downloads · 30 days
24
2% of all-time downloads
GPT-2-covid-news-articles
arun-shankar/GPT-2-covid-news-articles
GPT-2-covid-news-articles is a text generation model from arun-shankar. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Dataset: https://www.kaggle.com/datasets/timmayer/covid-news-articles-2020-2022
All-time downloads
1.3K
Public
Parameters
137M
1 GB on disk
Likes
4
Public
Repo makeup
Click a slice to open those files.
.bin510 MB · 50%
Parameter types
How the weights are stored.
F32124M · 91%
Try a prompt
Model card
From the Hugging Face model README
Dataset: https://www.kaggle.com/datasets/timmayer/covid-news-articles-2020-2022
Comprehensive guide can be found here: https://medium.com/@shankar.arunp/easily-build-your-own-gpt-from-scratch-using-aws-51811b6355d3
The model is GPT2 further pre-trained on the news articles to incorporate COVID-19 related context to the model.
Similar article on how to further pre-train a BERT base model from scratch using the articles can be found here: https://medium.com/@shankar.arunp/training-bert-from-scratch-on-your-custom-domain-data-a-step-by-step-guide-with-amazon-25fcbee4316a
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- License
- apache-2.0
- Languages
- en
- Created
- Jan 30, 2023
- Updated
- Mar 24, 2023