Downloads · 30 days
208
1% of all-time downloads
mrm8488/GPT-2-finetuned-covid-bio-medrxiv
GPT-2-finetuned-covid-bio-medrxiv is a text generation model from mrm8488. Use it when you need the model to write or continue text. It is set up for transformers.
GPT-2 fine-tuned on biorxivmedrxiv files from CORD-19 dataset.
Downloads · 30 days
208
1% of all-time downloads
All-time downloads
18.9K
Public
Repo size
1.6 GB
Likes
1
Public
Click a slice to open those files.
.bin548 MB · 52%
From the Hugging Face model README
GPT-2 fine-tuned on biorxiv_medrxiv files from CORD-19 dataset.
| Dataset | # Files |
|---|---|
| biorxiv_medrxiv | 885 |
The model was trained on a Tesla P100 GPU and 25GB of RAM with the following command:
export TRAIN_FILE=/path/to/dataset/train.txt
python run_language_modeling.py \\n --model_type gpt2 \\n --model_name_or_path gpt2 \\n --do_train \\n --train_data_file $TRAIN_FILE \\n --num_train_epochs 4 \\n --output_dir model_output \\n --overwrite_output_dir \\n --save_steps 2000 \\n --per_gpu_train_batch_size 3
You can get the following script here
python run_generation.py \\n --model_type gpt2 \\n --model_name_or_path mrm8488/GPT-2-finetuned-CORD19 \\n --length 200
👵👴🦠
# Input: Old people with COVID-19 tends to suffer
# Output: === GENERATED SEQUENCE 1 ===
Old people with COVID-19 tends to suffer more symptom onset time and death. It is well known that many people with COVID-19 have high homozygous ZIKV infection in the face of severe symptoms in both severe and severe cases.
The origin of Wuhan Fever was investigated by Prof. Shen Jiang at the outbreak of Wuhan Fever [34]. As Huanan Province is the epicenter of this outbreak, Huanan, the epicenter of epidemic Wuhan Fever, is the most potential location for the direct transmission of infection (source: Zhongzhen et al., 2020). A negative risk ratio indicates more frequent underlying signs in the people in Huanan Province with COVID-19 patients. Further analysis of reported Huanan Fever onset data in the past two years indicated that the intensity of exposure is the key risk factor for developing MERS-CoV infection in this region, especially among children and elderly. To be continued to develop infected patients would be a very important area for

Created by Manuel Romero/@mrm8488 | LinkedIn
Made with <span style="color: #e25555;">♥</span> in Spain