Downloads · 30 days
16
10% of all-time downloads
rajkumarrrk/gpt-2-fine-tuned-on-cnn-dm
gpt-2-fine-tuned-on-cnn-dm is a text generation model from rajkumarrrk. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
GPT-2 fine-tuned on CNN/DM summarization dataset.
Downloads · 30 days
16
10% of all-time downloads
All-time downloads
163
Public
Repo size
1 GB
Likes
0
Public
Click a slice to open those files.
.bin510 MB · 100%
From the Hugging Face model README
GPT-2 fine-tuned on CNN/DM summarization dataset.
Training args:
{
"learning_rate": 0.0001
"logging_steps": 5000
"lr_scheduler_type": "cosine"
"num_train_epochs": 2
"per_device_train_batch_size": 12, # Total batch size: 36
"weight_decay": 0.1
}
{"generation_kwargs": {"do_sample": true, "max_new_tokens": 100, "min_length": 50}
Pre-processing to truncate the article to contain only 500 tokens. Post-processing to consider only first three sentences as the summary.
Test split metrics:
Meteor: 0.2562237219960531
Rouge1: 0.3754558158439447
Rouge2: 0.15532626375157227
RougeL: 0.25813023509572597
RougeLsum: 0.3489472885043494
BLEU: 0.09285941365815623
Bert_score: 0.87570951795246\