Downloads · 30 days
17
22% of all-time downloads
DialoGPT-small-maptask
skouras/DialoGPT-small-maptask
DialoGPT-small-maptask is a text generation model from skouras. Use it when you need the model to write or continue text. It is set up for transformers.
DialoGPT-small finetuned in the Maptask Corpus. The repository with additionally pre-processed Maptask dialogues of concatenated utterances per speaker, 80/10/10 train/val/test split and metadata, is a fork of the Nat…
All-time downloads
76
Public
Repo size
1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin510 MB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- gpt2
- Access
- Public
- Created
- Aug 12, 2022
- Updated
- Aug 12, 2022
- SHA
- de03235d
Try a prompt
Model card
From the Hugging Face model README
DialoGPT-small finetuned in the Maptask Corpus. The repository with additionally pre-processed Maptask dialogues of concatenated utterances per speaker, 80/10/10 train/val/test split and metadata, is a fork of the Nathan Duran's repository. For finetuning the train_dialogpt.ipynb notebook from Nathan Cooper's Tutorial was used to finetune the model with slight modifications in Google Collab.
History dialogue context = 5. Number of utterances: 14712 (train set), 1964 (test set), 2017 (val set). Fine-tuning for 3 epochs with batch size 2.
Evaluation perplexity in Maptask from 410.7796 (pre-trainded model) to 19.7469 (fine-tuned model).
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- Created
- Aug 12, 2022
- Updated
- Aug 12, 2022