Downloads · 30 days
15
20% of all-time downloads
DialoGPT-small-swda
skouras/DialoGPT-small-swda
DialoGPT-small-swda is a text generation model from skouras. Use it when you need the model to write or continue text. It is set up for transformers.
DialoGPT-small finetuned in the Switchboard Dialogue Act (SwDa) Corpus. The repository with additionally pre-processed SwDa dialogues of concatenated utterances per speaker, 80/10/10 train/val/test split and metadata,…
All-time downloads
74
Public
Repo size
2 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.pt996 MB · 66%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- gpt2
- Access
- Public
- Created
- Aug 12, 2022
- Updated
- Aug 12, 2022
- SHA
- 27dc94a8
Try a prompt
Model card
From the Hugging Face model README
DialoGPT-small finetuned in the Switchboard Dialogue Act (SwDa) Corpus. The repository with additionally pre-processed SwDa dialogues of concatenated utterances per speaker, 80/10/10 train/val/test split and metadata, is a fork of the Nathan Duran's repository. For finetuning the train_dialogpt.ipynb notebook from Nathan Cooper's Tutorial was used to finetune the model with slight modifications in Google Collab.
History dialogue context = 5. Number of utterances: 80704 (train set), 9749 (test set), 9616 (val set). Checkpoint-84000 after fine-tuning for 2 epochs with batch size 2.
Evaluation perplexity in SwDa from 635.6993 (pre-trainded model) to 18.1693 (fine-tuned model).
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- Created
- Aug 12, 2022
- Updated
- Aug 12, 2022