Downloads · 30 days
12
2% of all-time downloads
dialo_transfer_5epo
nikokons/dialo_transfer_5epo
dialo_transfer_5epo is a machine learning model from nikokons. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
This model uses the open sourced-weights of the DIALOGPT (microsoft/DialoGPT-small) and is fine-tuned to the PERSONA-CHAT dataset using an augmented input representation and a multi-task learning scheme, further descr…
All-time downloads
586
Public
Repo size
1.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin548 MB · 100%
At a glance
- Library
- transformers
- Model type
- gpt2
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Jul 27, 2021
- SHA
- deb39872
Model card
From the Hugging Face model README
A brief description:
This model uses the open sourced-weights of the DIALOGPT (microsoft/DialoGPT-small) and is fine-tuned to the PERSONA-CHAT dataset using an augmented input representation and a multi-task learning scheme, further described in the paper "TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agents". The model finetunes quickly to the PERSONA-CHAT dataset and 5 epochs of training was sufficient. A batch size of 4 and accumulated gradients over 8 iterations are used, resulting in the effective batch size of 32. In addition, the Adam optimization scheme with a learning rate of 6e-5 is used.
- Library
- transformers
- Type
- gpt2
- Created
- Mar 2, 2022
- Updated
- Jul 27, 2021