Downloads · 30 days
29
0% of all-time downloads
DialogLED-large-5120
MingZhong/DialogLED-large-5120
DialogLED-large-5120 is a machine learning model from MingZhong. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization.
All-time downloads
21K
Public
Repo size
7.1 GB
Likes
8
Public
Repo makeup
Click a slice to open those files.
.pt3.4 GB · 65%
At a glance
- Library
- transformers
- Model type
- led
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Jan 5, 2022
- SHA
- b6c71369
Model card
From the Hugging Face model README
DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization.
Introduction
DialogLED is a pre-trained model for long dialogue understanding and summarization. It builds on the Longformer-Encoder-Decoder (LED) architecture and uses window-based denoising as the pre-training task on a large amount of long dialogue data for further training. Here is a large version of DialogLED, the input length is limited to 5,120 in the pre-training phase.
Finetuning for Downstream Tasks
Please refer to our GitHub page.
- Library
- transformers
- Type
- led
- Created
- Mar 2, 2022
- Updated
- Jan 5, 2022