Downloads · 30 days
15
0% of all-time downloads
HHousen/distil-led-large-cnn-16384
distil-led-large-cnn-16384 is a machine learning model from HHousen. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
distil-led-large-cnn-16384 was initialized from sshleifer/distilbart-cnn-12-6, in a fashion similar to allenai/led-large-16384.
Downloads · 30 days
15
0% of all-time downloads
All-time downloads
21.7K
Public
Repo size
2.6 GB
Likes
4
Public
Click a slice to open those files.
.bin1.3 GB · 100%
From the Hugging Face model README
distil-led-large-cnn-16384 was initialized from sshleifer/distilbart-cnn-12-6, in a fashion similar to allenai/led-large-16384.
To be able to process 16K tokens, sshleifer/distilbart-cnn-12-6's position embedding matrix was simply copied 16 times.
This checkpoint should be loaded into LEDForConditionalGeneration.from_pretrained. See the LED documentation for more information.