Downloads · 30 days
15
3% of all-time downloads
unlimiformer-bart-booksum-random-encoding
abertsch/unlimiformer-bart-booksum-random-encoding
unlimiformer-bart-booksum-random-encoding is a text generation model from abertsch. Use it when you need the model to write or continue text. It is set up for transformers.
Model from the preprint Unlimiformer: Long-Range Transformers with Unlimited Length Input.
All-time downloads
506
Public
Repo size
1.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin558 MB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- bart
- Access
- Public
- Created
- May 3, 2023
- Updated
- Jul 21, 2023
- SHA
- f7e78a3a
Try a prompt
Datasets
Model card
From the Hugging Face model README
Model from the preprint Unlimiformer: Long-Range Transformers with Unlimited Length Input.
This model was finetuned from a BART-base model using the random-encoding training strategy described in section 3.2 of the paper. It was finetuned on the dataset BookSum (full-book setting).
The inference demo is disabled because you must add the Unlimiformer files to your repo before this model can handle unlimited length input! See the Unlimiformer GitHub for setup instructions.
- Task
- Text Generation
- Library
- transformers
- Type
- bart
- Created
- May 3, 2023
- Updated
- Jul 21, 2023