Downloads · 30 days
14
2% of all-time downloads
Iulian277/ro-bart-large-512
ro-bart-large-512 is a summarization model from Iulian277. Use it when you need a shorter version of a longer text. It is set up for transformers.
This is a pretrained-from-scratch BART large model (400M parameters).
Downloads · 30 days
14
2% of all-time downloads
All-time downloads
662
Public
Repo size
3.3 GB
Likes
0
Public
Click a slice to open those files.
.bin1.6 GB · 100%
From the Hugging Face model README
This is a pretrained-from-scratch BART large model (400M parameters).
Training was performed on a clean 50GB Romanian text corpus for 3M steps with these scripts. The model was trained with a maximum sequence length of 512.
!! IMPORTANT !! This model was pretrained on the text corruption task, meaning this model is not usable in any downstream task without finetuning first!