Downloads · 30 days
26
2% of all-time downloads
ro-bart-512
Iulian277/ro-bart-512
ro-bart-512 is a summarization model from Iulian277. Use it when you need a shorter version of a longer text. It is set up for transformers.
This is a pretrained-from-scratch BART base model (140M parameters).
All-time downloads
1.2K
Public
Repo size
1.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin563 MB · 99%
At a glance
- Task
- Summarization
- Library
- transformers
- Model type
- bart
- Access
- Public
- Created
- Apr 13, 2023
- Updated
- May 23, 2023
- SHA
- 64cefb64
Model card
From the Hugging Face model README
This is a pretrained-from-scratch BART base model (140M parameters).
Training was performed on a clean 50GB Romanian text corpus for 3M steps with these scripts. The model was trained with a maximum sequence length of 512.
!! IMPORTANT !! This model was pretrained on the text corruption task, meaning this model is not usable in any downstream task without finetuning first!
- Task
- Summarization
- Library
- transformers
- Type
- bart
- Languages
- ro
- Created
- Apr 13, 2023
- Updated
- May 23, 2023