Downloads · 30 days
11
1% of all-time downloads
ro-bart-1024
Iulian277/ro-bart-1024
ro-bart-1024 is a summarization model from Iulian277. Use it when you need a shorter version of a longer text. It is set up for transformers.
This is a pretrained-from-scratch BART base model (140M parameters).
All-time downloads
1.8K
Public
Repo size
1.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin563 MB · 99%
At a glance
- Task
- Summarization
- Library
- transformers
- Model type
- bart
- Access
- Public
- Created
- May 23, 2023
- Updated
- Sep 4, 2023
- SHA
- 0cc0b927
Model card
From the Hugging Face model README
This is a pretrained-from-scratch BART base model (140M parameters).
Training was performed on a clean 50GB Romanian text corpus for 3M steps with these scripts. The model was trained with a maximum sequence length of 1024.
!! IMPORTANT !! This model was pretrained on the text corruption task, meaning this model is not usable in any downstream task without finetuning first!
- Task
- Summarization
- Library
- transformers
- Type
- bart
- Languages
- ro
- Created
- May 23, 2023
- Updated
- Sep 4, 2023