Downloads · 30 days
29
3% of all-time downloads
mitra-mir/ALBERT-Persian-Poetry
ALBERT-Persian-Poetry is a fill-mask model from mitra-mir. Use it when you need the model to fill a missing word. It is set up for transformers.
A Transformer-based Persian Language Model Further Pretrained on Persian Poetry
Downloads · 30 days
29
3% of all-time downloads
All-time downloads
848
Public
Repo size
196 MB
Likes
0
Public
Click a slice to open those files.
.h560.7 MB · 57%
From the Hugging Face model README
A Transformer-based Persian Language Model Further Pretrained on Persian Poetry
ALBERT was first introduced by Hooshvare with 30,000 vocabulary size as lite BERT for self-supervised learning of language representations for the Persian language. Here we wanted to utilize its capabilities by pretraining it on a large corpse of Persian poetry. This model has been post-trained on 80 percent of poetry verses of the Persian poetry dataset - Ganjoor- and has been evaluated on the other 20 percent.