Downloads · 30 days
20
0% of all-time downloads
alephbertgimmel-small
dicta-il/alephbertgimmel-small
alephbertgimmel-small is a fill-mask model from dicta-il. Use it when you need the model to fill a missing word. It is set up for transformers.
AlephBertGimmel - Modern Hebrew pretrained BERT model with a 128K token vocabulary.
All-time downloads
4.4K
Public
Parameters
78.8M
632 MB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin315 MB · 50%
Parameter types
How the weights are stored.
F3278.8M · 100%
Try a prompt
Model card
From the Hugging Face model README
alephbertgimmel
AlephBertGimmel - Modern Hebrew pretrained BERT model with a 128K token vocabulary.
NOTE: This model was only trained with sequences of up to 128 tokens.
When using AlephBertGimmel, please reference:
Eylon Guetta, Avi Shmidman, Shaltiel Shmidman, Cheyn Shmuel Shmidman, Joshua Guedalia, Moshe Koppel, Dan Bareket, Amit Seker and Reut Tsarfaty, "Large Pre-Trained Models with Extra-Large Vocabularies: A Contrastive Analysis of Hebrew BERT Models and a New One to Outperform Them All", Nov 2022 arXiv:2211.15199
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- Created
- Mar 23, 2023
- Updated
- Dec 28, 2024