Downloads · 30 days
155
4% of all-time downloads
BEREL
dicta-il/BEREL
BEREL is a fill-mask model from dicta-il. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as apache-2.0.
Update 2025-5-12: This model is BEREL version 1.0. We are now happy to provide a much improved BEREL3.0.
All-time downloads
3.8K
Public
Parameters
184M
1.5 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin738 MB · 50%
Parameter types
How the weights are stored.
F32184M · 100%
Model card
From the Hugging Face model README
Update 2025-5-12: This model is
BERELversion 1.0. We are now happy to provide a much improved BEREL_3.0.
Introducing BEREL: BERT Embeddings for Rabbinic-Encoded Language
When using BEREL, please reference:
Avi Shmidman, Joshua Guedalia, Shaltiel Shmidman, Cheyn Shmuel Shmidman, Eli Handel, Moshe Koppel, "Introducing BEREL: BERT Embeddings for Rabbinic-Encoded Language", Aug 2022 [arXiv:2208.01875]
- Usage:
from transformers import AutoTokenizer, BertForMaskedLM
tokenizer = AutoTokenizer.from_pretrained('dicta-il/BEREL')
model = BertForMaskedLM.from_pretrained('dicta-il/BEREL')
# for evaluation, disable dropout
model.eval()
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- License
- apache-2.0
- Languages
- he
- Created
- Jun 26, 2023
- Updated
- May 12, 2025