Downloads · 30 days
4.3K
15% of all-time downloads
BEREL_3.0
dicta-il/BEREL_3.0
BEREL_3.0 is a text generation model from dicta-il. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
28.2K
Public
Parameters
184M
3 GB on disk
Likes
5
Public
Repo makeup
Click a slice to open those files.
.bin738 MB · 50%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- bert
- Access
- Public
- Created
- Jun 26, 2023
- Updated
- Jun 16, 2025
- SHA
- 25dc07f2
Model card
From the Hugging Face model README
Introducing BEREL 3.0 - New and Improved BEREL: BERT Embeddings for Rabbinic-Encoded Language
When using BEREL 3.0, please reference:
Avi Shmidman, Joshua Guedalia, Shaltiel Shmidman, Cheyn Shmuel Shmidman, Eli Handel, Moshe Koppel, "Introducing BEREL: BERT Embeddings for Rabbinic-Encoded Language", Aug 2022 [arXiv:2208.01875]
- Usage:
from transformers import AutoTokenizer, BertForMaskedLM
tokenizer = AutoTokenizer.from_pretrained('dicta-il/BEREL_3.0')
model = BertForMaskedLM.from_pretrained('dicta-il/BEREL_3.0')
# for evaluation, disable dropout
model.eval()
NOTE: This code will not work and provide bad results if you use
BertTokenizer. Please useAutoTokenizerorBertTokenizerFast.
- Task
- Text Generation
- Library
- transformers
- Type
- bert
- License
- apache-2.0
- Languages
- he
- Created
- Jun 26, 2023
- Updated
- Jun 16, 2025