Downloads · 30 days
45
11% of all-time downloads
Tri-Distil-BERT
md-nishat-008/Tri-Distil-BERT
Tri-Distil-BERT is a fill-mask model from md-nishat-008. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as apache-2.0.
The model is pretrained on the OSCAR dataset for Bangla, English and Hindi. The base model is Distil-BERT and the intended use for this model is for the datasets that contain a mix of these languages.
All-time downloads
399
Public
Repo size
804 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin268 MB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- apache-2.0
- Model type
- distilbert
- Access
- Public
- Created
- Sep 17, 2023
- Updated
- Sep 26, 2023
- SHA
- f520aa9f
Try a prompt
Model card
From the Hugging Face model README
The model is pretrained on the OSCAR dataset for Bangla, English and Hindi. The base model is Distil-BERT and the intended use for this model is for the datasets that contain a mix of these languages.
To Cite:
@article{raihan2023mixed, title={Mixed-Distil-BERT: Code-mixed Language Modeling for Bangla, English, and Hindi}, author={Raihan, Md Nishat and Goswami, Dhiman and Mahmud, Antara}, journal={arXiv preprint arXiv:2309.10272}, year={2023} }
- Task
- Fill-Mask
- Library
- transformers
- Type
- distilbert
- License
- apache-2.0
- Created
- Sep 17, 2023
- Updated
- Sep 26, 2023