Downloads · 30 days
57
2% of all-time downloads
EnvironmentalBERT-base
ESGBERT/EnvironmentalBERT-base
EnvironmentalBERT-base is a fill-mask model from ESGBERT. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as apache-2.0.
Based on this paper, this is the EnvironmentalBERT-base language model. A language model that is trained to better understand environmental texts in the ESG domain.
All-time downloads
2.8K
Public
Repo size
986 MB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.bin329 MB · 99%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- apache-2.0
- Model type
- roberta
- Access
- Public
- Created
- Nov 4, 2023
- Updated
- Nov 10, 2025
- SHA
- 3da9585c
Try a prompt
Model card
From the Hugging Face model README
Model Card for EnvironmentalBERT-base
Model Description
Based on this paper, this is the EnvironmentalBERT-base language model. A language model that is trained to better understand environmental texts in the ESG domain.
Using the DistilRoBERTa model as a starting point, the EnvironmentalBERT-base Language Model is additionally pre-trained on a text corpus comprising environmental-related annual reports, sustainability reports, and corporate and general news.
More details can be found in the paper
@article{schimanski_ESGBERT_2024,
title = {Bridging the gap in ESG measurement: Using NLP to quantify environmental, social, and governance communication},
journal = {Finance Research Letters},
volume = {61},
pages = {104979},
year = {2024},
issn = {1544-6123},
doi = {https://doi.org/10.1016/j.frl.2024.104979},
url = {https://www.sciencedirect.com/science/article/pii/S1544612324000096},
author = {Tobias Schimanski and Andrin Reding and Nico Reding and Julia Bingler and Mathias Kraus and Markus Leippold},
}
- Task
- Fill-Mask
- Library
- transformers
- Type
- roberta
- License
- apache-2.0
- Languages
- en
- Created
- Nov 4, 2023
- Updated
- Nov 10, 2025