Downloads · 30 days
53
1% of all-time downloads
finbert-pretrain-yiyanghkust
philschmid/finbert-pretrain-yiyanghkust
finbert-pretrain-yiyanghkust is a fill-mask model from philschmid. Use it when you need the model to fill a missing word. It is set up for transformers.
All-time downloads
3.6K
Public
Repo size
1.4 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.h5536 MB · 55%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- Model type
- bert
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Nov 5, 2021
- SHA
- 90f3550f
Try a prompt
Model card
From the Hugging Face model README
This repository is a fork of yiyanghkust/finbert-pretrain
All credits to @yiyanghkust.
I added the TensorFlow model and a proper tokenizer.json
FinBERT is a BERT model pre-trained on financial communication text. The purpose is to enhance financial NLP research and practice. It is trained on the following three financial communication corpus. The total corpora size is 4.9B tokens.
- Corporate Reports 10-K & 10-Q: 2.5B tokens
- Earnings Call Transcripts: 1.3B tokens
- Analyst Reports: 1.1B tokens
More details on FinBERT's pre-training process can be found at: https://arxiv.org/abs/2006.08097
FinBERT can be further fine-tuned on downstream tasks. Specifically, we have fine-tuned FinBERT on an analyst sentiment classification task, and the fine-tuned model is shared at https://huggingface.co/yiyanghkust/finbert-tone
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- Languages
- en
- Created
- Mar 2, 2022
- Updated
- Nov 5, 2021