emtract-distilbert-base-uncased-emotion

EmTract (DistilBERT-Base-Uncased)

Model Description

emtract-distilbert-base-uncased-emotion is a specialized model finetuned on a combination of unify-emotion-datasets, containing around 250K texts labeled across seven emotion categories: neutral, happy, sad, anger, disgust, surprise, and fear. This model was later adapted to a smaller set of 10K hand-tagged messages from StockTwits. The model is designed to excel at emotion detection in financial social media content such as that found on StockTwits.

Model parameters were as follows: sequence length of 64, learning rate of 2e-5, batch size of 128, trained for 8 epochs. For steps on how to use the model for inference, please refer to the accompanying Inference.ipynb notebook.

Training Data

The first part of the training data was obtained from the Unify Emotion Datasets available at here. The second part I obtained from social media and hand-tagged. It is available here.

Evaluation Metrics

The model was evaluated using the following metrics:

• Accuracy
• Precision
• Recall
• F1-score

Research

The underlying research for emotion extraction from financial social media can be found on: arxiv and SSRN.

Citation

Please cite the following if you use this model:

Vamossy, Domonkos F., and Rolf Skog. "EmTract: Extracting Emotions from Social Media." Available at SSRN 3975884 (2023).

BibTex citation:

@article{vamossy2023emtract,
  title={EmTract: Extracting Emotions from Social Media},
  author={Vamossy, Domonkos F and Skog, Rolf},
  journal={Available at SSRN 3975884},
  year={2023}
}

Research using EmTract

Social Media Emotions and IPO Returns

Investor Emotions and Earnings Announcements

License

This project is licensed under the terms of the MIT license.