Downloads · 30 days
12
3% of all-time downloads
twitter-eupol-model
rbroc/twitter-eupol-model
twitter-eupol-model is a feature extraction model from rbroc. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as mit.
DistilBERT model fine-tuned on 117567 English language tweets from a range of political agencies (EUCommission, UN, OECD, IMF, ECB, Council of the European Union, UK government, Scottish government). Fine-tuned with l…
All-time downloads
356
Public
Repo size
531 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin265 MB · 100%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- License
- mit
- Model type
- distilbert
- Access
- Public
- Created
- May 15, 2023
- Updated
- May 15, 2023
- SHA
- 437d1e45
Model card
From the Hugging Face model README
DistilBERT model fine-tuned on 117567 English language tweets from a range of political agencies (EU_Commission, UN, OECD, IMF, ECB, Council of the European Union, UK government, Scottish government). Fine-tuned with learning rate = 2e-5, 16-sample batches, chunk_size = 50 tokens, 100 epochs (early stopping patience = 3 epochs), 3 warmup epochs. More details can be found at: https://github.com/rbroc/eucomm-twitter. No evaluation was performed, as fine-tuning was merely functional to providing checkpoints for a contextualized topic model.
- Task
- Feature Extraction
- Library
- transformers
- Type
- distilbert
- License
- mit
- Languages
- en
- Created
- May 15, 2023
- Updated
- May 15, 2023