Downloads · 30 days
12
15% of all-time downloads
xlm-roberta-sentiment-base
carant-ai/xlm-roberta-sentiment-base
xlm-roberta-sentiment-base is a text classification model from carant-ai. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as apache-2.0.
Finetuned xlm-roberta-base for Sentiment Analysis in English and Bahasa Indonesia Trained on TPU VM v4-8 for ~3 hours For replication, go to GitHub page 1. Google’s TPU Research Cloud (TRC) for providing Cloud TPU VM.…
All-time downloads
78
Public
Parameters
278M
2.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.1 GB · 98%
At a glance
- Task
- Text Classification
- Library
- transformers
- License
- apache-2.0
- Model type
- xlm-roberta
- Access
- Public
- Created
- May 9, 2024
- Updated
- Jun 3, 2024
- SHA
- 1436fa17
Try a prompt
Model card
From the Hugging Face model README
Model Description
Finetuned xlm-roberta-base for Sentiment Analysis in English and Bahasa Indonesia
Training results
Trained on TPU VM v4-8 for ~3 hours
| epoch | step | train_accuracy | train_loss | val_accuracy | val_loss |
|---|---|---|---|---|---|
| 0 | 5391 | 0.955597997 | 0.118527733 | 0.963498533 | 0.098501749 |
| 1 | 10783 | 0.965486944 | 0.092906699 | 0.964689374 | 0.094814248 |
| 2 | 16175 | 0.968293846 | 0.085916176 | 0.965770006 | 0.093040377 |
Training procedure
For replication, go to GitHub page
Special Thanks
- Google’s TPU Research Cloud (TRC) for providing Cloud TPU VM.
- carlesoctav for making the training script on TPU VM
- thonyyy for gathering the sentiment dataset
- Task
- Text Classification
- Library
- transformers
- Type
- xlm-roberta
- License
- apache-2.0
- Languages
- en, id
- Created
- May 9, 2024
- Updated
- Jun 3, 2024