roberta-blm-tweets

soschuetze/roberta-blm-tweets

roberta-blm-tweets is a text classification model from soschuetze. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as mit.

probably proofread and complete it, then remove this comment. --

Downloads · 30 days

3% of all-time downloads

All-time downloads

272

Public

Repo size

499 MB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.h5499 MB · 100%

At a glance

Task: Text Classification
Library: transformers
License: mit
Model type: roberta
Access: Public
Created: Dec 13, 2022
Updated: Dec 13, 2022
SHA: 4e0e60c1

Try a prompt

Model card

From the Hugging Face model README

roberta-blm-tweets

This model is a fine-tuned version of roberta-base on an unknown dataset. It achieves the following results on the evaluation set:

Train Loss: 0.3333
Train Accuracy: 0.8964
Validation Loss: 1.5482
Validation Accuracy: 0.6106
Epoch: 7

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

optimizer: {'name': 'Adam', 'learning_rate': 5e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False}
training_precision: float32

Training results

Train Loss	Train Accuracy	Validation Loss	Validation Accuracy	Epoch
1.4279	0.4908	1.3684	0.5442	0
1.1474	0.6375	1.2189	0.5796	1
0.9645	0.7016	1.1257	0.6106	2
0.7404	0.7534	1.2809	0.6239	3
0.6608	0.7965	1.4192	0.5973	4
0.5460	0.8187	1.3828	0.5354	5
0.4058	0.8668	1.5394	0.5929	6
0.3333	0.8964	1.5482	0.6106	7

Framework versions

Transformers 4.25.1
TensorFlow 2.9.2
Tokenizers 0.13.2

Task: Text Classification
Library: transformers
Type: roberta
License: mit
Created: Dec 13, 2022
Updated: Dec 13, 2022