lvbert-lv-go-emotions

SkyWater21/lvbert-lv-go-emotions

lvbert-lv-go-emotions is a text classification model from SkyWater21. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as mit.

Fine-tuned LVBERT for multi-label emotion classification task.

Downloads · 30 days

14% of all-time downloads

All-time downloads

Public

Parameters

111M

443 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors443 MB · 100%

At a glance

Task: Text Classification
Library: transformers
License: mit
Model type: bert
Access: Public
Created: Apr 16, 2024
Updated: Apr 26, 2024
SHA: 19355f4b

Datasets

SkyWater21/lv_go_emotions

Model card

From the Hugging Face model README

Fine-tuned LVBERT for multi-label emotion classification task.

Model was trained on lv_go_emotions dataset. This dataset is Latvian translation of GoEmotions dataset. Google Translate was used to generate the machine translation.

Labels:

0: admiration
1: amusement
2: anger
3: annoyance
4: approval
5: caring
6: confusion
7: curiosity
8: desire
9: disappointment
10: disapproval
11: disgust
12: embarrassment
13: excitement
14: fear
15: gratitude
16: grief
17: joy
18: love
19: nervousness
20: optimism
21: pride
22: realization
23: relief
24: remorse
25: sadness
26: surprise
27: neutral

Seed used for random number generator is 42:

def set_seed(seed=42):
    random.seed(seed)
    np.random.seed(seed)
    torch.manual_seed(seed)
    if torch.cuda.is_available():
        torch.cuda.manual_seed_all(seed)

Training parameters:

max_length: null
batch_size: 32
shuffle: True
num_workers: 2
pin_memory: False
drop_last: False

optimizer: adam
lr: 0.00001
weight_decay: 0

problem_type: multi_label_classification

num_epochs: 5

Evaluation results on test split of lv_go_emotions

	Precision	Recall	F1-Score	AUC-ROC	Support
admiration	0.64	0.64	0.64	0.92	504
amusement	0.76	0.85	0.80	0.96	264
anger	0.51	0.21	0.29	0.86	198
annoyance	0.49	0.15	0.23	0.78	320
approval	0.35	0.33	0.34	0.80	351
caring	0.43	0.39	0.41	0.89	135
confusion	0.53	0.33	0.41	0.94	153
curiosity	0.49	0.42	0.45	0.94	284
desire	0.63	0.37	0.47	0.92	83
disappointment	0.45	0.11	0.18	0.82	151
disapproval	0.45	0.25	0.32	0.84	267
disgust	0.63	0.29	0.40	0.92	123
embarrassment	0.50	0.14	0.21	0.85	37
excitement	0.55	0.16	0.24	0.89	103
fear	0.65	0.58	0.61	0.95	78
gratitude	0.88	0.91	0.90	0.99	352
grief	0.00	0.00	0.00	0.78	6
joy	0.61	0.39	0.47	0.93	161
love	0.80	0.69	0.74	0.97	238
nervousness	0.00	0.00	0.00	0.95	23
optimism	0.57	0.47	0.52	0.90	186
pride	0.00	0.00	0.00	0.73	16
realization	0.29	0.08	0.13	0.76	145
relief	0.00	0.00	0.00	0.85	11
remorse	0.54	0.68	0.60	0.98	56
sadness	0.60	0.50	0.54	0.93	156
surprise	0.65	0.41	0.50	0.92	141
neutral	0.67	0.50	0.57	0.81	1787
micro avg	0.62	0.46	0.53	0.93	6329
macro avg	0.49	0.35	0.39	0.88	6329
weighted avg	0.60	0.46	0.51	0.87	6329
samples avg	0.52	0.48	0.49	nan	6329

Task: Text Classification
Library: transformers
Type: bert
License: mit
Languages: lv
Created: Apr 16, 2024
Updated: Apr 26, 2024