64_no_mask_bert_model_1

iTroned/64_no_mask_bert_model_1

64_no_mask_bert_model_1 is a machine learning model from iTroned. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

Access

Public

Updated Apr 2, 2025

Parameters

194K

7.8 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors776 KB · 99%

At a glance

Library: transformers
License: apache-2.0
Access: Public
Created: Apr 2, 2025
Updated: Apr 2, 2025
SHA: 07ced58d

Base models

Model card

From the Hugging Face model README

64_no_mask_bert_model_1

This model is a fine-tuned version of bert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.0898
Accuracy Offensive: 0.9539
F1 Offensive: 0.9531
Accuracy Targeted: 0.9849
F1 Targeted: 0.9836
Accuracy Stance: 0.9135
F1 Stance: 0.8963

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 1e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy Offensive	F1 Offensive	Accuracy Targeted	F1 Targeted	Accuracy Stance	F1 Stance
0.524	1.0	1324	0.2720	0.9384	0.9368	0.9524	0.9300	0.8912	0.8478
0.2035	2.0	2648	0.1855	0.9528	0.9519	0.9532	0.9308	0.8912	0.8503
0.1686	3.0	3972	0.1527	0.9532	0.9523	0.9535	0.9311	0.8912	0.8517
0.1453	4.0	5296	0.1310	0.9535	0.9527	0.9539	0.9320	0.8912	0.8556
0.1297	5.0	6620	0.1175	0.9535	0.9527	0.9554	0.9363	0.8916	0.8571
0.1174	6.0	7944	0.1079	0.9535	0.9527	0.9585	0.9428	0.8992	0.8729
0.116	7.0	9268	0.0990	0.9535	0.9527	0.9724	0.9673	0.9105	0.8913
0.1056	8.0	10592	0.0933	0.9539	0.9531	0.9834	0.9818	0.9063	0.8851
0.1057	9.0	11916	0.0910	0.9539	0.9531	0.9849	0.9836	0.9071	0.8863
0.0994	10.0	13240	0.0898	0.9539	0.9531	0.9849	0.9836	0.9135	0.8963

Framework versions

Transformers 4.50.2
Pytorch 2.6.0+cu124
Datasets 3.0.1
Tokenizers 0.21.1

Library: transformers
License: apache-2.0
Created: Apr 2, 2025
Updated: Apr 2, 2025