ArabicNewSplits2_FineTuningAraBERT_run1_AugV5_k1_task1_organization

MayBashendy/ArabicNewSplits2_FineTuningAraBERT_run1_AugV5_k1_task1_organization

ArabicNewSplits2_FineTuningAraBERT_run1_AugV5_k1_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

50% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 1, 2024
Updated: Dec 1, 2024
SHA: f11e78b7

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits2_FineTuningAraBERT_run1_AugV5_k1_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.7351
Qwk: 0.7118
Mse: 0.7351
Rmse: 0.8574

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.25	2	3.3462	0.0246	3.3462	1.8293
No log	0.5	4	1.7176	0.1408	1.7176	1.3106
No log	0.75	6	1.3554	0.2674	1.3554	1.1642
No log	1.0	8	1.3169	0.2526	1.3169	1.1476
No log	1.25	10	1.0782	0.1616	1.0782	1.0384
No log	1.5	12	1.0205	0.2159	1.0205	1.0102
No log	1.75	14	0.9941	0.2931	0.9941	0.9970
No log	2.0	16	1.1318	0.1996	1.1318	1.0639
No log	2.25	18	1.0415	0.3787	1.0415	1.0205
No log	2.5	20	0.8041	0.4871	0.8041	0.8967
No log	2.75	22	0.7536	0.5814	0.7536	0.8681
No log	3.0	24	0.7195	0.6614	0.7195	0.8482
No log	3.25	26	0.6739	0.6131	0.6739	0.8209
No log	3.5	28	0.6494	0.6444	0.6494	0.8059
No log	3.75	30	0.6585	0.6351	0.6585	0.8115
No log	4.0	32	0.6155	0.6926	0.6155	0.7845
No log	4.25	34	0.7119	0.6453	0.7119	0.8437
No log	4.5	36	0.7644	0.6572	0.7644	0.8743
No log	4.75	38	0.6544	0.6940	0.6544	0.8089
No log	5.0	40	0.6258	0.6463	0.6258	0.7911
No log	5.25	42	0.6634	0.6178	0.6634	0.8145
No log	5.5	44	0.6767	0.7079	0.6767	0.8226
No log	5.75	46	0.7244	0.6610	0.7244	0.8511
No log	6.0	48	0.7326	0.6651	0.7326	0.8559
No log	6.25	50	0.7309	0.6810	0.7309	0.8549
No log	6.5	52	0.7629	0.6688	0.7629	0.8735
No log	6.75	54	0.7612	0.6688	0.7612	0.8724
No log	7.0	56	0.7902	0.6484	0.7902	0.8889
No log	7.25	58	0.7846	0.6688	0.7846	0.8858
No log	7.5	60	0.7878	0.6688	0.7878	0.8876
No log	7.75	62	0.8097	0.6423	0.8097	0.8998
No log	8.0	64	0.8243	0.6423	0.8243	0.9079
No log	8.25	66	0.7883	0.6466	0.7883	0.8879
No log	8.5	68	0.7605	0.6881	0.7605	0.8721
No log	8.75	70	0.7515	0.7079	0.7515	0.8669
No log	9.0	72	0.7420	0.7155	0.7420	0.8614
No log	9.25	74	0.7372	0.7042	0.7372	0.8586
No log	9.5	76	0.7344	0.7079	0.7344	0.8569
No log	9.75	78	0.7346	0.7118	0.7346	0.8571
No log	10.0	80	0.7351	0.7118	0.7351	0.8574

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 1, 2024
Updated: Dec 1, 2024