Arabic_FineTuningAraBERT_AugV5_k1_task3_organization_fold1

MayBashendy/Arabic_FineTuningAraBERT_AugV5_k1_task3_organization_fold1

Arabic_FineTuningAraBERT_AugV5_k1_task3_organization_fold1 is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

21% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Nov 25, 2024
Updated: Nov 25, 2024
SHA: 422df18e

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

Arabic_FineTuningAraBERT_AugV5_k1_task3_organization_fold1

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.4881
Qwk: 0.3654
Mse: 0.4881
Rmse: 0.6987

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2	2	4.3733	0.0	4.3733	2.0912
No log	0.4	4	3.0656	0.0041	3.0656	1.7509
No log	0.6	6	1.9187	0.0	1.9187	1.3852
No log	0.8	8	1.2784	0.0	1.2784	1.1307
No log	1.0	10	1.0288	0.0	1.0288	1.0143
No log	1.2	12	0.8073	0.2143	0.8073	0.8985
No log	1.4	14	0.8244	-0.0708	0.8244	0.9080
No log	1.6	16	0.8426	-0.0708	0.8426	0.9179
No log	1.8	18	0.8425	-0.2623	0.8425	0.9179
No log	2.0	20	0.7834	-0.2737	0.7834	0.8851
No log	2.2	22	0.7676	-0.0233	0.7676	0.8761
No log	2.4	24	0.7458	-0.0233	0.7458	0.8636
No log	2.6	26	0.7393	-0.0233	0.7393	0.8598
No log	2.8	28	0.7465	-0.0233	0.7465	0.8640
No log	3.0	30	0.7807	-0.0708	0.7807	0.8836
No log	3.2	32	0.7686	-0.0708	0.7686	0.8767
No log	3.4	34	0.7733	0.1239	0.7733	0.8794
No log	3.6	36	0.7919	-0.0820	0.7919	0.8899
No log	3.8	38	0.8260	0.0571	0.8260	0.9088
No log	4.0	40	0.8921	0.0253	0.8921	0.9445
No log	4.2	42	0.9072	0.0253	0.9072	0.9524
No log	4.4	44	0.8748	0.0403	0.8748	0.9353
No log	4.6	46	0.7669	0.1538	0.7669	0.8757
No log	4.8	48	0.7034	0.0	0.7034	0.8387
No log	5.0	50	0.7061	0.0	0.7061	0.8403
No log	5.2	52	0.7177	-0.0233	0.7177	0.8472
No log	5.4	54	0.7338	-0.0233	0.7338	0.8566
No log	5.6	56	0.7832	0.4590	0.7832	0.8850
No log	5.8	58	0.8263	0.0571	0.8263	0.9090
No log	6.0	60	0.9227	0.0253	0.9227	0.9606
No log	6.2	62	0.8976	0.0253	0.8976	0.9474
No log	6.4	64	0.8543	0.0403	0.8543	0.9243
No log	6.6	66	0.7962	0.2443	0.7962	0.8923
No log	6.8	68	0.7551	0.1239	0.7551	0.8690
No log	7.0	70	0.7269	0.0984	0.7269	0.8526
No log	7.2	72	0.6806	0.0984	0.6806	0.8250
No log	7.4	74	0.6234	0.1239	0.6234	0.7896
No log	7.6	76	0.5757	0.0984	0.5757	0.7587
No log	7.8	78	0.5394	0.3529	0.5394	0.7345
No log	8.0	80	0.4984	0.1239	0.4984	0.7059
No log	8.2	82	0.4521	0.3654	0.4521	0.6724
No log	8.4	84	0.4245	0.4884	0.4245	0.6516
No log	8.6	86	0.4220	0.4884	0.4220	0.6496
No log	8.8	88	0.4231	0.4884	0.4231	0.6505
No log	9.0	90	0.4275	0.4211	0.4275	0.6538
No log	9.2	92	0.4397	0.4211	0.4397	0.6631
No log	9.4	94	0.4567	0.4211	0.4567	0.6758
No log	9.6	96	0.4734	0.4211	0.4734	0.6880
No log	9.8	98	0.4866	0.3654	0.4866	0.6975
No log	10.0	100	0.4881	0.3654	0.4881	0.6987

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Nov 25, 2024
Updated: Nov 25, 2024