ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k7_task3_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k7_task3_organization

ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k7_task3_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

18% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: 39713a85

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k7_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.5642
Qwk: 0.3708
Mse: 0.5642
Rmse: 0.7511

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0667	2	3.3703	0.0026	3.3703	1.8358
No log	0.1333	4	1.7605	-0.0370	1.7605	1.3268
No log	0.2	6	1.0744	0.0769	1.0744	1.0365
No log	0.2667	8	1.7055	0.1277	1.7055	1.3059
No log	0.3333	10	1.3014	0.0476	1.3014	1.1408
No log	0.4	12	0.6472	0.1304	0.6472	0.8045
No log	0.4667	14	0.6152	0.0569	0.6152	0.7843
No log	0.5333	16	0.6887	-0.0963	0.6887	0.8299
No log	0.6	18	0.9023	0.0333	0.9023	0.9499
No log	0.6667	20	0.9457	-0.0196	0.9457	0.9725
No log	0.7333	22	0.9303	-0.0159	0.9303	0.9645
No log	0.8	24	0.9164	-0.0081	0.9164	0.9573
No log	0.8667	26	0.7917	-0.0818	0.7917	0.8898
No log	0.9333	28	0.6401	-0.0732	0.6401	0.8001
No log	1.0	30	0.5984	0.0569	0.5984	0.7736
No log	1.0667	32	0.5828	0.0388	0.5828	0.7634
No log	1.1333	34	0.6473	0.0145	0.6473	0.8046
No log	1.2	36	0.6808	0.0769	0.6808	0.8251
No log	1.2667	38	0.5878	0.0569	0.5878	0.7667
No log	1.3333	40	0.5759	0.0	0.5759	0.7589
No log	1.4	42	0.6336	0.1773	0.6336	0.7960
No log	1.4667	44	0.7110	-0.0169	0.7110	0.8432
No log	1.5333	46	0.6503	0.0769	0.6503	0.8064
No log	1.6	48	0.5910	-0.0159	0.5910	0.7688
No log	1.6667	50	0.5880	-0.0159	0.5880	0.7668
No log	1.7333	52	0.6091	0.0071	0.6091	0.7805
No log	1.8	54	0.6348	0.0769	0.6348	0.7968
No log	1.8667	56	0.8664	0.1289	0.8664	0.9308
No log	1.9333	58	0.9242	0.1730	0.9242	0.9613
No log	2.0	60	0.6709	0.1638	0.6709	0.8191
No log	2.0667	62	0.6406	0.1724	0.6406	0.8004
No log	2.1333	64	0.6095	0.1515	0.6095	0.7807
No log	2.2	66	0.5938	0.1605	0.5938	0.7706
No log	2.2667	68	0.5855	0.0850	0.5855	0.7652
No log	2.3333	70	0.7452	0.2323	0.7452	0.8632
No log	2.4	72	0.9013	0.2340	0.9013	0.9494
No log	2.4667	74	0.7451	0.1746	0.7451	0.8632
No log	2.5333	76	0.6182	0.1579	0.6182	0.7863
No log	2.6	78	0.6370	0.2704	0.6370	0.7981
No log	2.6667	80	0.5827	0.3446	0.5827	0.7633
No log	2.7333	82	0.9279	0.2432	0.9279	0.9633
No log	2.8	84	0.9190	0.2432	0.9190	0.9586
No log	2.8667	86	0.5665	0.2000	0.5665	0.7526
No log	2.9333	88	0.7605	0.1828	0.7605	0.8721
No log	3.0	90	1.0653	-0.0036	1.0653	1.0322
No log	3.0667	92	1.0818	-0.0246	1.0818	1.0401
No log	3.1333	94	0.8767	0.1220	0.8767	0.9363
No log	3.2	96	0.5760	0.0986	0.5760	0.7589
No log	3.2667	98	0.8121	0.1644	0.8121	0.9012
No log	3.3333	100	1.3495	0.0204	1.3495	1.1617
No log	3.4	102	1.4027	0.0204	1.4027	1.1844
No log	3.4667	104	1.0450	0.0388	1.0450	1.0222
No log	3.5333	106	0.6862	0.25	0.6862	0.8284
No log	3.6	108	0.5542	0.0725	0.5542	0.7445
No log	3.6667	110	0.6046	0.1565	0.6046	0.7776
No log	3.7333	112	0.7527	0.1392	0.7527	0.8676
No log	3.8	114	0.7900	0.1475	0.7900	0.8888
No log	3.8667	116	0.6578	0.2201	0.6578	0.8110
No log	3.9333	118	0.5862	0.2485	0.5862	0.7657
No log	4.0	120	0.7847	0.2146	0.7847	0.8858
No log	4.0667	122	0.9832	0.1760	0.9832	0.9916
No log	4.1333	124	0.8751	0.2129	0.8751	0.9355
No log	4.2	126	0.7137	0.1443	0.7137	0.8448
No log	4.2667	128	0.6486	0.3136	0.6486	0.8054
No log	4.3333	130	0.7127	0.2727	0.7127	0.8442
No log	4.4	132	0.7230	0.2727	0.7230	0.8503
No log	4.4667	134	0.6716	0.2967	0.6716	0.8195
No log	4.5333	136	0.7290	0.2381	0.7290	0.8538
No log	4.6	138	0.7924	0.0667	0.7924	0.8901
No log	4.6667	140	0.6943	0.3131	0.6943	0.8333
No log	4.7333	142	0.7337	0.2692	0.7337	0.8566
No log	4.8	144	0.7870	0.3052	0.7870	0.8871
No log	4.8667	146	0.6635	0.3706	0.6635	0.8145
No log	4.9333	148	0.6383	0.2709	0.6383	0.7989
No log	5.0	150	0.6266	0.2577	0.6266	0.7916
No log	5.0667	152	0.6804	0.3892	0.6804	0.8249
No log	5.1333	154	0.7165	0.4	0.7165	0.8465
No log	5.2	156	0.6566	0.3892	0.6566	0.8103
No log	5.2667	158	0.6389	0.3892	0.6389	0.7993
No log	5.3333	160	0.6330	0.3892	0.6330	0.7956
No log	5.4	162	0.6047	0.3623	0.6047	0.7776
No log	5.4667	164	0.6288	0.3892	0.6288	0.7930
No log	5.5333	166	0.6429	0.3846	0.6429	0.8018
No log	5.6	168	0.6289	0.3892	0.6289	0.7930
No log	5.6667	170	0.6050	0.3725	0.6050	0.7778
No log	5.7333	172	0.6277	0.4175	0.6277	0.7923
No log	5.8	174	0.6716	0.3427	0.6716	0.8195
No log	5.8667	176	0.7201	0.3394	0.7201	0.8486
No log	5.9333	178	0.7675	0.3488	0.7675	0.8760
No log	6.0	180	0.7066	0.3394	0.7066	0.8406
No log	6.0667	182	0.6314	0.3585	0.6314	0.7946
No log	6.1333	184	0.6226	0.3585	0.6226	0.7890
No log	6.2	186	0.6131	0.36	0.6131	0.7830
No log	6.2667	188	0.6635	0.4	0.6635	0.8146
No log	6.3333	190	0.6542	0.4	0.6542	0.8088
No log	6.4	192	0.6100	0.3878	0.6100	0.7810
No log	6.4667	194	0.6012	0.4171	0.6012	0.7754
No log	6.5333	196	0.6365	0.3892	0.6365	0.7978
No log	6.6	198	0.6970	0.3561	0.6970	0.8349
No log	6.6667	200	0.7256	0.3237	0.7256	0.8518
No log	6.7333	202	0.6335	0.4229	0.6335	0.7959
No log	6.8	204	0.6112	0.3892	0.6112	0.7818
No log	6.8667	206	0.6123	0.3892	0.6123	0.7825
No log	6.9333	208	0.6722	0.3462	0.6722	0.8199
No log	7.0	210	0.7025	0.3561	0.7025	0.8381
No log	7.0667	212	0.6726	0.3561	0.6726	0.8201
No log	7.1333	214	0.6100	0.3469	0.6100	0.7810
No log	7.2	216	0.5802	0.3561	0.5802	0.7617
No log	7.2667	218	0.5940	0.3641	0.5940	0.7707
No log	7.3333	220	0.6587	0.3561	0.6587	0.8116
No log	7.4	222	0.6549	0.4	0.6549	0.8092
No log	7.4667	224	0.5871	0.3684	0.5871	0.7662
No log	7.5333	226	0.5470	0.3478	0.5470	0.7396
No log	7.6	228	0.5355	0.2967	0.5355	0.7318
No log	7.6667	230	0.5380	0.2967	0.5380	0.7335
No log	7.7333	232	0.5337	0.2626	0.5337	0.7306
No log	7.8	234	0.5458	0.3371	0.5458	0.7388
No log	7.8667	236	0.5986	0.3684	0.5986	0.7737
No log	7.9333	238	0.6100	0.3641	0.6100	0.7811
No log	8.0	240	0.6051	0.3641	0.6051	0.7779
No log	8.0667	242	0.5792	0.3730	0.5792	0.7610
No log	8.1333	244	0.5449	0.2527	0.5449	0.7382
No log	8.2	246	0.5445	0.2990	0.5445	0.7379
No log	8.2667	248	0.5428	0.2990	0.5428	0.7368
No log	8.3333	250	0.5403	0.2941	0.5403	0.7351
No log	8.4	252	0.5558	0.3661	0.5558	0.7455
No log	8.4667	254	0.5502	0.3661	0.5502	0.7417
No log	8.5333	256	0.5345	0.2941	0.5345	0.7311
No log	8.6	258	0.5339	0.3575	0.5339	0.7307
No log	8.6667	260	0.5434	0.3043	0.5434	0.7372
No log	8.7333	262	0.5714	0.3990	0.5714	0.7559
No log	8.8	264	0.5971	0.4	0.5971	0.7728
No log	8.8667	266	0.6313	0.4	0.6313	0.7946
No log	8.9333	268	0.6428	0.4	0.6428	0.8017
No log	9.0	270	0.6373	0.4	0.6373	0.7983
No log	9.0667	272	0.6380	0.4	0.6380	0.7987
No log	9.1333	274	0.6272	0.4	0.6272	0.7920
No log	9.2	276	0.6160	0.4	0.6160	0.7849
No log	9.2667	278	0.5888	0.3990	0.5888	0.7674
No log	9.3333	280	0.5729	0.4043	0.5729	0.7569
No log	9.4	282	0.5614	0.3478	0.5614	0.7492
No log	9.4667	284	0.5556	0.3263	0.5556	0.7454
No log	9.5333	286	0.5542	0.3263	0.5542	0.7445
No log	9.6	288	0.5536	0.3263	0.5536	0.7441
No log	9.6667	290	0.5538	0.2941	0.5538	0.7442
No log	9.7333	292	0.5553	0.2941	0.5553	0.7452
No log	9.8	294	0.5576	0.3478	0.5576	0.7467
No log	9.8667	296	0.5606	0.3591	0.5606	0.7488
No log	9.9333	298	0.5631	0.3591	0.5631	0.7504
No log	10.0	300	0.5642	0.3708	0.5642	0.7511

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024