ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k15_task3_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k15_task3_organization

ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k15_task3_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

35% of all-time downloads

All-time downloads

Public

Parameters

135M

1.1 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: 5ce775a7

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k15_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.5838
Qwk: 0.2832
Mse: 0.5838
Rmse: 0.7641

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0333	2	3.1575	-0.0041	3.1575	1.7769
No log	0.0667	4	1.5257	-0.0070	1.5257	1.2352
No log	0.1	6	1.1326	0.0632	1.1326	1.0642
No log	0.1333	8	1.4657	0.0632	1.4657	1.2107
No log	0.1667	10	0.8367	0.0769	0.8367	0.9147
No log	0.2	12	0.6363	0.2418	0.6363	0.7977
No log	0.2333	14	0.5489	0.0569	0.5489	0.7409
No log	0.2667	16	0.6122	0.2778	0.6122	0.7824
No log	0.3	18	0.6585	0.3684	0.6585	0.8115
No log	0.3333	20	0.6552	0.3898	0.6552	0.8095
No log	0.3667	22	0.8354	0.1333	0.8354	0.9140
No log	0.4	24	1.1567	0.0698	1.1567	1.0755
No log	0.4333	26	1.0029	0.0431	1.0029	1.0015
No log	0.4667	28	0.8010	0.1925	0.8010	0.8950
No log	0.5	30	0.6002	-0.0081	0.6002	0.7747
No log	0.5333	32	0.5633	0.0	0.5633	0.7505
No log	0.5667	34	0.5580	0.0	0.5580	0.7470
No log	0.6	36	0.5594	0.0	0.5594	0.7480
No log	0.6333	38	0.5727	0.1746	0.5727	0.7568
No log	0.6667	40	0.5615	0.0	0.5615	0.7493
No log	0.7	42	0.5790	0.1746	0.5790	0.7609
No log	0.7333	44	0.8647	0.0667	0.8647	0.9299
No log	0.7667	46	1.1607	0.0345	1.1607	1.0774
No log	0.8	48	0.8161	0.0476	0.8161	0.9034
No log	0.8333	50	0.5624	0.0	0.5624	0.7499
No log	0.8667	52	0.5857	0.0	0.5857	0.7653
No log	0.9	54	0.5880	0.0	0.5880	0.7668
No log	0.9333	56	0.5768	0.0	0.5768	0.7595
No log	0.9667	58	0.5704	0.0	0.5704	0.7552
No log	1.0	60	0.6095	0.1773	0.6095	0.7807
No log	1.0333	62	0.6006	0.1407	0.6006	0.7750
No log	1.0667	64	0.6057	0.0815	0.6057	0.7783
No log	1.1	66	0.5643	0.0	0.5643	0.7512
No log	1.1333	68	0.5855	0.0	0.5855	0.7652
No log	1.1667	70	0.5687	0.0	0.5687	0.7541
No log	1.2	72	0.5826	0.1304	0.5826	0.7633
No log	1.2333	74	0.8767	0.1111	0.8767	0.9363
No log	1.2667	76	1.1151	0.0388	1.1151	1.0560
No log	1.3	78	1.1595	0.0388	1.1595	1.0768
No log	1.3333	80	0.9383	0.0947	0.9383	0.9686
No log	1.3667	82	0.6448	0.0692	0.6448	0.8030
No log	1.4	84	0.6501	0.0080	0.6501	0.8063
No log	1.4333	86	0.6625	0.0815	0.6625	0.8139
No log	1.4667	88	0.8243	-0.0753	0.8243	0.9079
No log	1.5	90	1.1998	-0.0233	1.1998	1.0953
No log	1.5333	92	1.6148	-0.0350	1.6148	1.2707
No log	1.5667	94	1.2408	0.0388	1.2408	1.1139
No log	1.6	96	0.7343	0.0123	0.7343	0.8569
No log	1.6333	98	0.7265	0.1688	0.7265	0.8524
No log	1.6667	100	0.7450	0.0769	0.7450	0.8632
No log	1.7	102	0.7599	0.1429	0.7599	0.8717
No log	1.7333	104	0.7662	0.0805	0.7662	0.8753
No log	1.7667	106	0.7364	-0.0864	0.7364	0.8581
No log	1.8	108	0.7116	0.0380	0.7116	0.8436
No log	1.8333	110	0.7018	0.1351	0.7018	0.8377
No log	1.8667	112	0.7977	0.1340	0.7977	0.8932
No log	1.9	114	0.9322	0.1373	0.9322	0.9655
No log	1.9333	116	0.6915	0.1220	0.6915	0.8316
No log	1.9667	118	0.8338	0.2000	0.8338	0.9131
No log	2.0	120	0.9568	0.1333	0.9568	0.9781
No log	2.0333	122	0.8005	0.1068	0.8005	0.8947
No log	2.0667	124	0.7208	0.0061	0.7208	0.8490
No log	2.1	126	0.7484	0.0899	0.7484	0.8651
No log	2.1333	128	0.8385	0.1855	0.8385	0.9157
No log	2.1667	130	0.8385	0.1028	0.8385	0.9157
No log	2.2	132	0.8428	0.0531	0.8428	0.9181
No log	2.2333	134	0.8009	0.1753	0.8009	0.8950
No log	2.2667	136	0.8010	0.1304	0.8010	0.8950
No log	2.3	138	0.7876	0.1220	0.7876	0.8875
No log	2.3333	140	1.0246	0.0791	1.0246	1.0122
No log	2.3667	142	0.7586	0.1855	0.7586	0.8710
No log	2.4	144	0.6691	0.3161	0.6691	0.8180
No log	2.4333	146	0.8560	0.1481	0.8560	0.9252
No log	2.4667	148	0.6169	0.3407	0.6169	0.7854
No log	2.5	150	0.5554	0.2418	0.5554	0.7453
No log	2.5333	152	0.6409	0.2865	0.6409	0.8006
No log	2.5667	154	0.6306	0.2340	0.6306	0.7941
No log	2.6	156	0.5926	0.1053	0.5926	0.7698
No log	2.6333	158	0.6270	0.1638	0.6270	0.7918
No log	2.6667	160	0.6122	0.3253	0.6122	0.7824
No log	2.7	162	1.0257	0.0690	1.0257	1.0128
No log	2.7333	164	1.0691	0.1496	1.0691	1.0340
No log	2.7667	166	0.6950	0.2083	0.6950	0.8337
No log	2.8	168	0.7846	0.2423	0.7846	0.8858
No log	2.8333	170	0.9088	0.1318	0.9088	0.9533
No log	2.8667	172	0.7886	0.1549	0.7886	0.8880
No log	2.9	174	0.6322	0.2683	0.6322	0.7951
No log	2.9333	176	0.7483	0.1456	0.7483	0.8651
No log	2.9667	178	0.7469	0.1921	0.7469	0.8642
No log	3.0	180	0.6000	0.2941	0.6000	0.7746
No log	3.0333	182	0.6254	0.1529	0.6254	0.7909
No log	3.0667	184	0.6747	0.2083	0.6747	0.8214
No log	3.1	186	0.5867	0.1807	0.5867	0.7660
No log	3.1333	188	0.6349	0.3149	0.6349	0.7968
No log	3.1667	190	0.5922	0.3371	0.5922	0.7696
No log	3.2	192	0.6106	0.2000	0.6106	0.7814
No log	3.2333	194	0.6578	0.24	0.6578	0.8110
No log	3.2667	196	0.6298	0.2000	0.6298	0.7936
No log	3.3	198	0.6789	0.2000	0.6789	0.8240
No log	3.3333	200	0.6424	0.2184	0.6424	0.8015
No log	3.3667	202	0.6735	0.1325	0.6735	0.8207
No log	3.4	204	0.7334	0.2513	0.7334	0.8564
No log	3.4333	206	0.6510	0.2575	0.6510	0.8068
No log	3.4667	208	0.7154	0.2381	0.7154	0.8458
No log	3.5	210	0.8405	0.2579	0.8405	0.9168
No log	3.5333	212	0.7331	0.2074	0.7331	0.8562
No log	3.5667	214	0.6522	0.1411	0.6522	0.8076
No log	3.6	216	0.8383	0.1045	0.8383	0.9156
No log	3.6333	218	0.7744	0.2000	0.7744	0.8800
No log	3.6667	220	0.6014	0.2393	0.6014	0.7755
No log	3.7	222	0.5895	0.1500	0.5895	0.7678
No log	3.7333	224	0.5922	0.2289	0.5922	0.7695
No log	3.7667	226	0.6108	0.1086	0.6108	0.7815
No log	3.8	228	0.6046	0.2832	0.6046	0.7776
No log	3.8333	230	0.6215	0.3846	0.6215	0.7883
No log	3.8667	232	0.6077	0.2281	0.6077	0.7795
No log	3.9	234	0.7423	0.2593	0.7423	0.8616
No log	3.9333	236	0.7980	0.2900	0.7980	0.8933
No log	3.9667	238	0.6219	0.2527	0.6219	0.7886
No log	4.0	240	0.5955	0.2000	0.5955	0.7717
No log	4.0333	242	0.5938	0.2000	0.5938	0.7706
No log	4.0667	244	0.6764	0.2475	0.6764	0.8224
No log	4.1	246	0.7804	0.2897	0.7804	0.8834
No log	4.1333	248	0.7171	0.2897	0.7171	0.8468
No log	4.1667	250	0.6360	0.3089	0.6360	0.7975
No log	4.2	252	0.6099	0.2644	0.6099	0.7810
No log	4.2333	254	0.6622	0.3077	0.6622	0.8138
No log	4.2667	256	0.8242	0.3195	0.8242	0.9078
No log	4.3	258	0.7709	0.3195	0.7709	0.8780
No log	4.3333	260	0.5515	0.2626	0.5515	0.7426
No log	4.3667	262	0.5555	0.3478	0.5555	0.7453
No log	4.4	264	0.5785	0.3369	0.5785	0.7606
No log	4.4333	266	0.5182	0.2644	0.5182	0.7199
No log	4.4667	268	0.5332	0.2174	0.5332	0.7302
No log	4.5	270	0.5357	0.2179	0.5357	0.7319
No log	4.5333	272	0.5761	0.2340	0.5761	0.7590
No log	4.5667	274	0.5486	0.2179	0.5486	0.7407
No log	4.6	276	0.5600	0.2727	0.5600	0.7483
No log	4.6333	278	0.6291	0.3478	0.6291	0.7932
No log	4.6667	280	0.5791	0.3103	0.5791	0.7610
No log	4.7	282	0.6244	0.24	0.6244	0.7902
No log	4.7333	284	0.9609	0.2302	0.9609	0.9803
No log	4.7667	286	1.0795	0.1714	1.0795	1.0390
No log	4.8	288	0.9470	0.2000	0.9470	0.9731
No log	4.8333	290	0.6829	0.2523	0.6829	0.8264
No log	4.8667	292	0.5691	0.2195	0.5691	0.7544
No log	4.9	294	0.8166	0.2479	0.8166	0.9037
No log	4.9333	296	0.8405	0.1667	0.8405	0.9168
No log	4.9667	298	0.6113	0.2707	0.6113	0.7819
No log	5.0	300	0.6191	0.2727	0.6191	0.7868
No log	5.0333	302	0.8953	0.264	0.8953	0.9462
No log	5.0667	304	0.9513	0.2627	0.9513	0.9753
No log	5.1	306	0.8260	0.2941	0.8260	0.9089
No log	5.1333	308	0.6033	0.2917	0.6033	0.7767
No log	5.1667	310	0.5446	0.2575	0.5446	0.7380
No log	5.2	312	0.5618	0.2558	0.5618	0.7495
No log	5.2333	314	0.5391	0.3136	0.5391	0.7343
No log	5.2667	316	0.5737	0.2513	0.5737	0.7574
No log	5.3	318	0.6487	0.3237	0.6487	0.8054
No log	5.3333	320	0.7175	0.3271	0.7175	0.8470
No log	5.3667	322	0.6329	0.2893	0.6329	0.7955
No log	5.4	324	0.5612	0.2381	0.5612	0.7491
No log	5.4333	326	0.5614	0.3591	0.5614	0.7492
No log	5.4667	328	0.5937	0.2809	0.5937	0.7705
No log	5.5	330	0.5709	0.2889	0.5709	0.7556
No log	5.5333	332	0.6216	0.2893	0.6216	0.7884
No log	5.5667	334	0.7568	0.3080	0.7568	0.8700
No log	5.6	336	0.6946	0.2442	0.6946	0.8334
No log	5.6333	338	0.5775	0.1908	0.5775	0.7599
No log	5.6667	340	0.5841	0.2832	0.5841	0.7643
No log	5.7	342	0.5841	0.2967	0.5841	0.7643
No log	5.7333	344	0.5449	0.3054	0.5449	0.7382
No log	5.7667	346	0.5757	0.2093	0.5757	0.7587
No log	5.8	348	0.6163	0.2893	0.6163	0.7851
No log	5.8333	350	0.5691	0.2575	0.5691	0.7544
No log	5.8667	352	0.5335	0.2704	0.5335	0.7304
No log	5.9	354	0.5485	0.2771	0.5485	0.7406
No log	5.9333	356	0.5489	0.1902	0.5489	0.7409
No log	5.9667	358	0.5468	0.2704	0.5468	0.7395
No log	6.0	360	0.5552	0.2308	0.5552	0.7451
No log	6.0333	362	0.5729	0.1913	0.5729	0.7569
No log	6.0667	364	0.5906	0.1913	0.5906	0.7685
No log	6.1	366	0.6317	0.2487	0.6317	0.7948
No log	6.1333	368	0.6061	0.2090	0.6061	0.7786
No log	6.1667	370	0.5878	0.2000	0.5878	0.7667
No log	6.2	372	0.5663	0.2308	0.5663	0.7525
No log	6.2333	374	0.5632	0.2201	0.5632	0.7505
No log	6.2667	376	0.5756	0.3000	0.5756	0.7587
No log	6.3	378	0.6387	0.2086	0.6387	0.7992
No log	6.3333	380	0.6701	0.2850	0.6701	0.8186
No log	6.3667	382	0.6235	0.1135	0.6235	0.7896
No log	6.4	384	0.6078	0.1823	0.6078	0.7796
No log	6.4333	386	0.6159	0.1823	0.6159	0.7848
No log	6.4667	388	0.6213	0.1813	0.6213	0.7882
No log	6.5	390	0.6347	0.1828	0.6347	0.7967
No log	6.5333	392	0.6442	0.1135	0.6442	0.8026
No log	6.5667	394	0.6208	0.2088	0.6208	0.7879
No log	6.6	396	0.6150	0.1592	0.6150	0.7842
No log	6.6333	398	0.6140	0.1902	0.6140	0.7836
No log	6.6667	400	0.5956	0.2000	0.5956	0.7718
No log	6.7	402	0.5684	0.1592	0.5684	0.7539
No log	6.7333	404	0.5657	0.1801	0.5657	0.7521
No log	6.7667	406	0.5889	0.1556	0.5889	0.7674
No log	6.8	408	0.6343	0.3180	0.6343	0.7964
No log	6.8333	410	0.6307	0.2830	0.6307	0.7942
No log	6.8667	412	0.5725	0.2000	0.5725	0.7566
No log	6.9	414	0.5547	0.1899	0.5547	0.7448
No log	6.9333	416	0.5549	0.1801	0.5549	0.7449
No log	6.9667	418	0.5659	0.2381	0.5659	0.7522
No log	7.0	420	0.5806	0.1543	0.5806	0.7620
No log	7.0333	422	0.6076	0.2000	0.6076	0.7795
No log	7.0667	424	0.6263	0.2830	0.6263	0.7914
No log	7.1	426	0.6151	0.2081	0.6151	0.7843
No log	7.1333	428	0.5633	0.2393	0.5633	0.7505
No log	7.1667	430	0.5567	0.1617	0.5567	0.7461
No log	7.2	432	0.5617	0.1617	0.5617	0.7494
No log	7.2333	434	0.5636	0.1617	0.5636	0.7507
No log	7.2667	436	0.5615	0.1707	0.5615	0.7493
No log	7.3	438	0.5663	0.2393	0.5663	0.7525
No log	7.3333	440	0.5707	0.2381	0.5707	0.7554
No log	7.3667	442	0.5883	0.2096	0.5883	0.7670
No log	7.4	444	0.6210	0.2088	0.6210	0.7880
No log	7.4333	446	0.6119	0.2090	0.6119	0.7822
No log	7.4667	448	0.5769	0.2184	0.5769	0.7595
No log	7.5	450	0.5738	0.2184	0.5738	0.7575
No log	7.5333	452	0.5852	0.2184	0.5852	0.7650
No log	7.5667	454	0.5895	0.1732	0.5895	0.7678
No log	7.6	456	0.5853	0.2184	0.5853	0.7650
No log	7.6333	458	0.5850	0.2184	0.5850	0.7648
No log	7.6667	460	0.5822	0.2683	0.5822	0.7630
No log	7.7	462	0.5914	0.2184	0.5914	0.7690
No log	7.7333	464	0.6089	0.1364	0.6089	0.7803
No log	7.7667	466	0.6068	0.1364	0.6068	0.7790
No log	7.8	468	0.5978	0.2184	0.5978	0.7732
No log	7.8333	470	0.5871	0.2189	0.5871	0.7662
No log	7.8667	472	0.5876	0.1688	0.5876	0.7666
No log	7.9	474	0.5871	0.2189	0.5871	0.7662
No log	7.9333	476	0.5958	0.1813	0.5958	0.7719
No log	7.9667	478	0.6132	0.2273	0.6132	0.7831
No log	8.0	480	0.6528	0.2830	0.6528	0.8080
No log	8.0333	482	0.6707	0.3153	0.6707	0.8189
No log	8.0667	484	0.6385	0.2527	0.6385	0.7991
No log	8.1	486	0.5962	0.1813	0.5962	0.7721
No log	8.1333	488	0.5801	0.2189	0.5801	0.7616
No log	8.1667	490	0.5716	0.1688	0.5716	0.7560
No log	8.2	492	0.5659	0.1688	0.5659	0.7523
No log	8.2333	494	0.5636	0.1688	0.5636	0.7508
No log	8.2667	496	0.5712	0.2184	0.5712	0.7557
No log	8.3	498	0.5728	0.2184	0.5728	0.7568
0.4463	8.3333	500	0.5709	0.2184	0.5709	0.7556
0.4463	8.3667	502	0.5634	0.2663	0.5634	0.7506
0.4463	8.4	504	0.5568	0.2663	0.5568	0.7462
0.4463	8.4333	506	0.5534	0.1688	0.5534	0.7439
0.4463	8.4667	508	0.5539	0.1688	0.5539	0.7443
0.4463	8.5	510	0.5547	0.1688	0.5547	0.7448
0.4463	8.5333	512	0.5571	0.1688	0.5571	0.7464
0.4463	8.5667	514	0.5607	0.1592	0.5607	0.7488
0.4463	8.6	516	0.5574	0.1688	0.5574	0.7466
0.4463	8.6333	518	0.5576	0.1707	0.5576	0.7467
0.4463	8.6667	520	0.5661	0.2626	0.5661	0.7524
0.4463	8.7	522	0.5814	0.2626	0.5814	0.7625
0.4463	8.7333	524	0.5946	0.2370	0.5946	0.7711
0.4463	8.7667	526	0.5938	0.2727	0.5938	0.7706
0.4463	8.8	528	0.5841	0.2626	0.5841	0.7643
0.4463	8.8333	530	0.5765	0.2626	0.5765	0.7593
0.4463	8.8667	532	0.5672	0.2184	0.5672	0.7531
0.4463	8.9	534	0.5630	0.2189	0.5630	0.7503
0.4463	8.9333	536	0.5636	0.2184	0.5636	0.7507
0.4463	8.9667	538	0.5680	0.2184	0.5680	0.7536
0.4463	9.0	540	0.5732	0.2184	0.5732	0.7571
0.4463	9.0333	542	0.5769	0.2184	0.5769	0.7595
0.4463	9.0667	544	0.5816	0.2626	0.5816	0.7626
0.4463	9.1	546	0.5801	0.2626	0.5801	0.7616
0.4463	9.1333	548	0.5739	0.2184	0.5739	0.7576
0.4463	9.1667	550	0.5721	0.2184	0.5721	0.7563
0.4463	9.2	552	0.5730	0.2184	0.5730	0.7570
0.4463	9.2333	554	0.5737	0.2626	0.5737	0.7574
0.4463	9.2667	556	0.5767	0.2626	0.5767	0.7594
0.4463	9.3	558	0.5814	0.2626	0.5814	0.7625
0.4463	9.3333	560	0.5938	0.2832	0.5938	0.7706
0.4463	9.3667	562	0.6047	0.2360	0.6047	0.7776
0.4463	9.4	564	0.6044	0.2360	0.6044	0.7775
0.4463	9.4333	566	0.5947	0.2832	0.5947	0.7712
0.4463	9.4667	568	0.5835	0.2273	0.5835	0.7639
0.4463	9.5	570	0.5780	0.2626	0.5780	0.7603
0.4463	9.5333	572	0.5698	0.2626	0.5698	0.7549
0.4463	9.5667	574	0.5627	0.2184	0.5627	0.7501
0.4463	9.6	576	0.5591	0.1716	0.5591	0.7478
0.4463	9.6333	578	0.5579	0.1707	0.5579	0.7469
0.4463	9.6667	580	0.5584	0.1716	0.5584	0.7472
0.4463	9.7	582	0.5600	0.1716	0.5600	0.7483
0.4463	9.7333	584	0.5626	0.2184	0.5626	0.7501
0.4463	9.7667	586	0.5643	0.2626	0.5643	0.7512
0.4463	9.8	588	0.5683	0.2626	0.5683	0.7538
0.4463	9.8333	590	0.5733	0.2626	0.5733	0.7572
0.4463	9.8667	592	0.5782	0.2273	0.5782	0.7604
0.4463	9.9	594	0.5818	0.2832	0.5818	0.7627
0.4463	9.9333	596	0.5833	0.2832	0.5833	0.7637
0.4463	9.9667	598	0.5837	0.2832	0.5837	0.7640
0.4463	10.0	600	0.5838	0.2832	0.5838	0.7641

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024