ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k19_task5_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k19_task5_organization

ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k19_task5_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

38% of all-time downloads

All-time downloads

Public

Parameters

135M

1.1 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 10, 2024
SHA: 384bad31

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k19_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 1.1051
Qwk: 0.5870
Mse: 1.1051
Rmse: 1.0512

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0345	2	2.2657	0.0144	2.2657	1.5052
No log	0.0690	4	1.4498	0.2089	1.4498	1.2041
No log	0.1034	6	1.4894	0.1340	1.4894	1.2204
No log	0.1379	8	1.6092	0.2548	1.6092	1.2685
No log	0.1724	10	1.7392	0.2321	1.7392	1.3188
No log	0.2069	12	1.7162	0.2949	1.7162	1.3101
No log	0.2414	14	1.6483	0.3435	1.6483	1.2839
No log	0.2759	16	1.5594	0.3304	1.5594	1.2488
No log	0.3103	18	1.4422	0.1700	1.4422	1.2009
No log	0.3448	20	1.3957	0.1475	1.3957	1.1814
No log	0.3793	22	1.3207	0.1318	1.3207	1.1492
No log	0.4138	24	1.3352	0.3197	1.3352	1.1555
No log	0.4483	26	1.3940	0.3946	1.3940	1.1807
No log	0.4828	28	1.3787	0.2884	1.3787	1.1742
No log	0.5172	30	1.3476	0.2933	1.3476	1.1609
No log	0.5517	32	1.2994	0.1981	1.2994	1.1399
No log	0.5862	34	1.2632	0.2389	1.2632	1.1239
No log	0.6207	36	1.2553	0.2970	1.2553	1.1204
No log	0.6552	38	1.3463	0.4215	1.3463	1.1603
No log	0.6897	40	1.5177	0.3688	1.5177	1.2319
No log	0.7241	42	1.5495	0.3325	1.5495	1.2448
No log	0.7586	44	1.4977	0.3819	1.4977	1.2238
No log	0.7931	46	1.5555	0.3214	1.5555	1.2472
No log	0.8276	48	1.4591	0.4032	1.4591	1.2079
No log	0.8621	50	1.5431	0.3849	1.5431	1.2422
No log	0.8966	52	1.8850	0.3222	1.8850	1.3729
No log	0.9310	54	2.1504	0.2001	2.1504	1.4664
No log	0.9655	56	2.0226	0.1920	2.0226	1.4222
No log	1.0	58	1.7930	0.2973	1.7930	1.3390
No log	1.0345	60	1.5150	0.3663	1.5150	1.2309
No log	1.0690	62	1.3548	0.3117	1.3548	1.1639
No log	1.1034	64	1.3470	0.3791	1.3470	1.1606
No log	1.1379	66	1.4157	0.3721	1.4157	1.1898
No log	1.1724	68	1.5289	0.3732	1.5289	1.2365
No log	1.2069	70	1.6806	0.3167	1.6806	1.2964
No log	1.2414	72	1.8341	0.2540	1.8341	1.3543
No log	1.2759	74	2.0349	0.2481	2.0349	1.4265
No log	1.3103	76	2.3534	0.3041	2.3534	1.5341
No log	1.3448	78	2.5376	0.2607	2.5376	1.5930
No log	1.3793	80	2.4043	0.2893	2.4043	1.5506
No log	1.4138	82	2.1722	0.3050	2.1722	1.4738
No log	1.4483	84	1.9618	0.3484	1.9618	1.4007
No log	1.4828	86	1.6478	0.3811	1.6477	1.2836
No log	1.5172	88	1.3443	0.4212	1.3443	1.1594
No log	1.5517	90	1.2823	0.4196	1.2823	1.1324
No log	1.5862	92	1.3690	0.5119	1.3690	1.1701
No log	1.6207	94	1.4935	0.4733	1.4935	1.2221
No log	1.6552	96	1.5892	0.4994	1.5892	1.2606
No log	1.6897	98	1.6363	0.4910	1.6363	1.2792
No log	1.7241	100	1.8440	0.4642	1.8440	1.3579
No log	1.7586	102	2.1234	0.3933	2.1234	1.4572
No log	1.7931	104	2.3126	0.3307	2.3126	1.5207
No log	1.8276	106	2.4456	0.3348	2.4456	1.5638
No log	1.8621	108	2.5035	0.3637	2.5035	1.5822
No log	1.8966	110	2.4453	0.3649	2.4453	1.5638
No log	1.9310	112	2.2043	0.3481	2.2043	1.4847
No log	1.9655	114	1.8793	0.3589	1.8793	1.3709
No log	2.0	116	1.6195	0.4433	1.6195	1.2726
No log	2.0345	118	1.4852	0.4905	1.4852	1.2187
No log	2.0690	120	1.2581	0.5625	1.2581	1.1216
No log	2.1034	122	1.0534	0.5961	1.0534	1.0264
No log	2.1379	124	1.0447	0.5807	1.0447	1.0221
No log	2.1724	126	1.1169	0.5867	1.1169	1.0568
No log	2.2069	128	1.2827	0.5448	1.2827	1.1326
No log	2.2414	130	1.4635	0.5053	1.4635	1.2098
No log	2.2759	132	1.7304	0.4501	1.7304	1.3154
No log	2.3103	134	1.9460	0.4432	1.9460	1.3950
No log	2.3448	136	2.1107	0.4181	2.1107	1.4528
No log	2.3793	138	2.2167	0.4064	2.2167	1.4889
No log	2.4138	140	2.2784	0.4164	2.2784	1.5094
No log	2.4483	142	2.1800	0.4188	2.1800	1.4765
No log	2.4828	144	2.0370	0.4053	2.0370	1.4272
No log	2.5172	146	1.7999	0.4220	1.7999	1.3416
No log	2.5517	148	1.5873	0.4889	1.5873	1.2599
No log	2.5862	150	1.4903	0.4810	1.4903	1.2208
No log	2.6207	152	1.4625	0.4620	1.4625	1.2094
No log	2.6552	154	1.3893	0.4836	1.3893	1.1787
No log	2.6897	156	1.3494	0.4950	1.3494	1.1616
No log	2.7241	158	1.3595	0.5183	1.3595	1.1660
No log	2.7586	160	1.3077	0.5108	1.3077	1.1436
No log	2.7931	162	1.3331	0.5104	1.3331	1.1546
No log	2.8276	164	1.3970	0.5069	1.3970	1.1819
No log	2.8621	166	1.3991	0.5275	1.3991	1.1828
No log	2.8966	168	1.3247	0.4996	1.3247	1.1510
No log	2.9310	170	1.2389	0.5149	1.2389	1.1131
No log	2.9655	172	1.1439	0.5399	1.1439	1.0695
No log	3.0	174	1.0914	0.5711	1.0914	1.0447
No log	3.0345	176	1.1524	0.5595	1.1524	1.0735
No log	3.0690	178	1.2775	0.5549	1.2775	1.1303
No log	3.1034	180	1.4590	0.5260	1.4590	1.2079
No log	3.1379	182	1.5132	0.5053	1.5132	1.2301
No log	3.1724	184	1.4753	0.5053	1.4753	1.2146
No log	3.2069	186	1.4996	0.5023	1.4996	1.2246
No log	3.2414	188	1.5087	0.4947	1.5087	1.2283
No log	3.2759	190	1.4733	0.5108	1.4733	1.2138
No log	3.3103	192	1.3932	0.5414	1.3932	1.1803
No log	3.3448	194	1.2840	0.5473	1.2840	1.1332
No log	3.3793	196	1.2782	0.5540	1.2782	1.1306
No log	3.4138	198	1.3227	0.5497	1.3227	1.1501
No log	3.4483	200	1.3583	0.5042	1.3583	1.1655
No log	3.4828	202	1.2384	0.5254	1.2384	1.1128
No log	3.5172	204	1.1020	0.5851	1.1020	1.0497
No log	3.5517	206	0.9688	0.6415	0.9688	0.9843
No log	3.5862	208	0.9026	0.6302	0.9026	0.9501
No log	3.6207	210	0.9024	0.6302	0.9024	0.9499
No log	3.6552	212	0.9577	0.6302	0.9577	0.9786
No log	3.6897	214	1.0985	0.5907	1.0985	1.0481
No log	3.7241	216	1.1756	0.5812	1.1756	1.0843
No log	3.7586	218	1.1932	0.5748	1.1932	1.0923
No log	3.7931	220	1.1996	0.5641	1.1996	1.0952
No log	3.8276	222	1.1817	0.5781	1.1817	1.0870
No log	3.8621	224	1.1881	0.5661	1.1881	1.0900
No log	3.8966	226	1.2156	0.5515	1.2156	1.1026
No log	3.9310	228	1.3212	0.5362	1.3212	1.1494
No log	3.9655	230	1.3881	0.5384	1.3881	1.1782
No log	4.0	232	1.4084	0.5225	1.4084	1.1867
No log	4.0345	234	1.3990	0.5340	1.3990	1.1828
No log	4.0690	236	1.4249	0.5232	1.4249	1.1937
No log	4.1034	238	1.4563	0.5260	1.4563	1.2068
No log	4.1379	240	1.4117	0.5267	1.4117	1.1881
No log	4.1724	242	1.3664	0.5266	1.3664	1.1689
No log	4.2069	244	1.2309	0.5319	1.2309	1.1095
No log	4.2414	246	1.1175	0.5675	1.1175	1.0571
No log	4.2759	248	1.1194	0.5649	1.1194	1.0580
No log	4.3103	250	1.1925	0.5061	1.1925	1.0920
No log	4.3448	252	1.2880	0.5236	1.2880	1.1349
No log	4.3793	254	1.4078	0.5197	1.4078	1.1865
No log	4.4138	256	1.4980	0.5264	1.4980	1.2239
No log	4.4483	258	1.5211	0.5264	1.5211	1.2333
No log	4.4828	260	1.5086	0.5264	1.5086	1.2282
No log	4.5172	262	1.4606	0.5160	1.4606	1.2086
No log	4.5517	264	1.3946	0.5160	1.3946	1.1809
No log	4.5862	266	1.3680	0.5131	1.3680	1.1696
No log	4.6207	268	1.3600	0.5160	1.3600	1.1662
No log	4.6552	270	1.4012	0.5160	1.4012	1.1837
No log	4.6897	272	1.4542	0.5145	1.4542	1.2059
No log	4.7241	274	1.4535	0.5145	1.4535	1.2056
No log	4.7586	276	1.4743	0.5145	1.4743	1.2142
No log	4.7931	278	1.4429	0.5145	1.4429	1.2012
No log	4.8276	280	1.3172	0.5345	1.3172	1.1477
No log	4.8621	282	1.2494	0.5550	1.2494	1.1178
No log	4.8966	284	1.1896	0.5614	1.1896	1.0907
No log	4.9310	286	1.1385	0.5539	1.1385	1.0670
No log	4.9655	288	1.0377	0.5568	1.0377	1.0187
No log	5.0	290	0.9788	0.5791	0.9788	0.9894
No log	5.0345	292	0.9831	0.5791	0.9831	0.9915
No log	5.0690	294	1.0837	0.5734	1.0837	1.0410
No log	5.1034	296	1.2149	0.5305	1.2149	1.1022
No log	5.1379	298	1.3040	0.5204	1.3040	1.1419
No log	5.1724	300	1.3881	0.5072	1.3881	1.1782
No log	5.2069	302	1.5054	0.4946	1.5054	1.2269
No log	5.2414	304	1.5695	0.4946	1.5695	1.2528
No log	5.2759	306	1.6046	0.4751	1.6046	1.2667
No log	5.3103	308	1.5915	0.4645	1.5915	1.2615
No log	5.3448	310	1.4977	0.4946	1.4977	1.2238
No log	5.3793	312	1.3891	0.5107	1.3891	1.1786
No log	5.4138	314	1.3028	0.5236	1.3028	1.1414
No log	5.4483	316	1.3051	0.5074	1.3051	1.1424
No log	5.4828	318	1.3295	0.5055	1.3295	1.1531
No log	5.5172	320	1.3325	0.5072	1.3325	1.1543
No log	5.5517	322	1.3177	0.5343	1.3177	1.1479
No log	5.5862	324	1.2995	0.5666	1.2995	1.1400
No log	5.6207	326	1.2586	0.5736	1.2586	1.1219
No log	5.6552	328	1.2323	0.5716	1.2323	1.1101
No log	5.6897	330	1.1636	0.5767	1.1636	1.0787
No log	5.7241	332	1.1343	0.5636	1.1343	1.0650
No log	5.7586	334	1.1059	0.5667	1.1059	1.0516
No log	5.7931	336	1.0579	0.5905	1.0579	1.0286
No log	5.8276	338	1.0136	0.6097	1.0136	1.0068
No log	5.8621	340	0.9962	0.6163	0.9962	0.9981
No log	5.8966	342	1.0177	0.6163	1.0177	1.0088
No log	5.9310	344	1.0660	0.6016	1.0660	1.0325
No log	5.9655	346	1.1055	0.5921	1.1055	1.0514
No log	6.0	348	1.1223	0.5669	1.1223	1.0594
No log	6.0345	350	1.0989	0.5602	1.0989	1.0483
No log	6.0690	352	1.0443	0.5675	1.0443	1.0219
No log	6.1034	354	0.9878	0.5818	0.9878	0.9939
No log	6.1379	356	0.9822	0.5794	0.9822	0.9911
No log	6.1724	358	0.9997	0.5793	0.9997	0.9998
No log	6.2069	360	1.0459	0.5698	1.0459	1.0227
No log	6.2414	362	1.0994	0.5444	1.0994	1.0485
No log	6.2759	364	1.1710	0.5493	1.1710	1.0821
No log	6.3103	366	1.1677	0.5493	1.1677	1.0806
No log	6.3448	368	1.1250	0.5502	1.1250	1.0607
No log	6.3793	370	1.1063	0.5502	1.1063	1.0518
No log	6.4138	372	1.0894	0.5531	1.0894	1.0437
No log	6.4483	374	1.0196	0.5722	1.0196	1.0098
No log	6.4828	376	0.9512	0.6280	0.9512	0.9753
No log	6.5172	378	0.8985	0.6120	0.8985	0.9479
No log	6.5517	380	0.9002	0.6172	0.9002	0.9488
No log	6.5862	382	0.9512	0.6228	0.9512	0.9753
No log	6.6207	384	1.0040	0.6220	1.0040	1.0020
No log	6.6552	386	1.0034	0.6220	1.0034	1.0017
No log	6.6897	388	0.9738	0.6317	0.9738	0.9868
No log	6.7241	390	0.9445	0.6540	0.9445	0.9719
No log	6.7586	392	0.9428	0.6410	0.9428	0.9710
No log	6.7931	394	0.9631	0.6317	0.9631	0.9814
No log	6.8276	396	0.9887	0.5965	0.9887	0.9943
No log	6.8621	398	1.0172	0.6023	1.0172	1.0086
No log	6.8966	400	1.0309	0.6023	1.0309	1.0154
No log	6.9310	402	1.0549	0.5895	1.0549	1.0271
No log	6.9655	404	1.0860	0.5803	1.0860	1.0421
No log	7.0	406	1.1216	0.5701	1.1216	1.0591
No log	7.0345	408	1.1335	0.5724	1.1335	1.0646
No log	7.0690	410	1.1359	0.5724	1.1359	1.0658
No log	7.1034	412	1.1148	0.5667	1.1148	1.0559
No log	7.1379	414	1.1253	0.5667	1.1253	1.0608
No log	7.1724	416	1.1682	0.5487	1.1682	1.0808
No log	7.2069	418	1.2076	0.5591	1.2076	1.0989
No log	7.2414	420	1.2171	0.5452	1.2171	1.1032
No log	7.2759	422	1.2161	0.5469	1.2161	1.1028
No log	7.3103	424	1.1947	0.5478	1.1947	1.0930
No log	7.3448	426	1.1335	0.5582	1.1335	1.0646
No log	7.3793	428	1.0288	0.5699	1.0288	1.0143
No log	7.4138	430	0.9782	0.6052	0.9782	0.9890
No log	7.4483	432	0.9211	0.6296	0.9211	0.9597
No log	7.4828	434	0.8993	0.6061	0.8993	0.9483
No log	7.5172	436	0.9302	0.5955	0.9302	0.9645
No log	7.5517	438	0.9870	0.5995	0.9870	0.9935
No log	7.5862	440	1.0484	0.5988	1.0484	1.0239
No log	7.6207	442	1.0912	0.5849	1.0912	1.0446
No log	7.6552	444	1.1203	0.5659	1.1203	1.0584
No log	7.6897	446	1.1476	0.5703	1.1476	1.0713
No log	7.7241	448	1.1925	0.5600	1.1925	1.0920
No log	7.7586	450	1.2658	0.5647	1.2658	1.1251
No log	7.7931	452	1.2661	0.5668	1.2661	1.1252
No log	7.8276	454	1.2317	0.5613	1.2317	1.1098
No log	7.8621	456	1.2011	0.5683	1.2011	1.0959
No log	7.8966	458	1.1536	0.5767	1.1536	1.0741
No log	7.9310	460	1.1057	0.5746	1.1057	1.0515
No log	7.9655	462	1.0681	0.5824	1.0681	1.0335
No log	8.0	464	1.0652	0.5836	1.0652	1.0321
No log	8.0345	466	1.0949	0.5734	1.0949	1.0464
No log	8.0690	468	1.1182	0.5602	1.1182	1.0575
No log	8.1034	470	1.1434	0.5602	1.1434	1.0693
No log	8.1379	472	1.1673	0.5681	1.1673	1.0804
No log	8.1724	474	1.1889	0.5578	1.1889	1.0904
No log	8.2069	476	1.1766	0.5564	1.1766	1.0847
No log	8.2414	478	1.1585	0.5558	1.1585	1.0763
No log	8.2759	480	1.1359	0.5558	1.1359	1.0658
No log	8.3103	482	1.1092	0.5791	1.1092	1.0532
No log	8.3448	484	1.1078	0.5746	1.1078	1.0525
No log	8.3793	486	1.1282	0.5746	1.1282	1.0622
No log	8.4138	488	1.1465	0.5690	1.1465	1.0707
No log	8.4483	490	1.1525	0.5635	1.1525	1.0736
No log	8.4828	492	1.1513	0.5758	1.1513	1.0730
No log	8.5172	494	1.1423	0.5758	1.1423	1.0688
No log	8.5517	496	1.1094	0.5791	1.1094	1.0533
No log	8.5862	498	1.1150	0.5746	1.1150	1.0559
0.3453	8.6207	500	1.1373	0.5769	1.1373	1.0664
0.3453	8.6552	502	1.1513	0.5758	1.1513	1.0730
0.3453	8.6897	504	1.1533	0.5769	1.1533	1.0739
0.3453	8.7241	506	1.1442	0.5769	1.1442	1.0697
0.3453	8.7586	508	1.1485	0.5656	1.1485	1.0717
0.3453	8.7931	510	1.1541	0.5460	1.1541	1.0743
0.3453	8.8276	512	1.1686	0.5504	1.1686	1.0810
0.3453	8.8621	514	1.1801	0.5511	1.1801	1.0863
0.3453	8.8966	516	1.1956	0.5614	1.1956	1.0934
0.3453	8.9310	518	1.2008	0.5562	1.2008	1.0958
0.3453	8.9655	520	1.1996	0.5435	1.1996	1.0953
0.3453	9.0	522	1.2012	0.5460	1.2012	1.0960
0.3453	9.0345	524	1.1931	0.5460	1.1931	1.0923
0.3453	9.0690	526	1.1863	0.5469	1.1863	1.0892
0.3453	9.1034	528	1.1729	0.5469	1.1729	1.0830
0.3453	9.1379	530	1.1500	0.5616	1.1500	1.0724
0.3453	9.1724	532	1.1252	0.5879	1.1252	1.0608
0.3453	9.2069	534	1.1125	0.5859	1.1125	1.0548
0.3453	9.2414	536	1.0994	0.5870	1.0994	1.0485
0.3453	9.2759	538	1.0819	0.5943	1.0819	1.0402
0.3453	9.3103	540	1.0701	0.5922	1.0701	1.0345
0.3453	9.3448	542	1.0657	0.5852	1.0657	1.0323
0.3453	9.3793	544	1.0637	0.5852	1.0637	1.0314
0.3453	9.4138	546	1.0723	0.5922	1.0723	1.0355
0.3453	9.4483	548	1.0834	0.5922	1.0834	1.0409
0.3453	9.4828	550	1.0913	0.5909	1.0913	1.0446
0.3453	9.5172	552	1.0976	0.5849	1.0976	1.0477
0.3453	9.5517	554	1.1012	0.5849	1.1012	1.0494
0.3453	9.5862	556	1.1009	0.5849	1.1009	1.0492
0.3453	9.6207	558	1.1018	0.5849	1.1018	1.0497
0.3453	9.6552	560	1.1015	0.5849	1.1015	1.0495
0.3453	9.6897	562	1.1002	0.5849	1.1002	1.0489
0.3453	9.7241	564	1.0999	0.5849	1.0999	1.0488
0.3453	9.7586	566	1.0998	0.5849	1.0998	1.0487
0.3453	9.7931	568	1.0975	0.5849	1.0975	1.0476
0.3453	9.8276	570	1.0979	0.5849	1.0979	1.0478
0.3453	9.8621	572	1.1003	0.5849	1.1003	1.0489
0.3453	9.8966	574	1.1034	0.5870	1.1034	1.0504
0.3453	9.9310	576	1.1043	0.5870	1.1043	1.0508
0.3453	9.9655	578	1.1050	0.5870	1.1050	1.0512
0.3453	10.0	580	1.1051	0.5870	1.1051	1.0512

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 10, 2024