ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k19_task5_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k19_task5_organization

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k19_task5_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

53% of all-time downloads

All-time downloads

Public

Parameters

135M

1.1 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: f98c8caa

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k19_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 1.1063
Qwk: 0.5870
Mse: 1.1063
Rmse: 1.0518

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0345	2	2.2657	0.0144	2.2657	1.5052
No log	0.0690	4	1.4498	0.2089	1.4498	1.2041
No log	0.1034	6	1.4894	0.1340	1.4894	1.2204
No log	0.1379	8	1.6092	0.2548	1.6092	1.2685
No log	0.1724	10	1.7392	0.2321	1.7392	1.3188
No log	0.2069	12	1.7162	0.2949	1.7162	1.3101
No log	0.2414	14	1.6483	0.3435	1.6483	1.2839
No log	0.2759	16	1.5594	0.3304	1.5594	1.2488
No log	0.3103	18	1.4422	0.1700	1.4422	1.2009
No log	0.3448	20	1.3957	0.1475	1.3957	1.1814
No log	0.3793	22	1.3207	0.1318	1.3207	1.1492
No log	0.4138	24	1.3352	0.3197	1.3352	1.1555
No log	0.4483	26	1.3940	0.3946	1.3940	1.1807
No log	0.4828	28	1.3787	0.2884	1.3787	1.1742
No log	0.5172	30	1.3476	0.2933	1.3476	1.1609
No log	0.5517	32	1.2994	0.1981	1.2994	1.1399
No log	0.5862	34	1.2632	0.2389	1.2632	1.1239
No log	0.6207	36	1.2553	0.2970	1.2553	1.1204
No log	0.6552	38	1.3463	0.4215	1.3463	1.1603
No log	0.6897	40	1.5177	0.3688	1.5177	1.2319
No log	0.7241	42	1.5495	0.3325	1.5495	1.2448
No log	0.7586	44	1.4977	0.3819	1.4977	1.2238
No log	0.7931	46	1.5555	0.3214	1.5555	1.2472
No log	0.8276	48	1.4591	0.4032	1.4591	1.2079
No log	0.8621	50	1.5431	0.3849	1.5431	1.2422
No log	0.8966	52	1.8850	0.3222	1.8850	1.3729
No log	0.9310	54	2.1504	0.2001	2.1504	1.4664
No log	0.9655	56	2.0226	0.1920	2.0226	1.4222
No log	1.0	58	1.7930	0.2973	1.7930	1.3390
No log	1.0345	60	1.5150	0.3663	1.5150	1.2309
No log	1.0690	62	1.3548	0.3117	1.3548	1.1639
No log	1.1034	64	1.3470	0.3791	1.3470	1.1606
No log	1.1379	66	1.4157	0.3721	1.4157	1.1898
No log	1.1724	68	1.5289	0.3732	1.5289	1.2365
No log	1.2069	70	1.6806	0.3167	1.6806	1.2964
No log	1.2414	72	1.8340	0.2540	1.8340	1.3543
No log	1.2759	74	2.0349	0.2481	2.0349	1.4265
No log	1.3103	76	2.3533	0.3041	2.3533	1.5341
No log	1.3448	78	2.5376	0.2607	2.5376	1.5930
No log	1.3793	80	2.4043	0.2893	2.4043	1.5506
No log	1.4138	82	2.1722	0.3050	2.1722	1.4738
No log	1.4483	84	1.9618	0.3484	1.9618	1.4007
No log	1.4828	86	1.6478	0.3811	1.6478	1.2837
No log	1.5172	88	1.3443	0.4212	1.3443	1.1594
No log	1.5517	90	1.2824	0.4196	1.2824	1.1324
No log	1.5862	92	1.3692	0.5119	1.3692	1.1701
No log	1.6207	94	1.4936	0.4733	1.4936	1.2221
No log	1.6552	96	1.5893	0.4994	1.5893	1.2607
No log	1.6897	98	1.6365	0.4910	1.6365	1.2792
No log	1.7241	100	1.8442	0.4642	1.8442	1.3580
No log	1.7586	102	2.1235	0.3933	2.1235	1.4572
No log	1.7931	104	2.3127	0.3307	2.3127	1.5207
No log	1.8276	106	2.4457	0.3348	2.4457	1.5639
No log	1.8621	108	2.5034	0.3637	2.5034	1.5822
No log	1.8966	110	2.4452	0.3649	2.4452	1.5637
No log	1.9310	112	2.2040	0.3481	2.2040	1.4846
No log	1.9655	114	1.8790	0.3589	1.8790	1.3708
No log	2.0	116	1.6192	0.4433	1.6192	1.2725
No log	2.0345	118	1.4847	0.4905	1.4847	1.2185
No log	2.0690	120	1.2574	0.5625	1.2574	1.1213
No log	2.1034	122	1.0530	0.5961	1.0530	1.0262
No log	2.1379	124	1.0445	0.5807	1.0445	1.0220
No log	2.1724	126	1.1169	0.5867	1.1169	1.0568
No log	2.2069	128	1.2828	0.5448	1.2828	1.1326
No log	2.2414	130	1.4636	0.5053	1.4636	1.2098
No log	2.2759	132	1.7307	0.4501	1.7307	1.3155
No log	2.3103	134	1.9465	0.4432	1.9465	1.3952
No log	2.3448	136	2.1113	0.4181	2.1113	1.4530
No log	2.3793	138	2.2175	0.4064	2.2175	1.4891
No log	2.4138	140	2.2794	0.4164	2.2794	1.5098
No log	2.4483	142	2.1812	0.4188	2.1812	1.4769
No log	2.4828	144	2.0385	0.4053	2.0385	1.4278
No log	2.5172	146	1.8017	0.4220	1.8017	1.3423
No log	2.5517	148	1.5891	0.4889	1.5891	1.2606
No log	2.5862	150	1.4917	0.4810	1.4917	1.2213
No log	2.6207	152	1.4635	0.4620	1.4635	1.2097
No log	2.6552	154	1.3901	0.4836	1.3901	1.1790
No log	2.6897	156	1.3499	0.4950	1.3499	1.1619
No log	2.7241	158	1.3597	0.5183	1.3597	1.1660
No log	2.7586	160	1.3078	0.5108	1.3078	1.1436
No log	2.7931	162	1.3330	0.5104	1.3330	1.1546
No log	2.8276	164	1.3966	0.5069	1.3966	1.1818
No log	2.8621	166	1.3986	0.5275	1.3986	1.1826
No log	2.8966	168	1.3244	0.4996	1.3244	1.1508
No log	2.9310	170	1.2387	0.5149	1.2387	1.1130
No log	2.9655	172	1.1438	0.5399	1.1438	1.0695
No log	3.0	174	1.0913	0.5711	1.0913	1.0447
No log	3.0345	176	1.1525	0.5595	1.1525	1.0735
No log	3.0690	178	1.2778	0.5549	1.2778	1.1304
No log	3.1034	180	1.4599	0.5260	1.4599	1.2083
No log	3.1379	182	1.5148	0.5053	1.5148	1.2308
No log	3.1724	184	1.4769	0.5053	1.4769	1.2153
No log	3.2069	186	1.5006	0.5023	1.5006	1.2250
No log	3.2414	188	1.5092	0.4947	1.5092	1.2285
No log	3.2759	190	1.4734	0.5108	1.4734	1.2138
No log	3.3103	192	1.3931	0.5414	1.3931	1.1803
No log	3.3448	194	1.2842	0.5473	1.2842	1.1332
No log	3.3793	196	1.2786	0.5540	1.2786	1.1308
No log	3.4138	198	1.3233	0.5497	1.3233	1.1503
No log	3.4483	200	1.3591	0.5042	1.3591	1.1658
No log	3.4828	202	1.2392	0.5254	1.2392	1.1132
No log	3.5172	204	1.1026	0.5851	1.1026	1.0501
No log	3.5517	206	0.9693	0.6415	0.9693	0.9845
No log	3.5862	208	0.9029	0.6302	0.9029	0.9502
No log	3.6207	210	0.9027	0.6302	0.9027	0.9501
No log	3.6552	212	0.9579	0.6302	0.9579	0.9787
No log	3.6897	214	1.0985	0.5920	1.0985	1.0481
No log	3.7241	216	1.1752	0.5812	1.1752	1.0841
No log	3.7586	218	1.1929	0.5748	1.1929	1.0922
No log	3.7931	220	1.1994	0.5641	1.1994	1.0952
No log	3.8276	222	1.1816	0.5781	1.1816	1.0870
No log	3.8621	224	1.1882	0.5661	1.1882	1.0900
No log	3.8966	226	1.2156	0.5489	1.2156	1.1026
No log	3.9310	228	1.3209	0.5362	1.3209	1.1493
No log	3.9655	230	1.3876	0.5384	1.3876	1.1780
No log	4.0	232	1.4078	0.5225	1.4078	1.1865
No log	4.0345	234	1.3979	0.5291	1.3979	1.1823
No log	4.0690	236	1.4233	0.5232	1.4233	1.1930
No log	4.1034	238	1.4543	0.5267	1.4543	1.2059
No log	4.1379	240	1.4098	0.5267	1.4098	1.1874
No log	4.1724	242	1.3642	0.5266	1.3642	1.1680
No log	4.2069	244	1.2293	0.5319	1.2293	1.1087
No log	4.2414	246	1.1168	0.5675	1.1168	1.0568
No log	4.2759	248	1.1193	0.5649	1.1193	1.0580
No log	4.3103	250	1.1925	0.5061	1.1925	1.0920
No log	4.3448	252	1.2874	0.5236	1.2874	1.1347
No log	4.3793	254	1.4065	0.5197	1.4065	1.1860
No log	4.4138	256	1.4952	0.5264	1.4952	1.2228
No log	4.4483	258	1.5182	0.5264	1.5182	1.2321
No log	4.4828	260	1.5055	0.5264	1.5055	1.2270
No log	4.5172	262	1.4574	0.5160	1.4574	1.2072
No log	4.5517	264	1.3913	0.5160	1.3913	1.1795
No log	4.5862	266	1.3647	0.5131	1.3647	1.1682
No log	4.6207	268	1.3565	0.5160	1.3565	1.1647
No log	4.6552	270	1.3978	0.5160	1.3978	1.1823
No log	4.6897	272	1.4510	0.5145	1.4510	1.2046
No log	4.7241	274	1.4510	0.5145	1.4510	1.2046
No log	4.7586	276	1.4726	0.5145	1.4726	1.2135
No log	4.7931	278	1.4413	0.5145	1.4413	1.2006
No log	4.8276	280	1.3159	0.5345	1.3159	1.1471
No log	4.8621	282	1.2481	0.5550	1.2481	1.1172
No log	4.8966	284	1.1880	0.5589	1.1880	1.0899
No log	4.9310	286	1.1371	0.5539	1.1371	1.0663
No log	4.9655	288	1.0366	0.5615	1.0366	1.0181
No log	5.0	290	0.9778	0.5791	0.9778	0.9888
No log	5.0345	292	0.9821	0.5791	0.9821	0.9910
No log	5.0690	294	1.0827	0.5734	1.0827	1.0405
No log	5.1034	296	1.2140	0.5305	1.2140	1.1018
No log	5.1379	298	1.3032	0.5204	1.3032	1.1416
No log	5.1724	300	1.3882	0.5072	1.3882	1.1782
No log	5.2069	302	1.5071	0.4946	1.5071	1.2276
No log	5.2414	304	1.5720	0.4869	1.5720	1.2538
No log	5.2759	306	1.6073	0.4751	1.6073	1.2678
No log	5.3103	308	1.5940	0.4645	1.5940	1.2625
No log	5.3448	310	1.4995	0.4946	1.4995	1.2246
No log	5.3793	312	1.3904	0.5107	1.3904	1.1792
No log	5.4138	314	1.3038	0.5236	1.3038	1.1419
No log	5.4483	316	1.3059	0.5074	1.3059	1.1428
No log	5.4828	318	1.3299	0.5055	1.3299	1.1532
No log	5.5172	320	1.3318	0.5072	1.3318	1.1540
No log	5.5517	322	1.3159	0.5343	1.3159	1.1471
No log	5.5862	324	1.2972	0.5666	1.2972	1.1389
No log	5.6207	326	1.2561	0.5675	1.2561	1.1207
No log	5.6552	328	1.2296	0.5623	1.2296	1.1089
No log	5.6897	330	1.1605	0.5767	1.1605	1.0773
No log	5.7241	332	1.1315	0.5690	1.1315	1.0637
No log	5.7586	334	1.1036	0.5667	1.1036	1.0505
No log	5.7931	336	1.0564	0.5905	1.0564	1.0278
No log	5.8276	338	1.0124	0.6218	1.0124	1.0062
No log	5.8621	340	0.9953	0.6163	0.9953	0.9977
No log	5.8966	342	1.0173	0.6163	1.0173	1.0086
No log	5.9310	344	1.0657	0.6016	1.0657	1.0323
No log	5.9655	346	1.1041	0.5921	1.1041	1.0507
No log	6.0	348	1.1202	0.5669	1.1202	1.0584
No log	6.0345	350	1.0960	0.5602	1.0960	1.0469
No log	6.0690	352	1.0410	0.5780	1.0410	1.0203
No log	6.1034	354	0.9845	0.5794	0.9845	0.9922
No log	6.1379	356	0.9797	0.5794	0.9797	0.9898
No log	6.1724	358	0.9978	0.5793	0.9978	0.9989
No log	6.2069	360	1.0448	0.5698	1.0448	1.0222
No log	6.2414	362	1.0992	0.5444	1.0992	1.0484
No log	6.2759	364	1.1719	0.5493	1.1719	1.0825
No log	6.3103	366	1.1690	0.5493	1.1690	1.0812
No log	6.3448	368	1.1261	0.5502	1.1261	1.0612
No log	6.3793	370	1.1070	0.5502	1.1070	1.0521
No log	6.4138	372	1.0894	0.5531	1.0894	1.0437
No log	6.4483	374	1.0188	0.5722	1.0188	1.0094
No log	6.4828	376	0.9497	0.6280	0.9497	0.9745
No log	6.5172	378	0.8966	0.6120	0.8966	0.9469
No log	6.5517	380	0.8983	0.6172	0.8983	0.9478
No log	6.5862	382	0.9487	0.6228	0.9487	0.9740
No log	6.6207	384	1.0009	0.6220	1.0009	1.0005
No log	6.6552	386	0.9997	0.6220	0.9997	0.9998
No log	6.6897	388	0.9697	0.6317	0.9697	0.9848
No log	6.7241	390	0.9413	0.6540	0.9413	0.9702
No log	6.7586	392	0.9409	0.6410	0.9409	0.9700
No log	6.7931	394	0.9626	0.6317	0.9626	0.9811
No log	6.8276	396	0.9892	0.6023	0.9892	0.9946
No log	6.8621	398	1.0184	0.6023	1.0184	1.0092
No log	6.8966	400	1.0332	0.6023	1.0332	1.0165
No log	6.9310	402	1.0580	0.5895	1.0580	1.0286
No log	6.9655	404	1.0895	0.5791	1.0895	1.0438
No log	7.0	406	1.1258	0.5701	1.1258	1.0611
No log	7.0345	408	1.1369	0.5724	1.1369	1.0663
No log	7.0690	410	1.1390	0.5635	1.1390	1.0673
No log	7.1034	412	1.1181	0.5667	1.1181	1.0574
No log	7.1379	414	1.1285	0.5667	1.1285	1.0623
No log	7.1724	416	1.1710	0.5487	1.1710	1.0821
No log	7.2069	418	1.2102	0.5591	1.2102	1.1001
No log	7.2414	420	1.2193	0.5443	1.2193	1.1042
No log	7.2759	422	1.2177	0.5443	1.2177	1.1035
No log	7.3103	424	1.1958	0.5478	1.1958	1.0935
No log	7.3448	426	1.1342	0.5582	1.1342	1.0650
No log	7.3793	428	1.0293	0.5699	1.0293	1.0145
No log	7.4138	430	0.9783	0.6052	0.9783	0.9891
No log	7.4483	432	0.9213	0.6195	0.9213	0.9598
No log	7.4828	434	0.8995	0.6061	0.8995	0.9484
No log	7.5172	436	0.9303	0.5955	0.9303	0.9645
No log	7.5517	438	0.9870	0.5995	0.9870	0.9935
No log	7.5862	440	1.0488	0.5988	1.0488	1.0241
No log	7.6207	442	1.0923	0.5849	1.0923	1.0451
No log	7.6552	444	1.1222	0.5713	1.1222	1.0593
No log	7.6897	446	1.1500	0.5703	1.1500	1.0724
No log	7.7241	448	1.1954	0.5600	1.1954	1.0934
No log	7.7586	450	1.2690	0.5647	1.2690	1.1265
No log	7.7931	452	1.2693	0.5668	1.2693	1.1266
No log	7.8276	454	1.2351	0.5604	1.2351	1.1114
No log	7.8621	456	1.2046	0.5683	1.2046	1.0975
No log	7.8966	458	1.1568	0.5683	1.1568	1.0756
No log	7.9310	460	1.1084	0.5876	1.1084	1.0528
No log	7.9655	462	1.0704	0.5824	1.0704	1.0346
No log	8.0	464	1.0667	0.5836	1.0667	1.0328
No log	8.0345	466	1.0956	0.5734	1.0956	1.0467
No log	8.0690	468	1.1182	0.5602	1.1182	1.0574
No log	8.1034	470	1.1427	0.5602	1.1427	1.0690
No log	8.1379	472	1.1661	0.5681	1.1661	1.0799
No log	8.1724	474	1.1874	0.5578	1.1874	1.0897
No log	8.2069	476	1.1752	0.5564	1.1752	1.0840
No log	8.2414	478	1.1571	0.5558	1.1571	1.0757
No log	8.2759	480	1.1348	0.5558	1.1348	1.0653
No log	8.3103	482	1.1083	0.5791	1.1083	1.0528
No log	8.3448	484	1.1072	0.5746	1.1072	1.0523
No log	8.3793	486	1.1279	0.5746	1.1279	1.0620
No log	8.4138	488	1.1466	0.5690	1.1466	1.0708
No log	8.4483	490	1.1531	0.5635	1.1531	1.0738
No log	8.4828	492	1.1524	0.5758	1.1524	1.0735
No log	8.5172	494	1.1438	0.5758	1.1438	1.0695
No log	8.5517	496	1.1108	0.5791	1.1108	1.0539
No log	8.5862	498	1.1160	0.5746	1.1160	1.0564
0.3452	8.6207	500	1.1378	0.5769	1.1378	1.0667
0.3452	8.6552	502	1.1514	0.5758	1.1514	1.0730
0.3452	8.6897	504	1.1531	0.5769	1.1531	1.0738
0.3452	8.7241	506	1.1440	0.5769	1.1440	1.0696
0.3452	8.7586	508	1.1484	0.5667	1.1484	1.0716
0.3452	8.7931	510	1.1543	0.5460	1.1543	1.0744
0.3452	8.8276	512	1.1690	0.5504	1.1690	1.0812
0.3452	8.8621	514	1.1808	0.5511	1.1808	1.0867
0.3452	8.8966	516	1.1964	0.5614	1.1964	1.0938
0.3452	8.9310	518	1.2017	0.5562	1.2017	1.0962
0.3452	8.9655	520	1.2004	0.5435	1.2004	1.0956
0.3452	9.0	522	1.2019	0.5460	1.2019	1.0963
0.3452	9.0345	524	1.1938	0.5460	1.1938	1.0926
0.3452	9.0690	526	1.1871	0.5460	1.1871	1.0895
0.3452	9.1034	528	1.1740	0.5469	1.1740	1.0835
0.3452	9.1379	530	1.1513	0.5659	1.1513	1.0730
0.3452	9.1724	532	1.1267	0.5879	1.1267	1.0615
0.3452	9.2069	534	1.1143	0.5859	1.1143	1.0556
0.3452	9.2414	536	1.1013	0.5870	1.1013	1.0494
0.3452	9.2759	538	1.0839	0.5943	1.0839	1.0411
0.3452	9.3103	540	1.0721	0.5922	1.0721	1.0354
0.3452	9.3448	542	1.0675	0.5852	1.0675	1.0332
0.3452	9.3793	544	1.0653	0.5852	1.0653	1.0321
0.3452	9.4138	546	1.0738	0.5922	1.0738	1.0362
0.3452	9.4483	548	1.0848	0.5930	1.0848	1.0415
0.3452	9.4828	550	1.0925	0.5930	1.0925	1.0452
0.3452	9.5172	552	1.0988	0.5849	1.0988	1.0482
0.3452	9.5517	554	1.1023	0.5849	1.1023	1.0499
0.3452	9.5862	556	1.1021	0.5849	1.1021	1.0498
0.3452	9.6207	558	1.1030	0.5849	1.1030	1.0502
0.3452	9.6552	560	1.1028	0.5849	1.1028	1.0501
0.3452	9.6897	562	1.1015	0.5849	1.1015	1.0495
0.3452	9.7241	564	1.1012	0.5849	1.1012	1.0494
0.3452	9.7586	566	1.1011	0.5849	1.1011	1.0493
0.3452	9.7931	568	1.0988	0.5849	1.0988	1.0482
0.3452	9.8276	570	1.0991	0.5849	1.0991	1.0484
0.3452	9.8621	572	1.1015	0.5849	1.1015	1.0495
0.3452	9.8966	574	1.1046	0.5870	1.1046	1.0510
0.3452	9.9310	576	1.1055	0.5870	1.1055	1.0514
0.3452	9.9655	578	1.1062	0.5870	1.1062	1.0518
0.3452	10.0	580	1.1063	0.5870	1.1063	1.0518

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024