ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k13_task1_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k13_task1_organization

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k13_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

23% of all-time downloads

All-time downloads

Public

Parameters

135M

1.1 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: 22c882fd

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k13_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.8428
Qwk: 0.6553
Mse: 0.8428
Rmse: 0.9181

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0328	2	5.3791	-0.0165	5.3791	2.3193
No log	0.0656	4	3.2894	0.0642	3.2894	1.8137
No log	0.0984	6	2.3389	-0.0478	2.3389	1.5293
No log	0.1311	8	1.8780	0.0253	1.8780	1.3704
No log	0.1639	10	2.0817	-0.1539	2.0817	1.4428
No log	0.1967	12	1.5803	-0.0039	1.5803	1.2571
No log	0.2295	14	1.6450	-0.0812	1.6450	1.2826
No log	0.2623	16	1.3279	0.1497	1.3279	1.1523
No log	0.2951	18	1.2770	0.2273	1.2770	1.1300
No log	0.3279	20	1.1824	0.2428	1.1824	1.0874
No log	0.3607	22	1.1866	0.1947	1.1866	1.0893
No log	0.3934	24	1.1693	0.2028	1.1693	1.0814
No log	0.4262	26	1.1704	0.2769	1.1704	1.0818
No log	0.4590	28	1.1597	0.2217	1.1597	1.0769
No log	0.4918	30	1.1690	0.1976	1.1690	1.0812
No log	0.5246	32	1.1810	0.2160	1.1810	1.0867
No log	0.5574	34	1.1421	0.2990	1.1421	1.0687
No log	0.5902	36	1.0953	0.3327	1.0953	1.0466
No log	0.6230	38	1.2355	0.2825	1.2355	1.1115
No log	0.6557	40	1.1490	0.3798	1.1490	1.0719
No log	0.6885	42	1.0321	0.3483	1.0321	1.0159
No log	0.7213	44	1.0470	0.3281	1.0470	1.0232
No log	0.7541	46	1.0584	0.3401	1.0584	1.0288
No log	0.7869	48	1.0611	0.4111	1.0611	1.0301
No log	0.8197	50	1.0275	0.4293	1.0275	1.0136
No log	0.8525	52	1.0679	0.4640	1.0679	1.0334
No log	0.8852	54	1.0041	0.4810	1.0041	1.0021
No log	0.9180	56	0.9852	0.3841	0.9852	0.9926
No log	0.9508	58	1.1470	0.2665	1.1470	1.0710
No log	0.9836	60	1.2329	0.2743	1.2329	1.1103
No log	1.0164	62	1.2335	0.2886	1.2335	1.1106
No log	1.0492	64	1.1464	0.4398	1.1464	1.0707
No log	1.0820	66	1.0770	0.4927	1.0770	1.0378
No log	1.1148	68	1.0677	0.5427	1.0677	1.0333
No log	1.1475	70	1.0396	0.5323	1.0396	1.0196
No log	1.1803	72	1.0312	0.5543	1.0312	1.0155
No log	1.2131	74	1.0298	0.5521	1.0298	1.0148
No log	1.2459	76	1.0235	0.5155	1.0235	1.0117
No log	1.2787	78	0.9731	0.5553	0.9731	0.9864
No log	1.3115	80	0.9323	0.5302	0.9323	0.9656
No log	1.3443	82	0.8997	0.5331	0.8997	0.9485
No log	1.3770	84	0.8852	0.5293	0.8852	0.9408
No log	1.4098	86	0.8964	0.5076	0.8964	0.9468
No log	1.4426	88	0.9288	0.4908	0.9288	0.9638
No log	1.4754	90	0.9683	0.4711	0.9683	0.9840
No log	1.5082	92	1.0730	0.4396	1.0730	1.0358
No log	1.5410	94	1.1251	0.4707	1.1251	1.0607
No log	1.5738	96	1.0186	0.5410	1.0186	1.0092
No log	1.6066	98	0.9240	0.6335	0.9240	0.9613
No log	1.6393	100	0.9574	0.6166	0.9574	0.9785
No log	1.6721	102	1.0970	0.5489	1.0970	1.0474
No log	1.7049	104	1.3442	0.4727	1.3442	1.1594
No log	1.7377	106	1.4268	0.4102	1.4268	1.1945
No log	1.7705	108	1.3855	0.3447	1.3855	1.1771
No log	1.8033	110	1.3479	0.3441	1.3479	1.1610
No log	1.8361	112	1.3081	0.4735	1.3081	1.1437
No log	1.8689	114	1.2938	0.5191	1.2938	1.1375
No log	1.9016	116	1.2054	0.5311	1.2054	1.0979
No log	1.9344	118	1.1692	0.4962	1.1692	1.0813
No log	1.9672	120	1.2109	0.4912	1.2109	1.1004
No log	2.0	122	1.2165	0.5064	1.2165	1.1030
No log	2.0328	124	1.1421	0.5195	1.1421	1.0687
No log	2.0656	126	1.2347	0.4572	1.2347	1.1112
No log	2.0984	128	1.2047	0.4740	1.2047	1.0976
No log	2.1311	130	1.2000	0.4648	1.2000	1.0954
No log	2.1639	132	1.0284	0.5500	1.0284	1.0141
No log	2.1967	134	0.8402	0.5669	0.8402	0.9166
No log	2.2295	136	0.8360	0.6013	0.8360	0.9144
No log	2.2623	138	1.0259	0.5518	1.0259	1.0129
No log	2.2951	140	1.1244	0.4882	1.1244	1.0604
No log	2.3279	142	1.0601	0.5112	1.0601	1.0296
No log	2.3607	144	0.9976	0.5650	0.9976	0.9988
No log	2.3934	146	1.0221	0.5687	1.0221	1.0110
No log	2.4262	148	1.0635	0.5520	1.0635	1.0313
No log	2.4590	150	0.9984	0.5722	0.9984	0.9992
No log	2.4918	152	1.0092	0.5538	1.0092	1.0046
No log	2.5246	154	1.0223	0.5683	1.0223	1.0111
No log	2.5574	156	1.0621	0.5453	1.0621	1.0306
No log	2.5902	158	1.1017	0.5264	1.1017	1.0496
No log	2.6230	160	1.0854	0.5215	1.0854	1.0418
No log	2.6557	162	1.2052	0.4940	1.2052	1.0978
No log	2.6885	164	1.2653	0.4733	1.2653	1.1248
No log	2.7213	166	1.2906	0.4590	1.2906	1.1361
No log	2.7541	168	1.2397	0.4912	1.2397	1.1134
No log	2.7869	170	1.0329	0.5597	1.0329	1.0163
No log	2.8197	172	0.8362	0.6236	0.8362	0.9145
No log	2.8525	174	0.8017	0.6723	0.8017	0.8954
No log	2.8852	176	0.8980	0.6122	0.8980	0.9477
No log	2.9180	178	1.1499	0.5397	1.1499	1.0723
No log	2.9508	180	1.1712	0.5361	1.1712	1.0822
No log	2.9836	182	1.0734	0.5698	1.0734	1.0360
No log	3.0164	184	1.0866	0.5688	1.0866	1.0424
No log	3.0492	186	1.0327	0.5674	1.0327	1.0162
No log	3.0820	188	1.0147	0.5607	1.0147	1.0073
No log	3.1148	190	1.0169	0.5478	1.0169	1.0084
No log	3.1475	192	0.9926	0.5616	0.9926	0.9963
No log	3.1803	194	0.9919	0.5746	0.9919	0.9959
No log	3.2131	196	1.0853	0.5512	1.0853	1.0418
No log	3.2459	198	1.0975	0.5546	1.0975	1.0476
No log	3.2787	200	1.0372	0.5582	1.0372	1.0184
No log	3.3115	202	1.0878	0.5327	1.0878	1.0430
No log	3.3443	204	1.0569	0.5343	1.0569	1.0280
No log	3.3770	206	0.9815	0.5690	0.9815	0.9907
No log	3.4098	208	0.9035	0.5971	0.9035	0.9505
No log	3.4426	210	0.7996	0.6558	0.7996	0.8942
No log	3.4754	212	0.8045	0.6497	0.8045	0.8970
No log	3.5082	214	0.8660	0.6124	0.8660	0.9306
No log	3.5410	216	0.9009	0.5676	0.9009	0.9492
No log	3.5738	218	1.0871	0.5434	1.0871	1.0426
No log	3.6066	220	1.1223	0.5426	1.1223	1.0594
No log	3.6393	222	0.9392	0.5750	0.9392	0.9691
No log	3.6721	224	0.7638	0.6687	0.7638	0.8740
No log	3.7049	226	0.7293	0.7022	0.7293	0.8540
No log	3.7377	228	0.7875	0.6598	0.7875	0.8874
No log	3.7705	230	0.8712	0.5923	0.8712	0.9334
No log	3.8033	232	1.0942	0.5390	1.0942	1.0460
No log	3.8361	234	1.1637	0.5295	1.1637	1.0788
No log	3.8689	236	1.1017	0.5597	1.1017	1.0496
No log	3.9016	238	0.9173	0.5708	0.9173	0.9578
No log	3.9344	240	0.7755	0.6995	0.7755	0.8806
No log	3.9672	242	0.7555	0.6931	0.7555	0.8692
No log	4.0	244	0.7913	0.6564	0.7913	0.8895
No log	4.0328	246	0.8901	0.5987	0.8901	0.9434
No log	4.0656	248	0.8762	0.6012	0.8762	0.9360
No log	4.0984	250	0.7815	0.6512	0.7815	0.8840
No log	4.1311	252	0.7303	0.7066	0.7303	0.8546
No log	4.1639	254	0.7336	0.6999	0.7336	0.8565
No log	4.1967	256	0.7390	0.7045	0.7390	0.8597
No log	4.2295	258	0.7870	0.6618	0.7870	0.8871
No log	4.2623	260	0.9028	0.6047	0.9028	0.9502
No log	4.2951	262	1.0168	0.5748	1.0168	1.0084
No log	4.3279	264	1.0242	0.5780	1.0242	1.0120
No log	4.3607	266	0.9355	0.6012	0.9355	0.9672
No log	4.3934	268	0.8515	0.6714	0.8515	0.9228
No log	4.4262	270	0.8819	0.6436	0.8819	0.9391
No log	4.4590	272	0.9246	0.5888	0.9246	0.9616
No log	4.4918	274	0.8777	0.5992	0.8777	0.9369
No log	4.5246	276	0.9073	0.5902	0.9073	0.9525
No log	4.5574	278	1.0405	0.5651	1.0405	1.0201
No log	4.5902	280	1.0409	0.5581	1.0409	1.0203
No log	4.6230	282	0.9117	0.6118	0.9117	0.9548
No log	4.6557	284	0.8614	0.6546	0.8614	0.9281
No log	4.6885	286	0.8608	0.6443	0.8608	0.9278
No log	4.7213	288	0.9510	0.5941	0.9510	0.9752
No log	4.7541	290	1.0151	0.5861	1.0151	1.0075
No log	4.7869	292	1.0124	0.5575	1.0124	1.0062
No log	4.8197	294	0.9876	0.5832	0.9876	0.9938
No log	4.8525	296	1.0215	0.5443	1.0215	1.0107
No log	4.8852	298	1.0380	0.5513	1.0380	1.0188
No log	4.9180	300	1.1189	0.5191	1.1189	1.0578
No log	4.9508	302	1.1564	0.5288	1.1564	1.0754
No log	4.9836	304	1.1240	0.5380	1.1240	1.0602
No log	5.0164	306	1.0433	0.5581	1.0433	1.0214
No log	5.0492	308	0.9198	0.5768	0.9198	0.9591
No log	5.0820	310	0.8405	0.6224	0.8405	0.9168
No log	5.1148	312	0.8250	0.6500	0.8250	0.9083
No log	5.1475	314	0.8505	0.6392	0.8505	0.9222
No log	5.1803	316	0.8485	0.6568	0.8485	0.9212
No log	5.2131	318	0.8768	0.6391	0.8768	0.9364
No log	5.2459	320	0.9627	0.6060	0.9627	0.9812
No log	5.2787	322	0.9872	0.6041	0.9872	0.9936
No log	5.3115	324	0.9362	0.6012	0.9362	0.9676
No log	5.3443	326	0.8607	0.6465	0.8607	0.9277
No log	5.3770	328	0.8622	0.6391	0.8622	0.9285
No log	5.4098	330	0.8774	0.6368	0.8774	0.9367
No log	5.4426	332	0.9838	0.5803	0.9838	0.9918
No log	5.4754	334	1.0324	0.5747	1.0324	1.0161
No log	5.5082	336	1.1299	0.5315	1.1299	1.0630
No log	5.5410	338	1.1734	0.5357	1.1734	1.0833
No log	5.5738	340	1.1029	0.5308	1.1029	1.0502
No log	5.6066	342	1.0300	0.5625	1.0300	1.0149
No log	5.6393	344	0.9958	0.5713	0.9958	0.9979
No log	5.6721	346	1.0225	0.5625	1.0225	1.0112
No log	5.7049	348	1.0693	0.5626	1.0693	1.0341
No log	5.7377	350	1.1295	0.5322	1.1295	1.0628
No log	5.7705	352	1.1375	0.5225	1.1375	1.0665
No log	5.8033	354	1.0435	0.5427	1.0435	1.0215
No log	5.8361	356	0.8875	0.6457	0.8875	0.9420
No log	5.8689	358	0.7829	0.6974	0.7829	0.8848
No log	5.9016	360	0.7561	0.6666	0.7561	0.8695
No log	5.9344	362	0.7606	0.6648	0.7606	0.8721
No log	5.9672	364	0.7974	0.6897	0.7974	0.8930
No log	6.0	366	0.8897	0.6268	0.8897	0.9432
No log	6.0328	368	0.9971	0.5398	0.9971	0.9985
No log	6.0656	370	1.0204	0.5483	1.0204	1.0102
No log	6.0984	372	0.9606	0.5630	0.9606	0.9801
No log	6.1311	374	0.9439	0.5675	0.9439	0.9715
No log	6.1639	376	0.9697	0.5780	0.9697	0.9847
No log	6.1967	378	0.9913	0.5735	0.9913	0.9957
No log	6.2295	380	1.0192	0.5636	1.0192	1.0095
No log	6.2623	382	0.9709	0.5701	0.9709	0.9854
No log	6.2951	384	0.9167	0.6007	0.9167	0.9574
No log	6.3279	386	0.8547	0.6523	0.8547	0.9245
No log	6.3607	388	0.8411	0.6523	0.8411	0.9171
No log	6.3934	390	0.8858	0.6081	0.8858	0.9412
No log	6.4262	392	0.9199	0.5709	0.9199	0.9591
No log	6.4590	394	0.9095	0.5891	0.9095	0.9537
No log	6.4918	396	0.8717	0.6160	0.8717	0.9336
No log	6.5246	398	0.8786	0.6160	0.8786	0.9373
No log	6.5574	400	0.8973	0.5932	0.8973	0.9473
No log	6.5902	402	0.9448	0.5744	0.9448	0.9720
No log	6.6230	404	0.9640	0.5650	0.9640	0.9818
No log	6.6557	406	0.9731	0.5557	0.9731	0.9864
No log	6.6885	408	0.9212	0.5839	0.9212	0.9598
No log	6.7213	410	0.8660	0.6247	0.8660	0.9306
No log	6.7541	412	0.8320	0.6484	0.8320	0.9121
No log	6.7869	414	0.8451	0.6489	0.8451	0.9193
No log	6.8197	416	0.8507	0.6444	0.8507	0.9223
No log	6.8525	418	0.8707	0.6239	0.8707	0.9331
No log	6.8852	420	0.8640	0.6109	0.8640	0.9295
No log	6.9180	422	0.8524	0.6207	0.8524	0.9232
No log	6.9508	424	0.8702	0.6020	0.8702	0.9329
No log	6.9836	426	0.8936	0.6011	0.8936	0.9453
No log	7.0164	428	0.9123	0.5964	0.9123	0.9551
No log	7.0492	430	0.8925	0.6011	0.8925	0.9447
No log	7.0820	432	0.8451	0.6476	0.8451	0.9193
No log	7.1148	434	0.8418	0.6598	0.8418	0.9175
No log	7.1475	436	0.8963	0.6040	0.8963	0.9467
No log	7.1803	438	0.9332	0.5702	0.9332	0.9660
No log	7.2131	440	0.9645	0.5727	0.9645	0.9821
No log	7.2459	442	0.9494	0.5726	0.9494	0.9744
No log	7.2787	444	0.9261	0.5899	0.9261	0.9623
No log	7.3115	446	0.8676	0.6375	0.8676	0.9315
No log	7.3443	448	0.7882	0.6758	0.7882	0.8878
No log	7.3770	450	0.7384	0.6873	0.7384	0.8593
No log	7.4098	452	0.7254	0.6725	0.7254	0.8517
No log	7.4426	454	0.7428	0.6873	0.7428	0.8619
No log	7.4754	456	0.7840	0.6880	0.7840	0.8855
No log	7.5082	458	0.8437	0.6598	0.8437	0.9185
No log	7.5410	460	0.9178	0.5975	0.9178	0.9580
No log	7.5738	462	0.9513	0.5967	0.9513	0.9754
No log	7.6066	464	0.9662	0.5967	0.9662	0.9829
No log	7.6393	466	0.9312	0.6066	0.9312	0.9650
No log	7.6721	468	0.8814	0.6016	0.8814	0.9388
No log	7.7049	470	0.8319	0.6666	0.8319	0.9121
No log	7.7377	472	0.8050	0.6753	0.8050	0.8972
No log	7.7705	474	0.8122	0.6666	0.8122	0.9012
No log	7.8033	476	0.8507	0.6266	0.8507	0.9224
No log	7.8361	478	0.9132	0.5982	0.9132	0.9556
No log	7.8689	480	0.9873	0.5695	0.9873	0.9937
No log	7.9016	482	1.0157	0.5572	1.0157	1.0078
No log	7.9344	484	1.0086	0.5464	1.0086	1.0043
No log	7.9672	486	0.9856	0.5474	0.9856	0.9928
No log	8.0	488	0.9504	0.5646	0.9504	0.9749
No log	8.0328	490	0.9364	0.5646	0.9364	0.9677
No log	8.0656	492	0.9242	0.5735	0.9242	0.9613
No log	8.0984	494	0.8957	0.5914	0.8957	0.9464
No log	8.1311	496	0.8874	0.5971	0.8874	0.9420
No log	8.1639	498	0.8769	0.6212	0.8769	0.9364
0.4557	8.1967	500	0.8946	0.6031	0.8946	0.9458
0.4557	8.2295	502	0.9235	0.6053	0.9235	0.9610
0.4557	8.2623	504	0.9096	0.6122	0.9096	0.9537
0.4557	8.2951	506	0.8933	0.6309	0.8933	0.9452
0.4557	8.3279	508	0.8701	0.6481	0.8701	0.9328
0.4557	8.3607	510	0.8456	0.6525	0.8456	0.9196
0.4557	8.3934	512	0.8392	0.6525	0.8392	0.9161
0.4557	8.4262	514	0.8368	0.6518	0.8368	0.9148
0.4557	8.4590	516	0.8202	0.6518	0.8202	0.9056
0.4557	8.4918	518	0.7961	0.6659	0.7961	0.8923
0.4557	8.5246	520	0.7848	0.6777	0.7848	0.8859
0.4557	8.5574	522	0.7812	0.6814	0.7812	0.8838
0.4557	8.5902	524	0.7762	0.6988	0.7762	0.8810
0.4557	8.6230	526	0.7764	0.7033	0.7764	0.8811
0.4557	8.6557	528	0.7875	0.6885	0.7875	0.8874
0.4557	8.6885	530	0.7953	0.6436	0.7953	0.8918
0.4557	8.7213	532	0.7988	0.6480	0.7988	0.8938
0.4557	8.7541	534	0.8085	0.6517	0.8085	0.8992
0.4557	8.7869	536	0.8227	0.6509	0.8227	0.9070
0.4557	8.8197	538	0.8491	0.6473	0.8491	0.9215
0.4557	8.8525	540	0.8654	0.6346	0.8654	0.9303
0.4557	8.8852	542	0.8799	0.6077	0.8799	0.9380
0.4557	8.9180	544	0.8721	0.6473	0.8721	0.9338
0.4557	8.9508	546	0.8507	0.6581	0.8507	0.9224
0.4557	8.9836	548	0.8380	0.6632	0.8380	0.9154
0.4557	9.0164	550	0.8275	0.6632	0.8275	0.9097
0.4557	9.0492	552	0.8148	0.6811	0.8148	0.9027
0.4557	9.0820	554	0.8043	0.6774	0.8043	0.8968
0.4557	9.1148	556	0.7953	0.6792	0.7953	0.8918
0.4557	9.1475	558	0.7932	0.6792	0.7932	0.8906
0.4557	9.1803	560	0.7908	0.6792	0.7908	0.8893
0.4557	9.2131	562	0.7918	0.6792	0.7918	0.8898
0.4557	9.2459	564	0.7936	0.6774	0.7936	0.8908
0.4557	9.2787	566	0.7945	0.6774	0.7945	0.8913
0.4557	9.3115	568	0.8020	0.6774	0.8020	0.8955
0.4557	9.3443	570	0.8037	0.6811	0.8037	0.8965
0.4557	9.3770	572	0.8063	0.6811	0.8063	0.8979
0.4557	9.4098	574	0.8147	0.6811	0.8147	0.9026
0.4557	9.4426	576	0.8216	0.6632	0.8216	0.9064
0.4557	9.4754	578	0.8261	0.6632	0.8261	0.9089
0.4557	9.5082	580	0.8257	0.6632	0.8257	0.9087
0.4557	9.5410	582	0.8232	0.6632	0.8232	0.9073
0.4557	9.5738	584	0.8161	0.6811	0.8161	0.9034
0.4557	9.6066	586	0.8139	0.6811	0.8139	0.9022
0.4557	9.6393	588	0.8139	0.6811	0.8139	0.9022
0.4557	9.6721	590	0.8164	0.6811	0.8164	0.9035
0.4557	9.7049	592	0.8206	0.6811	0.8206	0.9059
0.4557	9.7377	594	0.8233	0.6811	0.8233	0.9073
0.4557	9.7705	596	0.8261	0.6741	0.8261	0.9089
0.4557	9.8033	598	0.8290	0.6561	0.8290	0.9105
0.4557	9.8361	600	0.8328	0.6561	0.8328	0.9126
0.4557	9.8689	602	0.8364	0.6598	0.8364	0.9146
0.4557	9.9016	604	0.8385	0.6553	0.8385	0.9157
0.4557	9.9344	606	0.8406	0.6553	0.8406	0.9168
0.4557	9.9672	608	0.8422	0.6553	0.8422	0.9177
0.4557	10.0	610	0.8428	0.6553	0.8428	0.9181

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024