ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k11_task1_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k11_task1_organization

ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k11_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

28% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 8, 2024
Updated: Dec 8, 2024
SHA: 4cd93b19

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k11_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.8150
Qwk: 0.6797
Mse: 0.8150
Rmse: 0.9028

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0385	2	5.3741	-0.0178	5.3741	2.3182
No log	0.0769	4	3.4933	0.0588	3.4933	1.8690
No log	0.1154	6	2.1433	0.0484	2.1433	1.4640
No log	0.1538	8	1.5014	0.1531	1.5014	1.2253
No log	0.1923	10	1.4664	0.0772	1.4664	1.2110
No log	0.2308	12	1.4523	0.0418	1.4523	1.2051
No log	0.2692	14	1.6825	-0.0179	1.6825	1.2971
No log	0.3077	16	1.4137	0.1755	1.4137	1.1890
No log	0.3462	18	1.2486	0.0822	1.2486	1.1174
No log	0.3846	20	1.1670	0.1301	1.1670	1.0803
No log	0.4231	22	1.1907	0.2869	1.1907	1.0912
No log	0.4615	24	1.3182	0.1772	1.3182	1.1481
No log	0.5	26	1.3419	0.1476	1.3419	1.1584
No log	0.5385	28	1.2556	0.2885	1.2556	1.1205
No log	0.5769	30	1.2103	0.3496	1.2103	1.1001
No log	0.6154	32	1.2290	0.3644	1.2290	1.1086
No log	0.6538	34	1.3441	0.1798	1.3441	1.1594
No log	0.6923	36	1.3313	0.1965	1.3313	1.1538
No log	0.7308	38	1.2356	0.3051	1.2356	1.1116
No log	0.7692	40	1.1430	0.3512	1.1430	1.0691
No log	0.8077	42	1.1784	0.3078	1.1784	1.0855
No log	0.8462	44	1.3368	0.0813	1.3368	1.1562
No log	0.8846	46	1.4615	0.0756	1.4615	1.2089
No log	0.9231	48	1.4074	0.0726	1.4074	1.1863
No log	0.9615	50	1.3191	0.0940	1.3191	1.1485
No log	1.0	52	1.1931	0.3001	1.1931	1.0923
No log	1.0385	54	1.1057	0.2849	1.1057	1.0515
No log	1.0769	56	1.0818	0.2560	1.0818	1.0401
No log	1.1154	58	1.0809	0.2639	1.0809	1.0397
No log	1.1538	60	1.0808	0.3801	1.0808	1.0396
No log	1.1923	62	1.1184	0.3490	1.1184	1.0575
No log	1.2308	64	1.1300	0.3087	1.1300	1.0630
No log	1.2692	66	1.1184	0.2949	1.1184	1.0576
No log	1.3077	68	1.1955	0.2430	1.1955	1.0934
No log	1.3462	70	1.3026	0.1843	1.3026	1.1413
No log	1.3846	72	1.2500	0.1863	1.2500	1.1180
No log	1.4231	74	1.1731	0.2523	1.1731	1.0831
No log	1.4615	76	1.1154	0.2622	1.1154	1.0561
No log	1.5	78	1.1628	0.2646	1.1628	1.0783
No log	1.5385	80	1.1685	0.2671	1.1685	1.0810
No log	1.5769	82	1.1514	0.2974	1.1514	1.0731
No log	1.6154	84	1.1542	0.3181	1.1542	1.0743
No log	1.6538	86	1.1086	0.3920	1.1086	1.0529
No log	1.6923	88	0.9801	0.4572	0.9801	0.9900
No log	1.7308	90	0.8447	0.5087	0.8447	0.9191
No log	1.7692	92	0.8156	0.5510	0.8156	0.9031
No log	1.8077	94	0.8415	0.5519	0.8415	0.9173
No log	1.8462	96	1.0150	0.4523	1.0150	1.0075
No log	1.8846	98	1.2658	0.3085	1.2658	1.1251
No log	1.9231	100	1.4159	0.1677	1.4159	1.1899
No log	1.9615	102	1.2165	0.3311	1.2165	1.1029
No log	2.0	104	0.9389	0.3986	0.9389	0.9690
No log	2.0385	106	0.8387	0.4984	0.8387	0.9158
No log	2.0769	108	0.8568	0.5186	0.8568	0.9256
No log	2.1154	110	0.7873	0.5	0.7873	0.8873
No log	2.1538	112	0.7765	0.5353	0.7765	0.8812
No log	2.1923	114	1.0173	0.5583	1.0173	1.0086
No log	2.2308	116	1.1422	0.4508	1.1422	1.0687
No log	2.2692	118	1.1323	0.3992	1.1323	1.0641
No log	2.3077	120	1.0569	0.4367	1.0569	1.0281
No log	2.3462	122	0.9563	0.4721	0.9563	0.9779
No log	2.3846	124	0.9352	0.4771	0.9352	0.9671
No log	2.4231	126	0.9982	0.5451	0.9982	0.9991
No log	2.4615	128	1.0190	0.5548	1.0190	1.0094
No log	2.5	130	0.9041	0.5893	0.9041	0.9509
No log	2.5385	132	0.8531	0.5929	0.8531	0.9236
No log	2.5769	134	0.8897	0.6054	0.8897	0.9433
No log	2.6154	136	0.9522	0.5815	0.9522	0.9758
No log	2.6538	138	1.0251	0.5463	1.0251	1.0125
No log	2.6923	140	1.0230	0.5252	1.0230	1.0114
No log	2.7308	142	0.9488	0.4941	0.9488	0.9741
No log	2.7692	144	0.9803	0.4582	0.9803	0.9901
No log	2.8077	146	1.0792	0.4215	1.0792	1.0389
No log	2.8462	148	1.0620	0.4668	1.0620	1.0305
No log	2.8846	150	1.0965	0.4737	1.0965	1.0472
No log	2.9231	152	1.0391	0.5347	1.0391	1.0194
No log	2.9615	154	0.9605	0.5499	0.9605	0.9801
No log	3.0	156	0.8103	0.6434	0.8103	0.9002
No log	3.0385	158	0.8034	0.6523	0.8034	0.8963
No log	3.0769	160	0.8890	0.6336	0.8890	0.9429
No log	3.1154	162	1.0186	0.5880	1.0186	1.0092
No log	3.1538	164	1.0883	0.5500	1.0883	1.0432
No log	3.1923	166	1.0985	0.5632	1.0985	1.0481
No log	3.2308	168	1.0697	0.5572	1.0697	1.0343
No log	3.2692	170	1.0894	0.5421	1.0894	1.0438
No log	3.3077	172	1.0177	0.5762	1.0177	1.0088
No log	3.3462	174	0.9417	0.6082	0.9417	0.9704
No log	3.3846	176	0.9408	0.6082	0.9408	0.9700
No log	3.4231	178	0.9411	0.6204	0.9411	0.9701
No log	3.4615	180	0.9342	0.6067	0.9342	0.9666
No log	3.5	182	0.8221	0.6520	0.8221	0.9067
No log	3.5385	184	0.7707	0.6658	0.7707	0.8779
No log	3.5769	186	0.7531	0.6813	0.7531	0.8678
No log	3.6154	188	0.7813	0.6515	0.7813	0.8839
No log	3.6538	190	0.8035	0.6638	0.8035	0.8964
No log	3.6923	192	0.9005	0.6253	0.9005	0.9489
No log	3.7308	194	1.1184	0.5162	1.1184	1.0576
No log	3.7692	196	1.2007	0.5177	1.2007	1.0957
No log	3.8077	198	1.1644	0.5362	1.1644	1.0791
No log	3.8462	200	1.0502	0.5565	1.0502	1.0248
No log	3.8846	202	0.9964	0.5908	0.9964	0.9982
No log	3.9231	204	0.9945	0.5908	0.9945	0.9973
No log	3.9615	206	0.9558	0.5990	0.9558	0.9776
No log	4.0	208	0.9386	0.5963	0.9386	0.9688
No log	4.0385	210	0.8900	0.6298	0.8900	0.9434
No log	4.0769	212	0.8741	0.6114	0.8741	0.9349
No log	4.1154	214	0.8588	0.6213	0.8588	0.9267
No log	4.1538	216	0.8347	0.6319	0.8347	0.9136
No log	4.1923	218	0.8122	0.6052	0.8122	0.9012
No log	4.2308	220	0.8072	0.6314	0.8072	0.8984
No log	4.2692	222	0.8247	0.6407	0.8247	0.9081
No log	4.3077	224	0.9205	0.6121	0.9205	0.9594
No log	4.3462	226	1.0344	0.5800	1.0344	1.0171
No log	4.3846	228	1.0377	0.5746	1.0377	1.0187
No log	4.4231	230	0.8842	0.6075	0.8842	0.9403
No log	4.4615	232	0.8349	0.6290	0.8349	0.9137
No log	4.5	234	0.9032	0.5935	0.9032	0.9504
No log	4.5385	236	0.8929	0.6025	0.8929	0.9449
No log	4.5769	238	0.8630	0.6196	0.8630	0.9290
No log	4.6154	240	0.8023	0.6470	0.8023	0.8957
No log	4.6538	242	0.8221	0.6470	0.8221	0.9067
No log	4.6923	244	0.8109	0.6494	0.8109	0.9005
No log	4.7308	246	0.7756	0.6661	0.7756	0.8807
No log	4.7692	248	0.7952	0.6481	0.7952	0.8917
No log	4.8077	250	0.7563	0.6767	0.7563	0.8697
No log	4.8462	252	0.7308	0.6821	0.7308	0.8549
No log	4.8846	254	0.7378	0.6802	0.7378	0.8590
No log	4.9231	256	0.7597	0.6669	0.7597	0.8716
No log	4.9615	258	0.7434	0.6773	0.7434	0.8622
No log	5.0	260	0.7318	0.6570	0.7318	0.8554
No log	5.0385	262	0.7601	0.6677	0.7601	0.8718
No log	5.0769	264	0.7659	0.6815	0.7659	0.8751
No log	5.1154	266	0.7472	0.6909	0.7472	0.8644
No log	5.1538	268	0.7151	0.6829	0.7151	0.8457
No log	5.1923	270	0.7451	0.6949	0.7451	0.8632
No log	5.2308	272	0.8274	0.6343	0.8274	0.9096
No log	5.2692	274	0.9189	0.6156	0.9189	0.9586
No log	5.3077	276	0.9064	0.6188	0.9064	0.9520
No log	5.3462	278	0.8264	0.6498	0.8264	0.9091
No log	5.3846	280	0.7856	0.6852	0.7856	0.8864
No log	5.4231	282	0.8119	0.6586	0.8119	0.9011
No log	5.4615	284	0.9184	0.6243	0.9184	0.9584
No log	5.5	286	0.9955	0.5897	0.9955	0.9977
No log	5.5385	288	0.9960	0.5853	0.9960	0.9980
No log	5.5769	290	1.0352	0.5607	1.0352	1.0175
No log	5.6154	292	1.1063	0.5463	1.1063	1.0518
No log	5.6538	294	1.1173	0.5335	1.1173	1.0570
No log	5.6923	296	1.0457	0.5482	1.0457	1.0226
No log	5.7308	298	0.9213	0.6224	0.9213	0.9598
No log	5.7692	300	0.8426	0.6261	0.8426	0.9179
No log	5.8077	302	0.8428	0.6261	0.8428	0.9180
No log	5.8462	304	0.9201	0.6298	0.9201	0.9592
No log	5.8846	306	1.0709	0.5544	1.0709	1.0348
No log	5.9231	308	1.1334	0.5242	1.1334	1.0646
No log	5.9615	310	1.0783	0.5429	1.0783	1.0384
No log	6.0	312	0.9974	0.5601	0.9974	0.9987
No log	6.0385	314	0.9696	0.5517	0.9696	0.9847
No log	6.0769	316	0.9354	0.5901	0.9354	0.9671
No log	6.1154	318	0.9432	0.5838	0.9432	0.9712
No log	6.1538	320	0.9433	0.5961	0.9433	0.9712
No log	6.1923	322	0.9003	0.6335	0.9003	0.9489
No log	6.2308	324	0.8494	0.6266	0.8494	0.9216
No log	6.2692	326	0.8363	0.6473	0.8363	0.9145
No log	6.3077	328	0.8409	0.6343	0.8409	0.9170
No log	6.3462	330	0.8168	0.6389	0.8168	0.9038
No log	6.3846	332	0.7819	0.6711	0.7819	0.8843
No log	6.4231	334	0.7459	0.6956	0.7459	0.8636
No log	6.4615	336	0.7362	0.7065	0.7362	0.8580
No log	6.5	338	0.7373	0.7072	0.7373	0.8586
No log	6.5385	340	0.7368	0.7072	0.7368	0.8584
No log	6.5769	342	0.7478	0.6883	0.7478	0.8648
No log	6.6154	344	0.7501	0.6838	0.7501	0.8661
No log	6.6538	346	0.7832	0.6811	0.7832	0.8850
No log	6.6923	348	0.8095	0.6647	0.8095	0.8997
No log	6.7308	350	0.7999	0.6535	0.7999	0.8944
No log	6.7692	352	0.7769	0.6889	0.7769	0.8814
No log	6.8077	354	0.7723	0.6889	0.7723	0.8788
No log	6.8462	356	0.8042	0.6654	0.8042	0.8968
No log	6.8846	358	0.8346	0.6305	0.8346	0.9135
No log	6.9231	360	0.8714	0.6244	0.8714	0.9335
No log	6.9615	362	0.8867	0.6216	0.8867	0.9417
No log	7.0	364	0.8841	0.6298	0.8841	0.9403
No log	7.0385	366	0.8872	0.6207	0.8872	0.9419
No log	7.0769	368	0.8814	0.6207	0.8814	0.9388
No log	7.1154	370	0.8298	0.6536	0.8298	0.9109
No log	7.1538	372	0.7606	0.6875	0.7606	0.8721
No log	7.1923	374	0.7407	0.7007	0.7407	0.8607
No log	7.2308	376	0.7568	0.6875	0.7568	0.8700
No log	7.2692	378	0.8000	0.6914	0.8000	0.8945
No log	7.3077	380	0.8505	0.6441	0.8505	0.9222
No log	7.3462	382	0.8932	0.6174	0.8932	0.9451
No log	7.3846	384	0.9010	0.6263	0.9010	0.9492
No log	7.4231	386	0.9269	0.6169	0.9269	0.9628
No log	7.4615	388	0.9485	0.6142	0.9485	0.9739
No log	7.5	390	0.9424	0.6142	0.9424	0.9708
No log	7.5385	392	0.9356	0.6155	0.9356	0.9673
No log	7.5769	394	0.8833	0.6366	0.8833	0.9398
No log	7.6154	396	0.8457	0.6657	0.8457	0.9196
No log	7.6538	398	0.8338	0.6657	0.8338	0.9132
No log	7.6923	400	0.8520	0.6404	0.8520	0.9230
No log	7.7308	402	0.9026	0.6263	0.9026	0.9500
No log	7.7692	404	0.9465	0.6036	0.9465	0.9729
No log	7.8077	406	0.9526	0.6116	0.9526	0.9760
No log	7.8462	408	0.9379	0.6129	0.9379	0.9685
No log	7.8846	410	0.8845	0.6402	0.8845	0.9405
No log	7.9231	412	0.8476	0.6293	0.8476	0.9206
No log	7.9615	414	0.8475	0.6418	0.8475	0.9206
No log	8.0	416	0.8822	0.6285	0.8822	0.9393
No log	8.0385	418	0.9322	0.6143	0.9322	0.9655
No log	8.0769	420	1.0007	0.6072	1.0007	1.0003
No log	8.1154	422	1.0294	0.5900	1.0294	1.0146
No log	8.1538	424	1.0520	0.5944	1.0520	1.0257
No log	8.1923	426	1.0680	0.5844	1.0680	1.0334
No log	8.2308	428	1.0568	0.5844	1.0568	1.0280
No log	8.2692	430	1.0113	0.6183	1.0113	1.0056
No log	8.3077	432	0.9795	0.6179	0.9795	0.9897
No log	8.3462	434	0.9775	0.6085	0.9775	0.9887
No log	8.3846	436	0.9666	0.6085	0.9666	0.9832
No log	8.4231	438	0.9413	0.6275	0.9413	0.9702
No log	8.4615	440	0.9340	0.6320	0.9340	0.9664
No log	8.5	442	0.9357	0.6129	0.9357	0.9673
No log	8.5385	444	0.9162	0.6269	0.9162	0.9572
No log	8.5769	446	0.8908	0.6261	0.8908	0.9438
No log	8.6154	448	0.8864	0.6298	0.8864	0.9415
No log	8.6538	450	0.8795	0.6298	0.8795	0.9378
No log	8.6923	452	0.8643	0.6261	0.8643	0.9297
No log	8.7308	454	0.8645	0.6532	0.8645	0.9298
No log	8.7692	456	0.8763	0.6507	0.8763	0.9361
No log	8.8077	458	0.8898	0.6269	0.8898	0.9433
No log	8.8462	460	0.9062	0.6080	0.9062	0.9519
No log	8.8846	462	0.9149	0.6036	0.9149	0.9565
No log	8.9231	464	0.8998	0.6174	0.8998	0.9486
No log	8.9615	466	0.8769	0.6564	0.8769	0.9364
No log	9.0	468	0.8570	0.6706	0.8570	0.9257
No log	9.0385	470	0.8357	0.6632	0.8357	0.9141
No log	9.0769	472	0.8245	0.6568	0.8245	0.9080
No log	9.1154	474	0.8164	0.6702	0.8164	0.9035
No log	9.1538	476	0.8170	0.6720	0.8170	0.9039
No log	9.1923	478	0.8220	0.6622	0.8220	0.9067
No log	9.2308	480	0.8297	0.6706	0.8297	0.9109
No log	9.2692	482	0.8390	0.6706	0.8390	0.9160
No log	9.3077	484	0.8490	0.6706	0.8490	0.9214
No log	9.3462	486	0.8475	0.6662	0.8475	0.9206
No log	9.3846	488	0.8381	0.6706	0.8381	0.9155
No log	9.4231	490	0.8260	0.6760	0.8260	0.9088
No log	9.4615	492	0.8198	0.6797	0.8198	0.9054
No log	9.5	494	0.8163	0.6797	0.8163	0.9035
No log	9.5385	496	0.8159	0.6797	0.8159	0.9033
No log	9.5769	498	0.8169	0.6797	0.8169	0.9038
0.4541	9.6154	500	0.8178	0.6797	0.8178	0.9043
0.4541	9.6538	502	0.8145	0.6797	0.8145	0.9025
0.4541	9.6923	504	0.8154	0.6797	0.8154	0.9030
0.4541	9.7308	506	0.8164	0.6797	0.8164	0.9036
0.4541	9.7692	508	0.8181	0.6862	0.8181	0.9045
0.4541	9.8077	510	0.8184	0.6862	0.8184	0.9047
0.4541	9.8462	512	0.8180	0.6862	0.8180	0.9044
0.4541	9.8846	514	0.8172	0.6862	0.8172	0.9040
0.4541	9.9231	516	0.8162	0.6862	0.8162	0.9034
0.4541	9.9615	518	0.8151	0.6797	0.8151	0.9028
0.4541	10.0	520	0.8150	0.6797	0.8150	0.9028

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 8, 2024
Updated: Dec 8, 2024