ArabicNewSplits_FineTuningAraBERT_AugV5_k10_task1_organization_fold1

MayBashendy/ArabicNewSplits_FineTuningAraBERT_AugV5_k10_task1_organization_fold1

ArabicNewSplits_FineTuningAraBERT_AugV5_k10_task1_organization_fold1 is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

23% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Nov 26, 2024
Updated: Nov 26, 2024
SHA: ed4b0f20

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits_FineTuningAraBERT_AugV5_k10_task1_organization_fold1

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 1.1991
Qwk: 0.4965
Mse: 1.1991
Rmse: 1.0950

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0426	2	4.1922	-0.0773	4.1922	2.0475
No log	0.0851	4	2.6209	-0.0122	2.6209	1.6189
No log	0.1277	6	1.6099	0.1102	1.6099	1.2688
No log	0.1702	8	1.2158	0.0336	1.2158	1.1026
No log	0.2128	10	1.0512	0.2523	1.0512	1.0253
No log	0.2553	12	1.0559	0.2756	1.0559	1.0276
No log	0.2979	14	1.0540	0.2473	1.0540	1.0266
No log	0.3404	16	1.0621	0.2446	1.0621	1.0306
No log	0.3830	18	1.1991	0.0757	1.1991	1.0950
No log	0.4255	20	1.3386	0.0336	1.3386	1.1570
No log	0.4681	22	1.3737	0.0	1.3737	1.1721
No log	0.5106	24	1.3343	0.0	1.3343	1.1551
No log	0.5532	26	1.1758	0.0379	1.1758	1.0844
No log	0.5957	28	1.0688	0.2705	1.0688	1.0338
No log	0.6383	30	1.0642	0.2780	1.0642	1.0316
No log	0.6809	32	1.0513	0.2429	1.0513	1.0253
No log	0.7234	34	1.0429	0.2578	1.0429	1.0212
No log	0.7660	36	1.1709	0.1133	1.1709	1.0821
No log	0.8085	38	1.5149	-0.0068	1.5149	1.2308
No log	0.8511	40	1.6144	0.0540	1.6144	1.2706
No log	0.8936	42	1.4889	-0.0165	1.4889	1.2202
No log	0.9362	44	1.2576	0.0	1.2576	1.1214
No log	0.9787	46	1.1644	0.0654	1.1644	1.0791
No log	1.0213	48	1.0704	0.1970	1.0704	1.0346
No log	1.0638	50	1.0211	0.3192	1.0211	1.0105
No log	1.1064	52	1.0205	0.2806	1.0205	1.0102
No log	1.1489	54	1.0236	0.2730	1.0236	1.0118
No log	1.1915	56	1.0205	0.2730	1.0205	1.0102
No log	1.2340	58	1.0385	0.3653	1.0385	1.0191
No log	1.2766	60	1.1444	0.2469	1.1444	1.0698
No log	1.3191	62	1.2587	0.1062	1.2587	1.1219
No log	1.3617	64	1.4009	0.0840	1.4009	1.1836
No log	1.4043	66	1.5309	0.0690	1.5309	1.2373
No log	1.4468	68	1.4599	0.0757	1.4599	1.2083
No log	1.4894	70	1.3547	0.0757	1.3547	1.1639
No log	1.5319	72	1.1486	0.1229	1.1486	1.0717
No log	1.5745	74	0.9721	0.3399	0.9721	0.9860
No log	1.6170	76	0.9094	0.2755	0.9094	0.9536
No log	1.6596	78	0.9034	0.3581	0.9034	0.9505
No log	1.7021	80	0.8940	0.3683	0.8940	0.9455
No log	1.7447	82	0.9084	0.4217	0.9084	0.9531
No log	1.7872	84	0.9514	0.3559	0.9514	0.9754
No log	1.8298	86	0.9756	0.3683	0.9756	0.9877
No log	1.8723	88	1.0462	0.2902	1.0462	1.0229
No log	1.9149	90	1.1745	0.2452	1.1745	1.0838
No log	1.9574	92	1.1859	0.1517	1.1859	1.0890
No log	2.0	94	1.1417	0.2493	1.1417	1.0685
No log	2.0426	96	1.0598	0.2469	1.0598	1.0295
No log	2.0851	98	0.9893	0.2815	0.9893	0.9947
No log	2.1277	100	0.9691	0.3255	0.9691	0.9844
No log	2.1702	102	0.9837	0.3159	0.9837	0.9918
No log	2.2128	104	1.0251	0.2241	1.0251	1.0125
No log	2.2553	106	1.0966	0.3046	1.0966	1.0472
No log	2.2979	108	1.1841	0.3233	1.1841	1.0882
No log	2.3404	110	1.1291	0.4211	1.1291	1.0626
No log	2.3830	112	1.1909	0.3388	1.1909	1.0913
No log	2.4255	114	1.2907	0.3843	1.2907	1.1361
No log	2.4681	116	1.3819	0.3554	1.3819	1.1755
No log	2.5106	118	1.4458	0.3115	1.4458	1.2024
No log	2.5532	120	1.3916	0.3421	1.3916	1.1797
No log	2.5957	122	1.1706	0.4690	1.1706	1.0819
No log	2.6383	124	1.1565	0.4784	1.1565	1.0754
No log	2.6809	126	1.1196	0.5	1.1196	1.0581
No log	2.7234	128	1.0385	0.5475	1.0385	1.0191
No log	2.7660	130	1.0025	0.5041	1.0025	1.0012
No log	2.8085	132	1.0182	0.4876	1.0182	1.0091
No log	2.8511	134	1.0848	0.5224	1.0848	1.0416
No log	2.8936	136	1.2173	0.4417	1.2173	1.1033
No log	2.9362	138	1.2978	0.3735	1.2978	1.1392
No log	2.9787	140	1.4175	0.2958	1.4175	1.1906
No log	3.0213	142	1.5658	0.2631	1.5658	1.2513
No log	3.0638	144	1.5055	0.2631	1.5055	1.2270
No log	3.1064	146	1.2764	0.3739	1.2764	1.1298
No log	3.1489	148	1.0655	0.4902	1.0655	1.0322
No log	3.1915	150	0.9096	0.4960	0.9096	0.9537
No log	3.2340	152	0.8454	0.5364	0.8454	0.9194
No log	3.2766	154	0.8313	0.5267	0.8313	0.9118
No log	3.3191	156	0.8858	0.5467	0.8858	0.9412
No log	3.3617	158	1.1268	0.4933	1.1268	1.0615
No log	3.4043	160	1.2228	0.4746	1.2228	1.1058
No log	3.4468	162	1.3432	0.4392	1.3432	1.1589
No log	3.4894	164	1.4118	0.4053	1.4118	1.1882
No log	3.5319	166	1.3509	0.4172	1.3509	1.1623
No log	3.5745	168	1.4445	0.3607	1.4445	1.2019
No log	3.6170	170	1.6345	0.2970	1.6345	1.2785
No log	3.6596	172	1.5285	0.3319	1.5285	1.2363
No log	3.7021	174	1.2398	0.4677	1.2398	1.1134
No log	3.7447	176	0.9319	0.5578	0.9319	0.9654
No log	3.7872	178	0.8650	0.5491	0.8650	0.9301
No log	3.8298	180	0.9641	0.5574	0.9641	0.9819
No log	3.8723	182	1.1615	0.4583	1.1615	1.0777
No log	3.9149	184	1.2170	0.3684	1.2170	1.1032
No log	3.9574	186	1.1311	0.4183	1.1311	1.0635
No log	4.0	188	1.0130	0.4617	1.0130	1.0065
No log	4.0426	190	0.8848	0.5574	0.8848	0.9407
No log	4.0851	192	0.8997	0.5650	0.8997	0.9485
No log	4.1277	194	1.0497	0.4938	1.0497	1.0246
No log	4.1702	196	1.2284	0.4736	1.2284	1.1083
No log	4.2128	198	1.3561	0.3745	1.3561	1.1645
No log	4.2553	200	1.6690	0.2673	1.6690	1.2919
No log	4.2979	202	1.7938	0.2756	1.7938	1.3393
No log	4.3404	204	1.6916	0.2952	1.6916	1.3006
No log	4.3830	206	1.4893	0.3200	1.4893	1.2204
No log	4.4255	208	1.3159	0.3919	1.3159	1.1471
No log	4.4681	210	1.2539	0.4132	1.2539	1.1198
No log	4.5106	212	1.2960	0.4152	1.2960	1.1384
No log	4.5532	214	1.3272	0.3711	1.3272	1.1520
No log	4.5957	216	1.2697	0.3932	1.2697	1.1268
No log	4.6383	218	1.1376	0.4556	1.1376	1.0666
No log	4.6809	220	1.0785	0.4780	1.0785	1.0385
No log	4.7234	222	1.0116	0.5167	1.0116	1.0058
No log	4.7660	224	0.9509	0.5147	0.9509	0.9751
No log	4.8085	226	0.9286	0.5143	0.9286	0.9637
No log	4.8511	228	0.9622	0.4885	0.9622	0.9809
No log	4.8936	230	1.0678	0.4945	1.0678	1.0333
No log	4.9362	232	1.0703	0.5250	1.0703	1.0346
No log	4.9787	234	1.0808	0.5334	1.0808	1.0396
No log	5.0213	236	1.0571	0.5484	1.0571	1.0282
No log	5.0638	238	0.9784	0.5322	0.9784	0.9891
No log	5.1064	240	1.0327	0.5484	1.0327	1.0162
No log	5.1489	242	1.2418	0.4540	1.2418	1.1144
No log	5.1915	244	1.3600	0.3656	1.3600	1.1662
No log	5.2340	246	1.2671	0.3485	1.2671	1.1256
No log	5.2766	248	1.2806	0.3485	1.2806	1.1316
No log	5.3191	250	1.3525	0.3656	1.3525	1.1630
No log	5.3617	252	1.4405	0.3682	1.4405	1.2002
No log	5.4043	254	1.4106	0.3682	1.4106	1.1877
No log	5.4468	256	1.2158	0.4608	1.2158	1.1026
No log	5.4894	258	1.0663	0.5334	1.0663	1.0326
No log	5.5319	260	0.9877	0.5321	0.9877	0.9938
No log	5.5745	262	0.9742	0.5321	0.9742	0.9870
No log	5.6170	264	0.9722	0.5322	0.9722	0.9860
No log	5.6596	266	1.0124	0.5322	1.0124	1.0062
No log	5.7021	268	0.9686	0.5322	0.9686	0.9842
No log	5.7447	270	0.9404	0.5321	0.9404	0.9697
No log	5.7872	272	0.9104	0.5645	0.9104	0.9542
No log	5.8298	274	0.8880	0.5544	0.8880	0.9423
No log	5.8723	276	0.9335	0.5645	0.9335	0.9662
No log	5.9149	278	1.0472	0.5161	1.0472	1.0233
No log	5.9574	280	1.1369	0.5174	1.1369	1.0662
No log	6.0	282	1.1381	0.5108	1.1381	1.0668
No log	6.0426	284	1.1343	0.5407	1.1343	1.0651
No log	6.0851	286	1.0135	0.5322	1.0135	1.0067
No log	6.1277	288	0.9111	0.5570	0.9111	0.9545
No log	6.1702	290	0.9093	0.5566	0.9093	0.9536
No log	6.2128	292	0.9733	0.5322	0.9733	0.9866
No log	6.2553	294	1.0418	0.5484	1.0418	1.0207
No log	6.2979	296	1.0959	0.5324	1.0959	1.0469
No log	6.3404	298	1.0890	0.5324	1.0890	1.0435
No log	6.3830	300	1.0467	0.5324	1.0467	1.0231
No log	6.4255	302	1.0086	0.5323	1.0086	1.0043
No log	6.4681	304	1.0592	0.5324	1.0592	1.0292
No log	6.5106	306	1.0881	0.5405	1.0881	1.0431
No log	6.5532	308	1.1374	0.5185	1.1374	1.0665
No log	6.5957	310	1.1481	0.5040	1.1481	1.0715
No log	6.6383	312	1.1717	0.5040	1.1717	1.0825
No log	6.6809	314	1.2057	0.5119	1.2057	1.0981
No log	6.7234	316	1.2362	0.5119	1.2362	1.1119
No log	6.7660	318	1.1894	0.5119	1.1894	1.0906
No log	6.8085	320	1.1443	0.5182	1.1443	1.0697
No log	6.8511	322	1.1055	0.5324	1.1055	1.0514
No log	6.8936	324	1.0965	0.5482	1.0965	1.0471
No log	6.9362	326	1.1346	0.5171	1.1346	1.0652
No log	6.9787	328	1.1815	0.5174	1.1815	1.0870
No log	7.0213	330	1.1831	0.5174	1.1831	1.0877
No log	7.0638	332	1.2019	0.5177	1.2019	1.0963
No log	7.1064	334	1.2917	0.4696	1.2917	1.1365
No log	7.1489	336	1.3594	0.4295	1.3594	1.1659
No log	7.1915	338	1.3873	0.3832	1.3873	1.1779
No log	7.2340	340	1.3447	0.4090	1.3447	1.1596
No log	7.2766	342	1.2253	0.4687	1.2253	1.1069
No log	7.3191	344	1.1007	0.5407	1.1007	1.0491
No log	7.3617	346	1.0668	0.5324	1.0668	1.0328
No log	7.4043	348	1.0947	0.5407	1.0947	1.0463
No log	7.4468	350	1.1652	0.5406	1.1652	1.0794
No log	7.4894	352	1.2193	0.4906	1.2193	1.1042
No log	7.5319	354	1.3239	0.4840	1.3239	1.1506
No log	7.5745	356	1.3652	0.4311	1.3652	1.1684
No log	7.6170	358	1.3179	0.4906	1.3179	1.1480
No log	7.6596	360	1.2769	0.4906	1.2769	1.1300
No log	7.7021	362	1.2981	0.4906	1.2981	1.1393
No log	7.7447	364	1.3261	0.4565	1.3261	1.1516
No log	7.7872	366	1.2702	0.4631	1.2702	1.1270
No log	7.8298	368	1.1595	0.5556	1.1595	1.0768
No log	7.8723	370	1.0656	0.5484	1.0656	1.0323
No log	7.9149	372	1.0281	0.5484	1.0281	1.0139
No log	7.9574	374	1.0349	0.5322	1.0349	1.0173
No log	8.0	376	1.0360	0.5322	1.0360	1.0178
No log	8.0426	378	1.0898	0.5248	1.0898	1.0440
No log	8.0851	380	1.1790	0.4827	1.1790	1.0858
No log	8.1277	382	1.2307	0.4472	1.2307	1.1094
No log	8.1702	384	1.2524	0.4275	1.2524	1.1191
No log	8.2128	386	1.2634	0.4275	1.2634	1.1240
No log	8.2553	388	1.2658	0.4486	1.2658	1.1251
No log	8.2979	390	1.2254	0.4698	1.2254	1.1070
No log	8.3404	392	1.1898	0.4687	1.1898	1.0908
No log	8.3830	394	1.2031	0.4698	1.2031	1.0969
No log	8.4255	396	1.2406	0.4565	1.2406	1.1138
No log	8.4681	398	1.3066	0.4295	1.3066	1.1430
No log	8.5106	400	1.3457	0.4090	1.3457	1.1601
No log	8.5532	402	1.3263	0.4295	1.3263	1.1516
No log	8.5957	404	1.2992	0.4295	1.2992	1.1398
No log	8.6383	406	1.2570	0.4565	1.2570	1.1212
No log	8.6809	408	1.2032	0.5267	1.2032	1.0969
No log	8.7234	410	1.1756	0.5486	1.1756	1.0842
No log	8.7660	412	1.1845	0.5266	1.1845	1.0884
No log	8.8085	414	1.1732	0.5486	1.1732	1.0831
No log	8.8511	416	1.1611	0.5556	1.1611	1.0775
No log	8.8936	418	1.1508	0.5556	1.1508	1.0727
No log	8.9362	420	1.1203	0.5556	1.1203	1.0585
No log	8.9787	422	1.1169	0.5556	1.1169	1.0569
No log	9.0213	424	1.1143	0.5556	1.1143	1.0556
No log	9.0638	426	1.0987	0.5556	1.0987	1.0482
No log	9.1064	428	1.0614	0.5407	1.0614	1.0303
No log	9.1489	430	1.0424	0.5408	1.0424	1.0210
No log	9.1915	432	1.0384	0.5570	1.0384	1.0190
No log	9.2340	434	1.0566	0.5407	1.0566	1.0279
No log	9.2766	436	1.0860	0.5556	1.0860	1.0421
No log	9.3191	438	1.1221	0.5556	1.1221	1.0593
No log	9.3617	440	1.1558	0.5556	1.1558	1.0751
No log	9.4043	442	1.1886	0.5185	1.1886	1.0902
No log	9.4468	444	1.2244	0.4823	1.2244	1.1065
No log	9.4894	446	1.2447	0.4565	1.2447	1.1157
No log	9.5319	448	1.2450	0.4565	1.2450	1.1158
No log	9.5745	450	1.2493	0.4565	1.2493	1.1177
No log	9.6170	452	1.2487	0.4565	1.2487	1.1175
No log	9.6596	454	1.2375	0.4687	1.2375	1.1124
No log	9.7021	456	1.2250	0.4827	1.2250	1.1068
No log	9.7447	458	1.2133	0.4896	1.2133	1.1015
No log	9.7872	460	1.2057	0.4896	1.2057	1.0980
No log	9.8298	462	1.2006	0.4896	1.2006	1.0957
No log	9.8723	464	1.1988	0.4965	1.1988	1.0949
No log	9.9149	466	1.1979	0.4965	1.1979	1.0945
No log	9.9574	468	1.1987	0.4965	1.1987	1.0949
No log	10.0	470	1.1991	0.4965	1.1991	1.0950

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Nov 26, 2024
Updated: Nov 26, 2024