Arabic_FineTuningAraBERT_run3_AugV5_k5_task1_organization_fold1

MayBashendy/Arabic_FineTuningAraBERT_run3_AugV5_k5_task1_organization_fold1

Arabic_FineTuningAraBERT_run3_AugV5_k5_task1_organization_fold1 is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

32% of all-time downloads

All-time downloads

Public

Parameters

135M

1.1 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Nov 28, 2024
Updated: Nov 28, 2024
SHA: acc626a3

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

Arabic_FineTuningAraBERT_run3_AugV5_k5_task1_organization_fold1

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.4469
Qwk: 0.8146
Mse: 0.4469
Rmse: 0.6685

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0328	2	5.0810	0.0302	5.0810	2.2541
No log	0.0656	4	3.1878	0.0229	3.1878	1.7854
No log	0.0984	6	1.9953	0.1003	1.9953	1.4126
No log	0.1311	8	1.6411	0.1119	1.6411	1.2810
No log	0.1639	10	1.2633	0.0	1.2633	1.1239
No log	0.1967	12	1.0003	0.0990	1.0003	1.0002
No log	0.2295	14	0.9322	0.2391	0.9322	0.9655
No log	0.2623	16	1.0112	0.1206	1.0112	1.0056
No log	0.2951	18	1.0349	0.1910	1.0349	1.0173
No log	0.3279	20	1.0365	0.1206	1.0365	1.0181
No log	0.3607	22	1.3993	0.0841	1.3993	1.1829
No log	0.3934	24	1.6377	0.0	1.6377	1.2797
No log	0.4262	26	1.4308	0.0841	1.4308	1.1962
No log	0.4590	28	1.1048	0.1923	1.1048	1.0511
No log	0.4918	30	0.9058	0.1878	0.9058	0.9517
No log	0.5246	32	0.8751	0.24	0.8751	0.9355
No log	0.5574	34	0.8734	0.2135	0.8734	0.9346
No log	0.5902	36	0.8573	0.2652	0.8573	0.9259
No log	0.6230	38	0.9009	0.2391	0.9009	0.9492
No log	0.6557	40	0.9160	0.2888	0.9160	0.9571
No log	0.6885	42	0.8703	0.3571	0.8703	0.9329
No log	0.7213	44	0.7863	0.3834	0.7863	0.8867
No log	0.7541	46	0.6739	0.4385	0.6739	0.8209
No log	0.7869	48	0.6204	0.3708	0.6204	0.7876
No log	0.8197	50	0.6468	0.3708	0.6468	0.8042
No log	0.8525	52	0.8205	0.4262	0.8205	0.9058
No log	0.8852	54	1.1985	0.4548	1.1985	1.0948
No log	0.9180	56	1.0010	0.4542	1.0010	1.0005
No log	0.9508	58	1.1771	0.1009	1.1771	1.0850
No log	0.9836	60	1.7420	-0.1836	1.7420	1.3198
No log	1.0164	62	1.3812	-0.0606	1.3812	1.1753
No log	1.0492	64	1.2126	-0.0100	1.2126	1.1012
No log	1.0820	66	1.4663	-0.0796	1.4663	1.2109
No log	1.1148	68	1.3628	-0.0606	1.3628	1.1674
No log	1.1475	70	1.4072	-0.0606	1.4072	1.1862
No log	1.1803	72	1.6468	-0.1493	1.6468	1.2833
No log	1.2131	74	2.0094	-0.2986	2.0094	1.4175
No log	1.2459	76	2.1933	-0.3142	2.1933	1.4810
No log	1.2787	78	1.8675	-0.3260	1.8675	1.3666
No log	1.3115	80	1.0954	0.0	1.0954	1.0466
No log	1.3443	82	0.7628	0.3152	0.7628	0.8734
No log	1.3770	84	0.6049	0.4105	0.6049	0.7777
No log	1.4098	86	0.6593	0.4105	0.6593	0.8120
No log	1.4426	88	0.7487	0.4815	0.7487	0.8653
No log	1.4754	90	0.7367	0.4815	0.7367	0.8583
No log	1.5082	92	0.6784	0.5070	0.6784	0.8237
No log	1.5410	94	0.5133	0.5664	0.5133	0.7165
No log	1.5738	96	0.6024	0.5	0.6024	0.7761
No log	1.6066	98	0.9022	0.3207	0.9022	0.9498
No log	1.6393	100	0.9040	0.3226	0.9040	0.9508
No log	1.6721	102	0.6639	0.4878	0.6639	0.8148
No log	1.7049	104	0.5217	0.6617	0.5217	0.7223
No log	1.7377	106	0.4464	0.776	0.4464	0.6681
No log	1.7705	108	0.4214	0.7544	0.4214	0.6491
No log	1.8033	110	0.4596	0.7296	0.4596	0.6779
No log	1.8361	112	0.5265	0.6255	0.5265	0.7256
No log	1.8689	114	0.4918	0.6516	0.4918	0.7013
No log	1.9016	116	0.4345	0.7225	0.4345	0.6592
No log	1.9344	118	0.3835	0.7364	0.3835	0.6193
No log	1.9672	120	0.3737	0.7273	0.3737	0.6113
No log	2.0	122	0.3837	0.7544	0.3837	0.6194
No log	2.0328	124	0.5231	0.6316	0.5231	0.7233
No log	2.0656	126	0.6703	0.5882	0.6703	0.8187
No log	2.0984	128	0.6078	0.6290	0.6078	0.7796
No log	2.1311	130	0.3892	0.7686	0.3892	0.6239
No log	2.1639	132	0.4550	0.6500	0.4550	0.6745
No log	2.1967	134	0.6316	0.6715	0.6316	0.7947
No log	2.2295	136	0.9381	0.5513	0.9381	0.9685
No log	2.2623	138	0.9136	0.5778	0.9136	0.9558
No log	2.2951	140	0.7013	0.5270	0.7013	0.8374
No log	2.3279	142	0.6110	0.72	0.6110	0.7817
No log	2.3607	144	0.5893	0.72	0.5893	0.7676
No log	2.3934	146	0.5658	0.7123	0.5658	0.7522
No log	2.4262	148	0.5452	0.6784	0.5452	0.7384
No log	2.4590	150	0.5254	0.6784	0.5254	0.7249
No log	2.4918	152	0.5298	0.6231	0.5298	0.7279
No log	2.5246	154	0.6542	0.5821	0.6542	0.8088
No log	2.5574	156	0.7140	0.5735	0.7140	0.8450
No log	2.5902	158	0.5780	0.5821	0.5780	0.7603
No log	2.6230	160	0.5288	0.6000	0.5288	0.7272
No log	2.6557	162	0.4980	0.6784	0.4980	0.7057
No log	2.6885	164	0.5337	0.72	0.5337	0.7305
No log	2.7213	166	0.5829	0.6708	0.5829	0.7635
No log	2.7541	168	0.6992	0.5778	0.6992	0.8362
No log	2.7869	170	0.8990	0.5449	0.8990	0.9482
No log	2.8197	172	0.8567	0.5449	0.8567	0.9256
No log	2.8525	174	0.5452	0.6416	0.5452	0.7384
No log	2.8852	176	0.4124	0.8133	0.4124	0.6422
No log	2.9180	178	0.3757	0.8304	0.3757	0.6130
No log	2.9508	180	0.3782	0.8304	0.3782	0.6150
No log	2.9836	182	0.3786	0.7941	0.3786	0.6153
No log	3.0164	184	0.3865	0.7586	0.3865	0.6217
No log	3.0492	186	0.3868	0.7586	0.3868	0.6220
No log	3.0820	188	0.3963	0.7586	0.3963	0.6295
No log	3.1148	190	0.4079	0.6936	0.4079	0.6387
No log	3.1475	192	0.4011	0.7552	0.4011	0.6333
No log	3.1803	194	0.3896	0.8178	0.3896	0.6242
No log	3.2131	196	0.3231	0.776	0.3231	0.5684
No log	3.2459	198	0.3286	0.8205	0.3286	0.5732
No log	3.2787	200	0.3954	0.8165	0.3954	0.6288
No log	3.3115	202	0.5469	0.7325	0.5469	0.7395
No log	3.3443	204	0.6460	0.7091	0.6460	0.8037
No log	3.3770	206	0.6979	0.6100	0.6979	0.8354
No log	3.4098	208	0.6497	0.6708	0.6497	0.8060
No log	3.4426	210	0.5719	0.6818	0.5719	0.7562
No log	3.4754	212	0.5745	0.7016	0.5745	0.7579
No log	3.5082	214	0.5073	0.7016	0.5073	0.7123
No log	3.5410	216	0.4148	0.7586	0.4148	0.6440
No log	3.5738	218	0.4050	0.7586	0.4050	0.6364
No log	3.6066	220	0.3949	0.7586	0.3949	0.6284
No log	3.6393	222	0.3899	0.7586	0.3899	0.6244
No log	3.6721	224	0.3964	0.7586	0.3964	0.6296
No log	3.7049	226	0.4356	0.7426	0.4356	0.6600
No log	3.7377	228	0.5234	0.7	0.5234	0.7235
No log	3.7705	230	0.5833	0.6957	0.5833	0.7637
No log	3.8033	232	0.5059	0.7	0.5059	0.7113
No log	3.8361	234	0.3645	0.7426	0.3645	0.6038
No log	3.8689	236	0.3147	0.7586	0.3147	0.5610
No log	3.9016	238	0.3089	0.72	0.3089	0.5558
No log	3.9344	240	0.3124	0.72	0.3124	0.5589
No log	3.9672	242	0.3554	0.7658	0.3554	0.5962
No log	4.0	244	0.4562	0.7388	0.4562	0.6754
No log	4.0328	246	0.5405	0.6260	0.5405	0.7352
No log	4.0656	248	0.4775	0.6260	0.4775	0.6910
No log	4.0984	250	0.3597	0.7225	0.3597	0.5997
No log	4.1311	252	0.3304	0.7449	0.3304	0.5748
No log	4.1639	254	0.3620	0.7705	0.3620	0.6017
No log	4.1967	256	0.4715	0.6375	0.4715	0.6867
No log	4.2295	258	0.6716	0.5641	0.6716	0.8195
No log	4.2623	260	0.7374	0.5641	0.7374	0.8587
No log	4.2951	262	0.6639	0.5641	0.6639	0.8148
No log	4.3279	264	0.4736	0.7549	0.4736	0.6882
No log	4.3607	266	0.3833	0.7895	0.3833	0.6191
No log	4.3934	268	0.3238	0.7658	0.3238	0.5690
No log	4.4262	270	0.2994	0.7449	0.2994	0.5472
No log	4.4590	272	0.3325	0.7658	0.3325	0.5767
No log	4.4918	274	0.4463	0.7	0.4463	0.6681
No log	4.5246	276	0.6034	0.7407	0.6034	0.7768
No log	4.5574	278	0.6970	0.7048	0.6970	0.8349
No log	4.5902	280	0.6450	0.7048	0.6450	0.8031
No log	4.6230	282	0.4744	0.7342	0.4744	0.6887
No log	4.6557	284	0.3946	0.7426	0.3946	0.6282
No log	4.6885	286	0.3637	0.7426	0.3637	0.6031
No log	4.7213	288	0.3890	0.7426	0.3890	0.6237
No log	4.7541	290	0.4494	0.6818	0.4494	0.6704
No log	4.7869	292	0.4355	0.72	0.4355	0.6599
No log	4.8197	294	0.4237	0.72	0.4237	0.6510
No log	4.8525	296	0.4243	0.72	0.4243	0.6514
No log	4.8852	298	0.4171	0.72	0.4171	0.6458
No log	4.9180	300	0.3761	0.7482	0.3761	0.6133
No log	4.9508	302	0.3710	0.7948	0.3710	0.6091
No log	4.9836	304	0.4286	0.7893	0.4286	0.6547
No log	5.0164	306	0.4592	0.7742	0.4592	0.6777
No log	5.0492	308	0.4254	0.7948	0.4254	0.6522
No log	5.0820	310	0.4606	0.72	0.4606	0.6787
No log	5.1148	312	0.5778	0.7354	0.5778	0.7601
No log	5.1475	314	0.7047	0.6124	0.7047	0.8394
No log	5.1803	316	0.7374	0.6124	0.7374	0.8587
No log	5.2131	318	0.6365	0.6124	0.6365	0.7978
No log	5.2459	320	0.4672	0.7354	0.4672	0.6835
No log	5.2787	322	0.3782	0.7423	0.3782	0.6150
No log	5.3115	324	0.3406	0.7556	0.3406	0.5836
No log	5.3443	326	0.3085	0.7651	0.3085	0.5554
No log	5.3770	328	0.2860	0.7510	0.2860	0.5348
No log	5.4098	330	0.2917	0.7774	0.2917	0.5401
No log	5.4426	332	0.4092	0.7726	0.4092	0.6397
No log	5.4754	334	0.5475	0.6566	0.5475	0.7399
No log	5.5082	336	0.5711	0.6260	0.5711	0.7557
No log	5.5410	338	0.5059	0.7388	0.5059	0.7112
No log	5.5738	340	0.4369	0.7846	0.4369	0.6610
No log	5.6066	342	0.3826	0.8000	0.3826	0.6186
No log	5.6393	344	0.3781	0.7774	0.3781	0.6149
No log	5.6721	346	0.4180	0.7727	0.4180	0.6465
No log	5.7049	348	0.5167	0.7217	0.5167	0.7188
No log	5.7377	350	0.6138	0.7217	0.6138	0.7834
No log	5.7705	352	0.7142	0.6124	0.7142	0.8451
No log	5.8033	354	0.7144	0.6124	0.7144	0.8452
No log	5.8361	356	0.6620	0.6866	0.6620	0.8136
No log	5.8689	358	0.5811	0.7425	0.5811	0.7623
No log	5.9016	360	0.4468	0.7569	0.4468	0.6685
No log	5.9344	362	0.3550	0.7407	0.3550	0.5958
No log	5.9672	364	0.3368	0.7407	0.3368	0.5803
No log	6.0	366	0.3586	0.7407	0.3586	0.5988
No log	6.0328	368	0.4162	0.7220	0.4162	0.6451
No log	6.0656	370	0.4749	0.7635	0.4749	0.6891
No log	6.0984	372	0.5063	0.7635	0.5063	0.7115
No log	6.1311	374	0.4939	0.7572	0.4939	0.7028
No log	6.1639	376	0.4934	0.7705	0.4934	0.7024
No log	6.1967	378	0.4895	0.7673	0.4895	0.6996
No log	6.2295	380	0.4427	0.7437	0.4427	0.6654
No log	6.2623	382	0.4291	0.7455	0.4291	0.6550
No log	6.2951	384	0.3872	0.7921	0.3872	0.6223
No log	6.3279	386	0.3499	0.7921	0.3499	0.5915
No log	6.3607	388	0.3468	0.7552	0.3468	0.5889
No log	6.3934	390	0.3516	0.7407	0.3516	0.5930
No log	6.4262	392	0.3892	0.7934	0.3892	0.6239
No log	6.4590	394	0.4011	0.7934	0.4011	0.6333
No log	6.4918	396	0.3903	0.7934	0.3903	0.6248
No log	6.5246	398	0.4054	0.7934	0.4054	0.6367
No log	6.5574	400	0.3897	0.7934	0.3897	0.6243
No log	6.5902	402	0.3092	0.7426	0.3092	0.5561
No log	6.6230	404	0.2498	0.7586	0.2498	0.4998
No log	6.6557	406	0.2409	0.776	0.2409	0.4908
No log	6.6885	408	0.2465	0.776	0.2465	0.4965
No log	6.7213	410	0.2923	0.7426	0.2923	0.5406
No log	6.7541	412	0.4107	0.7934	0.4107	0.6408
No log	6.7869	414	0.5582	0.7929	0.5582	0.7471
No log	6.8197	416	0.6774	0.6706	0.6774	0.8231
No log	6.8525	418	0.6809	0.6667	0.6809	0.8252
No log	6.8852	420	0.6133	0.7237	0.6133	0.7832
No log	6.9180	422	0.5125	0.7987	0.5125	0.7159
No log	6.9508	424	0.4144	0.7934	0.4144	0.6438
No log	6.9836	426	0.3694	0.7407	0.3694	0.6078
No log	7.0164	428	0.3585	0.7426	0.3585	0.5988
No log	7.0492	430	0.3626	0.7426	0.3626	0.6022
No log	7.0820	432	0.4127	0.8000	0.4127	0.6424
No log	7.1148	434	0.5083	0.8056	0.5083	0.7130
No log	7.1475	436	0.5742	0.7425	0.5742	0.7578
No log	7.1803	438	0.5578	0.7425	0.5578	0.7468
No log	7.2131	440	0.5143	0.7407	0.5143	0.7171
No log	7.2459	442	0.4704	0.8146	0.4704	0.6859
No log	7.2787	444	0.4100	0.7934	0.4100	0.6403
No log	7.3115	446	0.3402	0.7426	0.3402	0.5833
No log	7.3443	448	0.2937	0.7586	0.2937	0.5420
No log	7.3770	450	0.2781	0.7986	0.2781	0.5273
No log	7.4098	452	0.2965	0.7586	0.2965	0.5445
No log	7.4426	454	0.3606	0.7934	0.3606	0.6005
No log	7.4754	456	0.4481	0.8146	0.4481	0.6694
No log	7.5082	458	0.5787	0.7407	0.5787	0.7607
No log	7.5410	460	0.6576	0.7048	0.6576	0.8109
No log	7.5738	462	0.6688	0.7048	0.6688	0.8178
No log	7.6066	464	0.6383	0.7048	0.6383	0.7989
No log	7.6393	466	0.5866	0.7284	0.5866	0.7659
No log	7.6721	468	0.5370	0.7987	0.5370	0.7328
No log	7.7049	470	0.4511	0.8146	0.4511	0.6717
No log	7.7377	472	0.3774	0.7727	0.3774	0.6143
No log	7.7705	474	0.3529	0.7552	0.3529	0.5940
No log	7.8033	476	0.3518	0.7407	0.3518	0.5932
No log	7.8361	478	0.3576	0.7407	0.3576	0.5980
No log	7.8689	480	0.3938	0.7934	0.3938	0.6276
No log	7.9016	482	0.4470	0.8146	0.4470	0.6686
No log	7.9344	484	0.4973	0.7893	0.4973	0.7052
No log	7.9672	486	0.5130	0.7893	0.5130	0.7163
No log	8.0	488	0.4864	0.8146	0.4864	0.6974
No log	8.0328	490	0.4525	0.8146	0.4525	0.6727
No log	8.0656	492	0.4102	0.7934	0.4102	0.6405
No log	8.0984	494	0.3757	0.7619	0.3757	0.6129
No log	8.1311	496	0.3555	0.7407	0.3555	0.5962
No log	8.1639	498	0.3490	0.7921	0.3490	0.5907
0.442	8.1967	500	0.3534	0.7921	0.3534	0.5945
0.442	8.2295	502	0.3672	0.7407	0.3672	0.6060
0.442	8.2623	504	0.3833	0.7619	0.3833	0.6191
0.442	8.2951	506	0.4084	0.7619	0.4084	0.6391
0.442	8.3279	508	0.4499	0.7934	0.4499	0.6707
0.442	8.3607	510	0.5276	0.7987	0.5276	0.7264
0.442	8.3934	512	0.5877	0.7407	0.5877	0.7666
0.442	8.4262	514	0.6345	0.7284	0.6345	0.7966
0.442	8.4590	516	0.6361	0.7284	0.6361	0.7975
0.442	8.4918	518	0.6021	0.7407	0.6021	0.7760
0.442	8.5246	520	0.5684	0.7987	0.5684	0.7539
0.442	8.5574	522	0.5012	0.8146	0.5012	0.7080
0.442	8.5902	524	0.4395	0.7934	0.4395	0.6629
0.442	8.6230	526	0.4113	0.7934	0.4113	0.6413
0.442	8.6557	528	0.3951	0.7934	0.3951	0.6286
0.442	8.6885	530	0.3894	0.7934	0.3894	0.6240
0.442	8.7213	532	0.3909	0.7934	0.3909	0.6252
0.442	8.7541	534	0.4018	0.7934	0.4018	0.6339
0.442	8.7869	536	0.4275	0.7934	0.4275	0.6538
0.442	8.8197	538	0.4507	0.8146	0.4507	0.6713
0.442	8.8525	540	0.4585	0.8146	0.4585	0.6772
0.442	8.8852	542	0.4602	0.8146	0.4602	0.6784
0.442	8.9180	544	0.4603	0.8146	0.4603	0.6784
0.442	8.9508	546	0.4605	0.8146	0.4605	0.6786
0.442	8.9836	548	0.4632	0.8146	0.4632	0.6806
0.442	9.0164	550	0.4677	0.8146	0.4677	0.6839
0.442	9.0492	552	0.4690	0.8146	0.4690	0.6848
0.442	9.0820	554	0.4799	0.8146	0.4799	0.6927
0.442	9.1148	556	0.4869	0.8146	0.4869	0.6978
0.442	9.1475	558	0.4800	0.8146	0.4800	0.6928
0.442	9.1803	560	0.4752	0.8146	0.4752	0.6893
0.442	9.2131	562	0.4776	0.8146	0.4776	0.6911
0.442	9.2459	564	0.4685	0.8146	0.4685	0.6845
0.442	9.2787	566	0.4649	0.8146	0.4649	0.6818
0.442	9.3115	568	0.4617	0.8146	0.4617	0.6795
0.442	9.3443	570	0.4533	0.7934	0.4533	0.6733
0.442	9.3770	572	0.4517	0.7934	0.4517	0.6721
0.442	9.4098	574	0.4513	0.7934	0.4513	0.6718
0.442	9.4426	576	0.4535	0.7934	0.4535	0.6734
0.442	9.4754	578	0.4487	0.7934	0.4487	0.6698
0.442	9.5082	580	0.4449	0.7934	0.4449	0.6670
0.442	9.5410	582	0.4436	0.7934	0.4436	0.6661
0.442	9.5738	584	0.4426	0.7934	0.4426	0.6653
0.442	9.6066	586	0.4434	0.7934	0.4434	0.6659
0.442	9.6393	588	0.4447	0.7934	0.4447	0.6668
0.442	9.6721	590	0.4422	0.7934	0.4422	0.6650
0.442	9.7049	592	0.4434	0.7934	0.4434	0.6659
0.442	9.7377	594	0.4479	0.8146	0.4479	0.6693
0.442	9.7705	596	0.4483	0.8146	0.4483	0.6696
0.442	9.8033	598	0.4472	0.8146	0.4472	0.6687
0.442	9.8361	600	0.4466	0.8146	0.4466	0.6682
0.442	9.8689	602	0.4456	0.8146	0.4456	0.6675
0.442	9.9016	604	0.4454	0.8146	0.4454	0.6674
0.442	9.9344	606	0.4465	0.8146	0.4465	0.6682
0.442	9.9672	608	0.4468	0.8146	0.4468	0.6684
0.442	10.0	610	0.4469	0.8146	0.4469	0.6685

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Nov 28, 2024
Updated: Nov 28, 2024