Arabic_FineTuningAraBERT_run2_AugV5_k3_task1_organization_fold1

MayBashendy/Arabic_FineTuningAraBERT_run2_AugV5_k3_task1_organization_fold1

Arabic_FineTuningAraBERT_run2_AugV5_k3_task1_organization_fold1 is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

10% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Nov 27, 2024
Updated: Nov 27, 2024
SHA: 59fc5e00

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

Arabic_FineTuningAraBERT_run2_AugV5_k3_task1_organization_fold1

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.6314
Qwk: 0.5831
Mse: 0.6314
Rmse: 0.7946

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0488	2	4.9906	-0.0600	4.9906	2.2340
No log	0.0976	4	3.2190	-0.1140	3.2190	1.7942
No log	0.1463	6	1.5529	0.0156	1.5529	1.2462
No log	0.1951	8	1.4796	0.1450	1.4796	1.2164
No log	0.2439	10	1.7567	0.1064	1.7567	1.3254
No log	0.2927	12	1.2366	0.2678	1.2366	1.1120
No log	0.3415	14	0.8241	0.1840	0.8241	0.9078
No log	0.3902	16	0.8686	0.2125	0.8686	0.9320
No log	0.4390	18	0.8253	0.2125	0.8253	0.9085
No log	0.4878	20	0.7253	0.2410	0.7253	0.8516
No log	0.5366	22	0.7241	0.2652	0.7241	0.8509
No log	0.5854	24	0.8257	0.4842	0.8257	0.9087
No log	0.6341	26	0.9106	0.4842	0.9106	0.9543
No log	0.6829	28	1.0996	0.3913	1.0996	1.0486
No log	0.7317	30	1.3895	0.0755	1.3895	1.1788
No log	0.7805	32	1.2955	0.2286	1.2955	1.1382
No log	0.8293	34	1.1580	0.1706	1.1580	1.0761
No log	0.8780	36	0.9292	0.4020	0.9292	0.9640
No log	0.9268	38	0.8034	0.3368	0.8034	0.8963
No log	0.9756	40	0.7398	0.3368	0.7398	0.8601
No log	1.0244	42	0.6992	0.3636	0.6992	0.8362
No log	1.0732	44	0.7289	0.1878	0.7289	0.8538
No log	1.1220	46	0.8274	0.3636	0.8274	0.9096
No log	1.1707	48	0.8007	0.3636	0.8007	0.8948
No log	1.2195	50	0.6409	0.3488	0.6409	0.8005
No log	1.2683	52	0.7090	0.4455	0.7090	0.8420
No log	1.3171	54	0.8627	0.2297	0.8627	0.9288
No log	1.3659	56	0.8960	0.4	0.8960	0.9466
No log	1.4146	58	0.9039	0.5914	0.9039	0.9507
No log	1.4634	60	0.8143	0.5783	0.8143	0.9024
No log	1.5122	62	0.6848	0.5024	0.6848	0.8275
No log	1.5610	64	0.6738	0.5024	0.6738	0.8208
No log	1.6098	66	0.7210	0.5882	0.7210	0.8491
No log	1.6585	68	0.8135	0.5092	0.8135	0.9019
No log	1.7073	70	0.8680	0.5092	0.8680	0.9317
No log	1.7561	72	0.8392	0.5401	0.8392	0.9161
No log	1.8049	74	0.7619	0.5911	0.7619	0.8729
No log	1.8537	76	0.6768	0.6182	0.6768	0.8227
No log	1.9024	78	0.6420	0.6067	0.6420	0.8012
No log	1.9512	80	0.6196	0.6067	0.6196	0.7872
No log	2.0	82	0.6132	0.6431	0.6132	0.7831
No log	2.0488	84	0.7140	0.5401	0.7140	0.8450
No log	2.0976	86	0.9173	0.5092	0.9173	0.9577
No log	2.1463	88	0.9889	0.4928	0.9889	0.9944
No log	2.1951	90	1.0756	0.4577	1.0756	1.0371
No log	2.2439	92	0.9381	0.4776	0.9381	0.9686
No log	2.2927	94	0.7231	0.5092	0.7231	0.8504
No log	2.3415	96	0.6273	0.5692	0.6273	0.7920
No log	2.3902	98	0.5827	0.6094	0.5827	0.7634
No log	2.4390	100	0.5588	0.5088	0.5588	0.7475
No log	2.4878	102	0.5756	0.5625	0.5756	0.7587
No log	2.5366	104	0.5996	0.6513	0.5996	0.7743
No log	2.5854	106	0.6398	0.5500	0.6398	0.7999
No log	2.6341	108	0.7793	0.5625	0.7793	0.8828
No log	2.6829	110	0.8680	0.5625	0.8680	0.9316
No log	2.7317	112	0.8976	0.5625	0.8976	0.9474
No log	2.7805	114	0.8625	0.5199	0.8625	0.9287
No log	2.8293	116	0.7771	0.5625	0.7771	0.8815
No log	2.8780	118	0.7522	0.6667	0.7522	0.8673
No log	2.9268	120	0.7499	0.6392	0.7499	0.8660
No log	2.9756	122	0.7798	0.5625	0.7798	0.8831
No log	3.0244	124	0.7741	0.5625	0.7741	0.8799
No log	3.0732	126	0.7472	0.6828	0.7472	0.8644
No log	3.1220	128	0.7390	0.5465	0.7390	0.8596
No log	3.1707	130	0.7322	0.6167	0.7322	0.8557
No log	3.2195	132	0.6655	0.5831	0.6655	0.8158
No log	3.2683	134	0.5789	0.7535	0.5789	0.7609
No log	3.3171	136	0.6254	0.6392	0.6254	0.7908
No log	3.3659	138	0.7565	0.5532	0.7565	0.8698
No log	3.4146	140	0.9026	0.5532	0.9026	0.9501
No log	3.4634	142	0.9444	0.5532	0.9444	0.9718
No log	3.5122	144	0.8858	0.5912	0.8858	0.9412
No log	3.5610	146	0.8877	0.5912	0.8877	0.9422
No log	3.6098	148	0.8621	0.6209	0.8621	0.9285
No log	3.6585	150	0.8096	0.6465	0.8096	0.8998
No log	3.7073	152	0.7648	0.6465	0.7648	0.8745
No log	3.7561	154	0.7985	0.6667	0.7985	0.8936
No log	3.8049	156	0.7676	0.6667	0.7676	0.8761
No log	3.8537	158	0.8056	0.5625	0.8056	0.8976
No log	3.9024	160	0.8735	0.5935	0.8735	0.9346
No log	3.9512	162	0.8933	0.5935	0.8933	0.9452
No log	4.0	164	0.8384	0.5935	0.8384	0.9156
No log	4.0488	166	0.7598	0.5625	0.7598	0.8717
No log	4.0976	168	0.6542	0.6190	0.6542	0.8089
No log	4.1463	170	0.5916	0.6190	0.5916	0.7692
No log	4.1951	172	0.5596	0.6784	0.5596	0.7480
No log	4.2439	174	0.5522	0.6784	0.5522	0.7431
No log	4.2927	176	0.5579	0.6316	0.5579	0.7469
No log	4.3415	178	0.5494	0.6316	0.5494	0.7412
No log	4.3902	180	0.5232	0.6431	0.5232	0.7233
No log	4.4390	182	0.4916	0.6744	0.4916	0.7011
No log	4.4878	184	0.4589	0.7758	0.4589	0.6774
No log	4.5366	186	0.4690	0.8205	0.4690	0.6849
No log	4.5854	188	0.5356	0.6423	0.5356	0.7318
No log	4.6341	190	0.5844	0.6392	0.5844	0.7645
No log	4.6829	192	0.5501	0.6423	0.5501	0.7417
No log	4.7317	194	0.4930	0.7926	0.4930	0.7021
No log	4.7805	196	0.5221	0.6617	0.5221	0.7226
No log	4.8293	198	0.6681	0.5092	0.6681	0.8174
No log	4.8780	200	0.8940	0.5461	0.8940	0.9455
No log	4.9268	202	0.9825	0.4934	0.9825	0.9912
No log	4.9756	204	0.8939	0.5461	0.8939	0.9455
No log	5.0244	206	0.7743	0.5625	0.7743	0.8799
No log	5.0732	208	0.7152	0.6426	0.7152	0.8457
No log	5.1220	210	0.6719	0.7674	0.6719	0.8197
No log	5.1707	212	0.6623	0.7674	0.6623	0.8138
No log	5.2195	214	0.6790	0.6957	0.6790	0.8240
No log	5.2683	216	0.7603	0.5270	0.7603	0.8719
No log	5.3171	218	0.8164	0.5270	0.8164	0.9035
No log	5.3659	220	0.8434	0.5270	0.8434	0.9184
No log	5.4146	222	0.8969	0.5270	0.8969	0.9470
No log	5.4634	224	0.8834	0.5270	0.8834	0.9399
No log	5.5122	226	0.8767	0.5270	0.8767	0.9363
No log	5.5610	228	0.8441	0.5751	0.8441	0.9187
No log	5.6098	230	0.8501	0.5270	0.8501	0.9220
No log	5.6585	232	0.8339	0.5270	0.8339	0.9132
No log	5.7073	234	0.7769	0.5751	0.7769	0.8814
No log	5.7561	236	0.6454	0.6800	0.6454	0.8034
No log	5.8049	238	0.5853	0.7674	0.5853	0.7650
No log	5.8537	240	0.5434	0.7712	0.5434	0.7371
No log	5.9024	242	0.5511	0.7712	0.5511	0.7424
No log	5.9512	244	0.6020	0.6800	0.6020	0.7759
No log	6.0	246	0.6932	0.6100	0.6932	0.8326
No log	6.0488	248	0.7551	0.5935	0.7551	0.8689
No log	6.0976	250	0.7345	0.6361	0.7345	0.8570
No log	6.1463	252	0.6851	0.6087	0.6851	0.8277
No log	6.1951	254	0.6678	0.6769	0.6678	0.8172
No log	6.2439	256	0.6573	0.6769	0.6573	0.8108
No log	6.2927	258	0.6655	0.6087	0.6655	0.8158
No log	6.3415	260	0.6987	0.6020	0.6987	0.8359
No log	6.3902	262	0.6886	0.5461	0.6886	0.8298
No log	6.4390	264	0.6762	0.5461	0.6762	0.8223
No log	6.4878	266	0.6347	0.5461	0.6347	0.7967
No log	6.5366	268	0.5719	0.6020	0.5719	0.7562
No log	6.5854	270	0.4952	0.7482	0.4952	0.7037
No log	6.6341	272	0.4798	0.7482	0.4798	0.6927
No log	6.6829	274	0.4828	0.7482	0.4828	0.6948
No log	6.7317	276	0.4910	0.7336	0.4910	0.7007
No log	6.7805	278	0.5334	0.7138	0.5334	0.7304
No log	6.8293	280	0.6299	0.5552	0.6299	0.7937
No log	6.8780	282	0.7024	0.5461	0.7024	0.8381
No log	6.9268	284	0.7384	0.5597	0.7384	0.8593
No log	6.9756	286	0.7396	0.5597	0.7396	0.8600
No log	7.0244	288	0.7269	0.5679	0.7269	0.8526
No log	7.0732	290	0.7233	0.6456	0.7233	0.8505
No log	7.1220	292	0.7158	0.6426	0.7158	0.8461
No log	7.1707	294	0.7279	0.6089	0.7279	0.8532
No log	7.2195	296	0.7616	0.6089	0.7616	0.8727
No log	7.2683	298	0.8177	0.5387	0.8177	0.9043
No log	7.3171	300	0.8633	0.5508	0.8633	0.9292
No log	7.3659	302	0.8659	0.5579	0.8659	0.9305
No log	7.4146	304	0.8852	0.5579	0.8852	0.9408
No log	7.4634	306	0.8538	0.5465	0.8538	0.9240
No log	7.5122	308	0.8053	0.6089	0.8053	0.8974
No log	7.5610	310	0.7522	0.6316	0.7522	0.8673
No log	7.6098	312	0.7070	0.6629	0.7070	0.8408
No log	7.6585	314	0.6532	0.7075	0.6532	0.8082
No log	7.7073	316	0.6311	0.7586	0.6311	0.7944
No log	7.7561	318	0.6442	0.6725	0.6442	0.8026
No log	7.8049	320	0.6838	0.5758	0.6838	0.8269
No log	7.8537	322	0.7442	0.5679	0.7442	0.8627
No log	7.9024	324	0.7708	0.5306	0.7708	0.8780
No log	7.9512	326	0.8020	0.5471	0.8020	0.8956
No log	8.0	328	0.8071	0.5778	0.8071	0.8984
No log	8.0488	330	0.7485	0.5778	0.7485	0.8652
No log	8.0976	332	0.6719	0.5597	0.6719	0.8197
No log	8.1463	334	0.6005	0.6392	0.6005	0.7749
No log	8.1951	336	0.5485	0.7074	0.5485	0.7406
No log	8.2439	338	0.5292	0.7074	0.5292	0.7275
No log	8.2927	340	0.5289	0.6290	0.5289	0.7273
No log	8.3415	342	0.5587	0.6392	0.5587	0.7474
No log	8.3902	344	0.5946	0.6392	0.5946	0.7711
No log	8.4390	346	0.6249	0.5828	0.6249	0.7905
No log	8.4878	348	0.6692	0.5751	0.6692	0.8180
No log	8.5366	350	0.6985	0.6111	0.6985	0.8358
No log	8.5854	352	0.7141	0.6111	0.7141	0.8451
No log	8.6341	354	0.7309	0.6030	0.7309	0.8549
No log	8.6829	356	0.7340	0.6030	0.7340	0.8567
No log	8.7317	358	0.7243	0.5758	0.7243	0.8510
No log	8.7805	360	0.6991	0.5758	0.6991	0.8361
No log	8.8293	362	0.6790	0.5758	0.6790	0.8240
No log	8.8780	364	0.6700	0.5758	0.6700	0.8186
No log	8.9268	366	0.6664	0.5758	0.6664	0.8163
No log	8.9756	368	0.6631	0.5758	0.6631	0.8143
No log	9.0244	370	0.6640	0.5758	0.6640	0.8148
No log	9.0732	372	0.6578	0.5758	0.6578	0.8111
No log	9.1220	374	0.6452	0.5758	0.6452	0.8033
No log	9.1707	376	0.6313	0.5758	0.6313	0.7945
No log	9.2195	378	0.6128	0.6364	0.6128	0.7828
No log	9.2683	380	0.5955	0.6364	0.5955	0.7717
No log	9.3171	382	0.5866	0.6364	0.5866	0.7659
No log	9.3659	384	0.5907	0.6364	0.5907	0.7686
No log	9.4146	386	0.5941	0.6364	0.5941	0.7708
No log	9.4634	388	0.5976	0.6364	0.5976	0.7730
No log	9.5122	390	0.6023	0.6364	0.6023	0.7761
No log	9.5610	392	0.6076	0.6364	0.6076	0.7795
No log	9.6098	394	0.6133	0.6364	0.6133	0.7831
No log	9.6585	396	0.6169	0.6364	0.6169	0.7854
No log	9.7073	398	0.6222	0.6364	0.6222	0.7888
No log	9.7561	400	0.6278	0.6364	0.6278	0.7923
No log	9.8049	402	0.6288	0.5831	0.6288	0.7929
No log	9.8537	404	0.6285	0.5831	0.6285	0.7928
No log	9.9024	406	0.6288	0.5831	0.6288	0.7930
No log	9.9512	408	0.6303	0.5831	0.6303	0.7939
No log	10.0	410	0.6314	0.5831	0.6314	0.7946

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Nov 27, 2024
Updated: Nov 27, 2024