Arabic_FineTuningAraBERT_run2_AugV5_k5_task1_organization_fold1

MayBashendy/Arabic_FineTuningAraBERT_run2_AugV5_k5_task1_organization_fold1

Arabic_FineTuningAraBERT_run2_AugV5_k5_task1_organization_fold1 is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

1% of all-time downloads

All-time downloads

310

Public

Parameters

135M

1.1 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Nov 27, 2024
Updated: Nov 27, 2024
SHA: 67568b4f

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

Arabic_FineTuningAraBERT_run2_AugV5_k5_task1_organization_fold1

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.5708
Qwk: 0.7290
Mse: 0.5708
Rmse: 0.7555

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0328	2	5.4407	0.0053	5.4407	2.3325
No log	0.0656	4	3.6682	0.0162	3.6682	1.9152
No log	0.0984	6	2.4874	-0.0752	2.4874	1.5771
No log	0.1311	8	1.4567	0.0403	1.4567	1.2069
No log	0.1639	10	1.0544	0.0297	1.0544	1.0268
No log	0.1967	12	1.0815	0.2479	1.0815	1.0400
No log	0.2295	14	1.9749	0.125	1.9749	1.4053
No log	0.2623	16	2.2001	0.1499	2.2001	1.4833
No log	0.2951	18	1.8171	0.1442	1.8171	1.3480
No log	0.3279	20	1.4504	0.2097	1.4504	1.2043
No log	0.3607	22	1.2281	0.0841	1.2281	1.1082
No log	0.3934	24	0.9686	0.2829	0.9686	0.9842
No log	0.4262	26	0.7863	0.3636	0.7863	0.8867
No log	0.4590	28	0.7410	0.24	0.7410	0.8608
No log	0.4918	30	0.7405	0.2391	0.7405	0.8606
No log	0.5246	32	0.7216	0.2391	0.7216	0.8495
No log	0.5574	34	0.8246	0.24	0.8246	0.9081
No log	0.5902	36	1.1392	-0.0442	1.1392	1.0673
No log	0.6230	38	1.4753	-0.3725	1.4753	1.2146
No log	0.6557	40	1.9224	-0.2008	1.9224	1.3865
No log	0.6885	42	1.8742	-0.0726	1.8742	1.3690
No log	0.7213	44	1.5295	0.0403	1.5295	1.2367
No log	0.7541	46	1.3468	0.1064	1.3468	1.1605
No log	0.7869	48	1.2969	0.1884	1.2969	1.1388
No log	0.8197	50	1.2029	0.3691	1.2029	1.0968
No log	0.8525	52	1.0192	0.3691	1.0192	1.0095
No log	0.8852	54	0.8171	0.4286	0.8171	0.9039
No log	0.9180	56	0.7251	0.3152	0.7251	0.8515
No log	0.9508	58	0.6777	0.3152	0.6777	0.8232
No log	0.9836	60	0.6395	0.3704	0.6395	0.7997
No log	1.0164	62	0.6348	0.3704	0.6348	0.7968
No log	1.0492	64	0.6345	0.5024	0.6345	0.7965
No log	1.0820	66	0.7077	0.4659	0.7077	0.8413
No log	1.1148	68	0.7712	0.4615	0.7712	0.8782
No log	1.1475	70	0.7131	0.4659	0.7131	0.8445
No log	1.1803	72	0.6181	0.4766	0.6181	0.7862
No log	1.2131	74	0.6452	0.4904	0.6452	0.8033
No log	1.2459	76	0.8310	0.5035	0.8310	0.9116
No log	1.2787	78	0.8604	0.5233	0.8604	0.9276
No log	1.3115	80	0.7879	0.5333	0.7879	0.8876
No log	1.3443	82	0.6988	0.5401	0.6988	0.8359
No log	1.3770	84	0.6101	0.6957	0.6101	0.7811
No log	1.4098	86	0.5766	0.6375	0.5766	0.7593
No log	1.4426	88	0.6370	0.6535	0.6370	0.7981
No log	1.4754	90	0.8089	0.5828	0.8089	0.8994
No log	1.5082	92	0.8828	0.4077	0.8828	0.9396
No log	1.5410	94	0.8342	0.4411	0.8342	0.9134
No log	1.5738	96	0.7711	0.4235	0.7711	0.8781
No log	1.6066	98	0.6988	0.4292	0.6988	0.8359
No log	1.6393	100	0.6775	0.6075	0.6775	0.8231
No log	1.6721	102	0.6565	0.6075	0.6565	0.8102
No log	1.7049	104	0.6414	0.5024	0.6414	0.8009
No log	1.7377	106	0.6343	0.4893	0.6343	0.7964
No log	1.7705	108	0.6032	0.5882	0.6032	0.7767
No log	1.8033	110	0.5649	0.5984	0.5649	0.7516
No log	1.8361	112	0.5160	0.7034	0.5160	0.7183
No log	1.8689	114	0.5001	0.5919	0.5001	0.7072
No log	1.9016	116	0.5273	0.6016	0.5273	0.7261
No log	1.9344	118	0.4879	0.5243	0.4879	0.6985
No log	1.9672	120	0.5032	0.7034	0.5032	0.7094
No log	2.0	122	0.6416	0.5401	0.6416	0.8010
No log	2.0328	124	0.7299	0.5401	0.7299	0.8543
No log	2.0656	126	0.7937	0.5092	0.7937	0.8909
No log	2.0984	128	0.8235	0.5704	0.8235	0.9075
No log	2.1311	130	0.7867	0.5116	0.7867	0.8870
No log	2.1639	132	0.7737	0.5772	0.7737	0.8796
No log	2.1967	134	0.7763	0.6149	0.7763	0.8811
No log	2.2295	136	0.7929	0.5987	0.7929	0.8905
No log	2.2623	138	0.8726	0.6111	0.8726	0.9341
No log	2.2951	140	0.8155	0.6198	0.8155	0.9031
No log	2.3279	142	0.7403	0.5935	0.7403	0.8604
No log	2.3607	144	0.6972	0.5552	0.6972	0.8350
No log	2.3934	146	0.4972	0.6744	0.4972	0.7052
No log	2.4262	148	0.4871	0.5919	0.4871	0.6979
No log	2.4590	150	0.4654	0.6207	0.4654	0.6822
No log	2.4918	152	0.5507	0.5475	0.5507	0.7421
No log	2.5246	154	0.8124	0.5299	0.8124	0.9013
No log	2.5574	156	0.8602	0.5735	0.8602	0.9275
No log	2.5902	158	0.8924	0.5772	0.8924	0.9447
No log	2.6230	160	0.9442	0.5492	0.9442	0.9717
No log	2.6557	162	0.7739	0.5735	0.7739	0.8797
No log	2.6885	164	0.7375	0.5735	0.7375	0.8588
No log	2.7213	166	0.6168	0.5609	0.6168	0.7854
No log	2.7541	168	0.5258	0.6111	0.5258	0.7251
No log	2.7869	170	0.4692	0.6392	0.4692	0.6850
No log	2.8197	172	0.4254	0.7143	0.4254	0.6522
No log	2.8525	174	0.3951	0.7552	0.3951	0.6286
No log	2.8852	176	0.4062	0.72	0.4062	0.6373
No log	2.9180	178	0.4419	0.7279	0.4419	0.6648
No log	2.9508	180	0.6230	0.7093	0.6230	0.7893
No log	2.9836	182	0.7494	0.5855	0.7494	0.8657
No log	3.0164	184	0.6254	0.6839	0.6254	0.7908
No log	3.0492	186	0.4090	0.75	0.4090	0.6395
No log	3.0820	188	0.3242	0.7482	0.3242	0.5694
No log	3.1148	190	0.3150	0.7482	0.3150	0.5613
No log	3.1475	192	0.3282	0.7709	0.3282	0.5729
No log	3.1803	194	0.3540	0.7829	0.3540	0.5950
No log	3.2131	196	0.4607	0.7220	0.4607	0.6788
No log	3.2459	198	0.5655	0.6138	0.5655	0.7520
No log	3.2787	200	0.6501	0.6047	0.6501	0.8063
No log	3.3115	202	0.5840	0.5939	0.5840	0.7642
No log	3.3443	204	0.5639	0.6316	0.5639	0.7510
No log	3.3770	206	0.5230	0.6557	0.5230	0.7232
No log	3.4098	208	0.5924	0.6316	0.5924	0.7697
No log	3.4426	210	0.7257	0.6047	0.7257	0.8519
No log	3.4754	212	0.7743	0.6047	0.7743	0.8800
No log	3.5082	214	0.7313	0.6047	0.7313	0.8552
No log	3.5410	216	0.5537	0.6525	0.5537	0.7441
No log	3.5738	218	0.5225	0.6934	0.5225	0.7228
No log	3.6066	220	0.6474	0.6047	0.6474	0.8046
No log	3.6393	222	0.7149	0.6047	0.7149	0.8455
No log	3.6721	224	0.6438	0.6138	0.6438	0.8024
No log	3.7049	226	0.4874	0.6642	0.4874	0.6981
No log	3.7377	228	0.3987	0.7619	0.3987	0.6314
No log	3.7705	230	0.3779	0.8042	0.3779	0.6147
No log	3.8033	232	0.3486	0.7709	0.3486	0.5904
No log	3.8361	234	0.3631	0.8082	0.3631	0.6026
No log	3.8689	236	0.4188	0.7771	0.4188	0.6472
No log	3.9016	238	0.4932	0.7422	0.4932	0.7023
No log	3.9344	240	0.5500	0.76	0.5500	0.7416
No log	3.9672	242	0.5678	0.7631	0.5678	0.7536
No log	4.0	244	0.6002	0.76	0.6002	0.7747
No log	4.0328	246	0.5664	0.76	0.5664	0.7526
No log	4.0656	248	0.5386	0.6706	0.5386	0.7339
No log	4.0984	250	0.4895	0.7358	0.4895	0.6997
No log	4.1311	252	0.4322	0.7255	0.4322	0.6574
No log	4.1639	254	0.4429	0.7138	0.4430	0.6655
No log	4.1967	256	0.5619	0.6038	0.5619	0.7496
No log	4.2295	258	0.5836	0.5725	0.5836	0.7639
No log	4.2623	260	0.4851	0.5679	0.4851	0.6965
No log	4.2951	262	0.3610	0.6957	0.3610	0.6008
No log	4.3279	264	0.3387	0.8	0.3387	0.5820
No log	4.3607	266	0.3413	0.8	0.3413	0.5842
No log	4.3934	268	0.3466	0.7640	0.3466	0.5888
No log	4.4262	270	0.4685	0.7475	0.4685	0.6845
No log	4.4590	272	0.5723	0.6580	0.5723	0.7565
No log	4.4918	274	0.5120	0.7342	0.5120	0.7156
No log	4.5246	276	0.4463	0.76	0.4463	0.6681
No log	4.5574	278	0.4099	0.7812	0.4099	0.6402
No log	4.5902	280	0.4304	0.7864	0.4304	0.6560
No log	4.6230	282	0.4374	0.7129	0.4374	0.6614
No log	4.6557	284	0.4654	0.7631	0.4654	0.6822
No log	4.6885	286	0.4739	0.7631	0.4739	0.6884
No log	4.7213	288	0.4704	0.7631	0.4704	0.6858
No log	4.7541	290	0.4241	0.7273	0.4241	0.6512
No log	4.7869	292	0.3672	0.8082	0.3672	0.6060
No log	4.8197	294	0.3628	0.7709	0.3628	0.6023
No log	4.8525	296	0.4340	0.7709	0.4340	0.6588
No log	4.8852	298	0.4600	0.6936	0.4600	0.6782
No log	4.9180	300	0.4070	0.7709	0.4070	0.6380
No log	4.9508	302	0.4163	0.7063	0.4163	0.6452
No log	4.9836	304	0.5164	0.6839	0.5164	0.7186
No log	5.0164	306	0.5863	0.6839	0.5863	0.7657
No log	5.0492	308	0.5607	0.6839	0.5607	0.7488
No log	5.0820	310	0.5424	0.6488	0.5424	0.7365
No log	5.1148	312	0.5485	0.6216	0.5485	0.7406
No log	5.1475	314	0.5118	0.6216	0.5118	0.7154
No log	5.1803	316	0.5628	0.6580	0.5628	0.7502
No log	5.2131	318	0.5660	0.6580	0.5660	0.7523
No log	5.2459	320	0.5301	0.6488	0.5301	0.7281
No log	5.2787	322	0.5850	0.6543	0.5850	0.7649
No log	5.3115	324	0.6540	0.6543	0.6540	0.8087
No log	5.3443	326	0.7849	0.6478	0.7849	0.8860
No log	5.3770	328	0.7930	0.6387	0.7930	0.8905
No log	5.4098	330	0.7928	0.7042	0.7928	0.8904
No log	5.4426	332	0.7574	0.6872	0.7574	0.8703
No log	5.4754	334	0.6866	0.7631	0.6866	0.8286
No log	5.5082	336	0.6236	0.7631	0.6236	0.7897
No log	5.5410	338	0.5898	0.7631	0.5898	0.7680
No log	5.5738	340	0.5833	0.7631	0.5833	0.7637
No log	5.6066	342	0.5900	0.7631	0.5900	0.7681
No log	5.6393	344	0.6086	0.6557	0.6086	0.7801
No log	5.6721	346	0.5767	0.7273	0.5767	0.7594
No log	5.7049	348	0.5143	0.7273	0.5143	0.7171
No log	5.7377	350	0.4550	0.6936	0.4550	0.6746
No log	5.7705	352	0.4206	0.7921	0.4206	0.6485
No log	5.8033	354	0.3975	0.8082	0.3975	0.6305
No log	5.8361	356	0.4216	0.7866	0.4216	0.6493
No log	5.8689	358	0.4361	0.7316	0.4361	0.6604
No log	5.9016	360	0.4841	0.7267	0.4841	0.6958
No log	5.9344	362	0.5666	0.7093	0.5666	0.7527
No log	5.9672	364	0.5554	0.7093	0.5554	0.7452
No log	6.0	366	0.5805	0.6580	0.5805	0.7619
No log	6.0328	368	0.5489	0.6525	0.5489	0.7409
No log	6.0656	370	0.4771	0.7354	0.4771	0.6907
No log	6.0984	372	0.4180	0.7658	0.4180	0.6465
No log	6.1311	374	0.4375	0.7619	0.4375	0.6614
No log	6.1639	376	0.5066	0.7016	0.5066	0.7117
No log	6.1967	378	0.5743	0.7093	0.5743	0.7578
No log	6.2295	380	0.6659	0.6387	0.6659	0.8160
No log	6.2623	382	0.6569	0.7093	0.6569	0.8105
No log	6.2951	384	0.5838	0.76	0.5838	0.7641
No log	6.3279	386	0.6007	0.76	0.6007	0.7751
No log	6.3607	388	0.6672	0.7093	0.6672	0.8168
No log	6.3934	390	0.6921	0.6580	0.6921	0.8319
No log	6.4262	392	0.6218	0.7093	0.6218	0.7885
No log	6.4590	394	0.5373	0.7093	0.5373	0.7330
No log	6.4918	396	0.4549	0.7407	0.4549	0.6745
No log	6.5246	398	0.4125	0.7864	0.4125	0.6422
No log	6.5574	400	0.4324	0.7712	0.4324	0.6576
No log	6.5902	402	0.4988	0.6755	0.4988	0.7063
No log	6.6230	404	0.6453	0.6580	0.6453	0.8033
No log	6.6557	406	0.8246	0.5389	0.8246	0.9081
No log	6.6885	408	0.8983	0.5389	0.8983	0.9478
No log	6.7213	410	0.8732	0.5449	0.8732	0.9345
No log	6.7541	412	0.7490	0.6122	0.7490	0.8655
No log	6.7869	414	0.6532	0.6789	0.6532	0.8082
No log	6.8197	416	0.6035	0.6789	0.6035	0.7769
No log	6.8525	418	0.6023	0.6789	0.6023	0.7761
No log	6.8852	420	0.6411	0.6580	0.6411	0.8007
No log	6.9180	422	0.7019	0.6047	0.7019	0.8378
No log	6.9508	424	0.6952	0.6047	0.6952	0.8338
No log	6.9836	426	0.6275	0.6138	0.6275	0.7922
No log	7.0164	428	0.5348	0.7290	0.5348	0.7313
No log	7.0492	430	0.4611	0.7727	0.4611	0.6790
No log	7.0820	432	0.4000	0.8218	0.4000	0.6325
No log	7.1148	434	0.3762	0.8218	0.3762	0.6133
No log	7.1475	436	0.3881	0.8218	0.3881	0.6230
No log	7.1803	438	0.4541	0.7727	0.4541	0.6739
No log	7.2131	440	0.5865	0.6866	0.5865	0.7659
No log	7.2459	442	0.7672	0.5882	0.7672	0.8759
No log	7.2787	444	0.8166	0.5812	0.8166	0.9037
No log	7.3115	446	0.7483	0.5882	0.7483	0.8650
No log	7.3443	448	0.6317	0.6763	0.6317	0.7948
No log	7.3770	450	0.5238	0.7455	0.5238	0.7238
No log	7.4098	452	0.4334	0.7974	0.4334	0.6583
No log	7.4426	454	0.4086	0.7974	0.4086	0.6392
No log	7.4754	456	0.4034	0.7974	0.4034	0.6352
No log	7.5082	458	0.4349	0.7727	0.4349	0.6594
No log	7.5410	460	0.5037	0.7290	0.5037	0.7097
No log	7.5738	462	0.5616	0.7290	0.5616	0.7494
No log	7.6066	464	0.5656	0.7645	0.5656	0.7520
No log	7.6393	466	0.5380	0.7645	0.5380	0.7335
No log	7.6721	468	0.5102	0.7455	0.5102	0.7143
No log	7.7049	470	0.5140	0.7455	0.5140	0.7169
No log	7.7377	472	0.5520	0.7645	0.5520	0.7429
No log	7.7705	474	0.5909	0.6975	0.5909	0.7687
No log	7.8033	476	0.5751	0.6975	0.5751	0.7584
No log	7.8361	478	0.5510	0.7645	0.5510	0.7423
No log	7.8689	480	0.4865	0.7645	0.4865	0.6975
No log	7.9016	482	0.4399	0.7455	0.4399	0.6633
No log	7.9344	484	0.3999	0.7941	0.3999	0.6324
No log	7.9672	486	0.3899	0.7941	0.3899	0.6244
No log	8.0	488	0.3902	0.7941	0.3902	0.6247
No log	8.0328	490	0.4051	0.7941	0.4051	0.6365
No log	8.0656	492	0.4255	0.7727	0.4255	0.6523
No log	8.0984	494	0.4534	0.7147	0.4534	0.6733
No log	8.1311	496	0.4461	0.7727	0.4461	0.6679
No log	8.1639	498	0.4551	0.7147	0.4551	0.6746
0.461	8.1967	500	0.4727	0.7455	0.4727	0.6875
0.461	8.2295	502	0.5097	0.7455	0.5097	0.7140
0.461	8.2623	504	0.5465	0.7645	0.5465	0.7392
0.461	8.2951	506	0.5405	0.7455	0.5405	0.7352
0.461	8.3279	508	0.5164	0.7455	0.5164	0.7186
0.461	8.3607	510	0.5062	0.7455	0.5062	0.7114
0.461	8.3934	512	0.5136	0.7455	0.5136	0.7166
0.461	8.4262	514	0.4977	0.7455	0.4977	0.7055
0.461	8.4590	516	0.4829	0.7455	0.4829	0.6949
0.461	8.4918	518	0.4878	0.7455	0.4878	0.6984
0.461	8.5246	520	0.5079	0.7290	0.5079	0.7127
0.461	8.5574	522	0.5193	0.7036	0.5193	0.7206
0.461	8.5902	524	0.5285	0.7036	0.5285	0.7270
0.461	8.6230	526	0.5283	0.7036	0.5283	0.7269
0.461	8.6557	528	0.4957	0.7290	0.4957	0.7040
0.461	8.6885	530	0.4536	0.7354	0.4536	0.6735
0.461	8.7213	532	0.4156	0.7619	0.4156	0.6447
0.461	8.7541	534	0.3933	0.8042	0.3933	0.6272
0.461	8.7869	536	0.3951	0.7974	0.3951	0.6286
0.461	8.8197	538	0.4041	0.7866	0.4041	0.6357
0.461	8.8525	540	0.4202	0.7866	0.4202	0.6482
0.461	8.8852	542	0.4347	0.7974	0.4347	0.6593
0.461	8.9180	544	0.4512	0.7974	0.4512	0.6717
0.461	8.9508	546	0.4690	0.7391	0.4690	0.6849
0.461	8.9836	548	0.4967	0.7688	0.4967	0.7048
0.461	9.0164	550	0.5178	0.7688	0.5178	0.7196
0.461	9.0492	552	0.5340	0.7093	0.5340	0.7308
0.461	9.0820	554	0.5525	0.7093	0.5525	0.7433
0.461	9.1148	556	0.5540	0.7093	0.5540	0.7443
0.461	9.1475	558	0.5561	0.7455	0.5561	0.7457
0.461	9.1803	560	0.5640	0.7455	0.5640	0.7510
0.461	9.2131	562	0.5706	0.7455	0.5706	0.7554
0.461	9.2459	564	0.5788	0.7645	0.5788	0.7608
0.461	9.2787	566	0.5696	0.7455	0.5696	0.7547
0.461	9.3115	568	0.5558	0.7455	0.5558	0.7455
0.461	9.3443	570	0.5498	0.7455	0.5498	0.7415
0.461	9.3770	572	0.5597	0.7455	0.5597	0.7481
0.461	9.4098	574	0.5742	0.7645	0.5742	0.7578
0.461	9.4426	576	0.5775	0.7290	0.5775	0.7599
0.461	9.4754	578	0.5787	0.7290	0.5787	0.7607
0.461	9.5082	580	0.5827	0.7290	0.5827	0.7634
0.461	9.5410	582	0.5848	0.7290	0.5848	0.7647
0.461	9.5738	584	0.5779	0.7290	0.5779	0.7602
0.461	9.6066	586	0.5699	0.7290	0.5699	0.7549
0.461	9.6393	588	0.5674	0.7290	0.5674	0.7533
0.461	9.6721	590	0.5722	0.7290	0.5722	0.7564
0.461	9.7049	592	0.5813	0.7290	0.5813	0.7624
0.461	9.7377	594	0.5882	0.7290	0.5882	0.7669
0.461	9.7705	596	0.5934	0.7290	0.5934	0.7703
0.461	9.8033	598	0.5938	0.7290	0.5938	0.7706
0.461	9.8361	600	0.5899	0.7290	0.5899	0.7681
0.461	9.8689	602	0.5838	0.7290	0.5838	0.7641
0.461	9.9016	604	0.5778	0.7290	0.5778	0.7602
0.461	9.9344	606	0.5739	0.7290	0.5739	0.7576
0.461	9.9672	608	0.5715	0.7290	0.5715	0.7560
0.461	10.0	610	0.5708	0.7290	0.5708	0.7555

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Nov 27, 2024
Updated: Nov 27, 2024