Arabic_FineTuningAraBERT_run2_AugV5_k4_task1_organization_fold1

MayBashendy/Arabic_FineTuningAraBERT_run2_AugV5_k4_task1_organization_fold1

Arabic_FineTuningAraBERT_run2_AugV5_k4_task1_organization_fold1 is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

16% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Nov 27, 2024
Updated: Nov 27, 2024
SHA: 7a72206a

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

Arabic_FineTuningAraBERT_run2_AugV5_k4_task1_organization_fold1

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.4736
Qwk: 0.6689
Mse: 0.4736
Rmse: 0.6882

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0392	2	4.5828	-0.0298	4.5828	2.1407
No log	0.0784	4	3.0349	-0.0450	3.0349	1.7421
No log	0.1176	6	1.8013	0.1355	1.8013	1.3421
No log	0.1569	8	1.3073	0.0	1.3073	1.1434
No log	0.1961	10	1.6160	0.0	1.6160	1.2712
No log	0.2353	12	1.9273	-0.0067	1.9273	1.3883
No log	0.2745	14	1.8152	-0.0145	1.8152	1.3473
No log	0.3137	16	1.2048	0.1895	1.2048	1.0976
No log	0.3529	18	1.0950	0.1658	1.0950	1.0464
No log	0.3922	20	1.0637	0.2143	1.0637	1.0314
No log	0.4314	22	0.8361	0.0562	0.8361	0.9144
No log	0.4706	24	0.8338	0.1390	0.8338	0.9131
No log	0.5098	26	1.2259	0.1600	1.2259	1.1072
No log	0.5490	28	1.5629	0.2340	1.5629	1.2501
No log	0.5882	30	1.3471	0.2097	1.3471	1.1607
No log	0.6275	32	0.9943	0.3317	0.9943	0.9971
No log	0.6667	34	0.7704	0.4842	0.7704	0.8777
No log	0.7059	36	0.7706	0.4842	0.7706	0.8778
No log	0.7451	38	0.7733	0.3834	0.7733	0.8794
No log	0.7843	40	0.8724	0.2613	0.8724	0.9340
No log	0.8235	42	0.9560	0.2146	0.9560	0.9778
No log	0.8627	44	1.1985	0.0	1.1985	1.0947
No log	0.9020	46	1.5556	0.0	1.5556	1.2472
No log	0.9412	48	1.5611	0.0	1.5611	1.2495
No log	0.9804	50	1.4003	0.0	1.4003	1.1833
No log	1.0196	52	1.1788	0.0187	1.1788	1.0857
No log	1.0588	54	1.0058	0.0577	1.0058	1.0029
No log	1.0980	56	0.8882	0.3317	0.8882	0.9424
No log	1.1373	58	0.9728	0.3099	0.9728	0.9863
No log	1.1765	60	0.9893	0.3099	0.9893	0.9946
No log	1.2157	62	0.8258	0.1630	0.8258	0.9088
No log	1.2549	64	0.8078	0.2652	0.8078	0.8988
No log	1.2941	66	0.8447	0.0642	0.8447	0.9191
No log	1.3333	68	0.8151	0.1630	0.8151	0.9028
No log	1.3725	70	0.8172	0.3636	0.8172	0.9040
No log	1.4118	72	0.7825	0.3438	0.7825	0.8846
No log	1.4510	74	0.7904	0.3179	0.7904	0.8890
No log	1.4902	76	0.7652	0.3438	0.7652	0.8748
No log	1.5294	78	0.7141	0.3226	0.7141	0.8450
No log	1.5686	80	0.7245	0.125	0.7245	0.8512
No log	1.6078	82	0.7310	0.125	0.7310	0.8550
No log	1.6471	84	0.7357	0.3942	0.7357	0.8578
No log	1.6863	86	0.7505	0.3512	0.7505	0.8663
No log	1.7255	88	0.8366	0.3348	0.8366	0.9146
No log	1.7647	90	0.8712	0.3362	0.8712	0.9334
No log	1.8039	92	1.0121	0.2417	1.0121	1.0060
No log	1.8431	94	1.0515	0.2417	1.0515	1.0254
No log	1.8824	96	0.8947	0.3149	0.8947	0.9459
No log	1.9216	98	0.8081	0.3900	0.8081	0.8989
No log	1.9608	100	0.8048	0.3900	0.8048	0.8971
No log	2.0	102	0.9428	0.3581	0.9428	0.9710
No log	2.0392	104	0.9756	0.2736	0.9756	0.9877
No log	2.0784	106	0.7878	0.2936	0.7878	0.8876
No log	2.1176	108	0.5770	0.4848	0.5770	0.7596
No log	2.1569	110	0.5234	0.4306	0.5234	0.7235
No log	2.1961	112	0.5161	0.6903	0.5161	0.7184
No log	2.2353	114	0.5165	0.6410	0.5165	0.7187
No log	2.2745	116	0.5575	0.5977	0.5575	0.7466
No log	2.3137	118	0.6313	0.6209	0.6313	0.7945
No log	2.3529	120	0.5835	0.5441	0.5835	0.7639
No log	2.3922	122	0.5736	0.6719	0.5736	0.7574
No log	2.4314	124	0.5635	0.6403	0.5635	0.7506
No log	2.4706	126	0.6290	0.5475	0.6290	0.7931
No log	2.5098	128	0.9103	0.5070	0.9103	0.9541
No log	2.5490	130	1.0394	0.5070	1.0394	1.0195
No log	2.5882	132	0.8834	0.5070	0.8834	0.9399
No log	2.6275	134	0.5670	0.5882	0.5670	0.7530
No log	2.6667	136	0.4894	0.6316	0.4894	0.6996
No log	2.7059	138	0.5104	0.6111	0.5104	0.7144
No log	2.7451	140	0.6789	0.5172	0.6789	0.8240
No log	2.7843	142	0.7482	0.5172	0.7482	0.8650
No log	2.8235	144	0.7298	0.5172	0.7298	0.8543
No log	2.8627	146	0.6079	0.5821	0.6079	0.7797
No log	2.9020	148	0.6107	0.5821	0.6107	0.7814
No log	2.9412	150	0.5682	0.6125	0.5682	0.7538
No log	2.9804	152	0.4350	0.7287	0.4350	0.6596
No log	3.0196	154	0.3954	0.7686	0.3954	0.6288
No log	3.0588	156	0.3967	0.7950	0.3967	0.6299
No log	3.0980	158	0.4831	0.6111	0.4831	0.6950
No log	3.1373	160	0.7083	0.5435	0.7083	0.8416
No log	3.1765	162	0.7120	0.5128	0.7120	0.8438
No log	3.2157	164	0.6263	0.5914	0.6263	0.7914
No log	3.2549	166	0.4553	0.7658	0.4553	0.6747
No log	3.2941	168	0.4387	0.7812	0.4387	0.6623
No log	3.3333	170	0.4565	0.7586	0.4565	0.6756
No log	3.3725	172	0.5728	0.5914	0.5728	0.7568
No log	3.4118	174	0.7245	0.5641	0.7245	0.8512
No log	3.4510	176	0.7807	0.5128	0.7807	0.8836
No log	3.4902	178	0.7956	0.5725	0.7956	0.8920
No log	3.5294	180	0.6344	0.5817	0.6344	0.7965
No log	3.5686	182	0.4198	0.6224	0.4198	0.6480
No log	3.6078	184	0.3761	0.6818	0.3761	0.6133
No log	3.6471	186	0.4157	0.51	0.4157	0.6447
No log	3.6863	188	0.4611	0.4948	0.4611	0.6790
No log	3.7255	190	0.4581	0.4670	0.4581	0.6769
No log	3.7647	192	0.4251	0.6207	0.4251	0.6520
No log	3.8039	194	0.3869	0.7829	0.3869	0.6220
No log	3.8431	196	0.4039	0.7279	0.4039	0.6355
No log	3.8824	198	0.4880	0.6873	0.4880	0.6986
No log	3.9216	200	0.5829	0.6028	0.5829	0.7635
No log	3.9608	202	0.8203	0.6138	0.8203	0.9057
No log	4.0	204	0.8665	0.5302	0.8665	0.9309
No log	4.0392	206	0.7375	0.5939	0.7375	0.8588
No log	4.0784	208	0.5911	0.6807	0.5911	0.7688
No log	4.1176	210	0.6285	0.5939	0.6285	0.7928
No log	4.1569	212	0.6941	0.5172	0.6941	0.8332
No log	4.1961	214	0.6840	0.5172	0.6840	0.8270
No log	4.2353	216	0.6671	0.5172	0.6671	0.8168
No log	4.2745	218	0.5766	0.5939	0.5766	0.7594
No log	4.3137	220	0.5533	0.5939	0.5533	0.7439
No log	4.3529	222	0.5158	0.6642	0.5158	0.7182
No log	4.3922	224	0.5446	0.6343	0.5446	0.7379
No log	4.4314	226	0.5458	0.6237	0.5458	0.7388
No log	4.4706	228	0.5636	0.5655	0.5636	0.7508
No log	4.5098	230	0.5756	0.5461	0.5756	0.7587
No log	4.5490	232	0.6894	0.4878	0.6894	0.8303
No log	4.5882	234	0.7605	0.4878	0.7605	0.8720
No log	4.6275	236	0.6888	0.5461	0.6888	0.8299
No log	4.6667	238	0.5790	0.6488	0.5790	0.7609
No log	4.7059	240	0.5942	0.5461	0.5942	0.7708
No log	4.7451	242	0.5106	0.7354	0.5106	0.7145
No log	4.7843	244	0.5069	0.75	0.5069	0.7120
No log	4.8235	246	0.4530	0.8123	0.4530	0.6731
No log	4.8627	248	0.4366	0.8123	0.4366	0.6608
No log	4.9020	250	0.4785	0.7774	0.4785	0.6918
No log	4.9412	252	0.6738	0.4690	0.6738	0.8208
No log	4.9804	254	0.7761	0.4878	0.7761	0.8810
No log	5.0196	256	0.6862	0.5461	0.6862	0.8284
No log	5.0588	258	0.4912	0.7619	0.4912	0.7009
No log	5.0980	260	0.4221	0.7774	0.4221	0.6497
No log	5.1373	262	0.4213	0.7774	0.4213	0.6490
No log	5.1765	264	0.4664	0.7774	0.4664	0.6830
No log	5.2157	266	0.5404	0.6642	0.5404	0.7351
No log	5.2549	268	0.4972	0.6642	0.4972	0.7051
No log	5.2941	270	0.5046	0.6642	0.5046	0.7104
No log	5.3333	272	0.5553	0.6642	0.5553	0.7452
No log	5.3725	274	0.5425	0.6642	0.5425	0.7366
No log	5.4118	276	0.5466	0.5939	0.5466	0.7393
No log	5.4510	278	0.5421	0.5939	0.5421	0.7363
No log	5.4902	280	0.6245	0.5854	0.6245	0.7902
No log	5.5294	282	0.6417	0.5854	0.6417	0.8011
No log	5.5686	284	0.6862	0.5854	0.6862	0.8284
No log	5.6078	286	0.6408	0.5854	0.6408	0.8005
No log	5.6471	288	0.5907	0.6689	0.5907	0.7686
No log	5.6863	290	0.6073	0.6689	0.6073	0.7793
No log	5.7255	292	0.7019	0.6621	0.7019	0.8378
No log	5.7647	294	0.8169	0.5070	0.8169	0.9038
No log	5.8039	296	0.7619	0.5070	0.7619	0.8729
No log	5.8431	298	0.6364	0.5854	0.6364	0.7977
No log	5.8824	300	0.6238	0.5854	0.6238	0.7898
No log	5.9216	302	0.5634	0.6894	0.5634	0.7506
No log	5.9608	304	0.4638	0.6957	0.4638	0.6810
No log	6.0	306	0.4039	0.7219	0.4039	0.6356
No log	6.0392	308	0.4149	0.7219	0.4149	0.6441
No log	6.0784	310	0.5354	0.6689	0.5354	0.7317
No log	6.1176	312	0.7246	0.6138	0.7246	0.8512
No log	6.1569	314	0.7612	0.6222	0.7612	0.8725
No log	6.1961	316	0.7228	0.5366	0.7228	0.8502
No log	6.2353	318	0.6079	0.6894	0.6079	0.7797
No log	6.2745	320	0.4313	0.7726	0.4313	0.6567
No log	6.3137	322	0.2974	0.7510	0.2974	0.5453
No log	6.3529	324	0.2756	0.7510	0.2756	0.5249
No log	6.3922	326	0.2745	0.7510	0.2745	0.5240
No log	6.4314	328	0.3066	0.776	0.3066	0.5537
No log	6.4706	330	0.4001	0.7726	0.4001	0.6326
No log	6.5098	332	0.5040	0.6894	0.5040	0.7100
No log	6.5490	334	0.5630	0.6138	0.5630	0.7503
No log	6.5882	336	0.5561	0.6894	0.5561	0.7457
No log	6.6275	338	0.4819	0.6894	0.4819	0.6942
No log	6.6667	340	0.4023	0.7445	0.4023	0.6343
No log	6.7059	342	0.3672	0.8178	0.3672	0.6059
No log	6.7451	344	0.3894	0.7895	0.3894	0.6240
No log	6.7843	346	0.4635	0.6894	0.4635	0.6808
No log	6.8235	348	0.5793	0.5854	0.5793	0.7611
No log	6.8627	350	0.6467	0.5854	0.6467	0.8042
No log	6.9020	352	0.6170	0.5854	0.6170	0.7855
No log	6.9412	354	0.5915	0.6621	0.5915	0.7691
No log	6.9804	356	0.5311	0.6621	0.5311	0.7288
No log	7.0196	358	0.4643	0.6894	0.4643	0.6814
No log	7.0588	360	0.4457	0.6894	0.4457	0.6676
No log	7.0980	362	0.4284	0.6957	0.4284	0.6545
No log	7.1373	364	0.4388	0.6957	0.4388	0.6624
No log	7.1765	366	0.4877	0.6894	0.4877	0.6984
No log	7.2157	368	0.5279	0.6894	0.5279	0.7266
No log	7.2549	370	0.5196	0.6894	0.5196	0.7208
No log	7.2941	372	0.5526	0.6894	0.5526	0.7433
No log	7.3333	374	0.6320	0.6621	0.6320	0.7950
No log	7.3725	376	0.6761	0.6621	0.6761	0.8222
No log	7.4118	378	0.6182	0.6621	0.6182	0.7863
No log	7.4510	380	0.5339	0.6894	0.5339	0.7307
No log	7.4902	382	0.4995	0.6894	0.4995	0.7067
No log	7.5294	384	0.4625	0.6957	0.4625	0.6801
No log	7.5686	386	0.4706	0.6689	0.4706	0.6860
No log	7.6078	388	0.4832	0.6894	0.4832	0.6951
No log	7.6471	390	0.4882	0.6894	0.4882	0.6987
No log	7.6863	392	0.5409	0.6894	0.5409	0.7354
No log	7.7255	394	0.5536	0.6894	0.5536	0.7441
No log	7.7647	396	0.5125	0.6894	0.5125	0.7159
No log	7.8039	398	0.4914	0.6894	0.4914	0.7010
No log	7.8431	400	0.4787	0.6689	0.4787	0.6919
No log	7.8824	402	0.5099	0.6894	0.5099	0.7141
No log	7.9216	404	0.5233	0.6894	0.5233	0.7234
No log	7.9608	406	0.5271	0.6894	0.5271	0.7260
No log	8.0	408	0.5233	0.6894	0.5233	0.7234
No log	8.0392	410	0.5325	0.6894	0.5325	0.7297
No log	8.0784	412	0.5031	0.6894	0.5031	0.7093
No log	8.1176	414	0.5123	0.6894	0.5123	0.7157
No log	8.1569	416	0.5450	0.6894	0.5450	0.7382
No log	8.1961	418	0.5411	0.6894	0.5411	0.7356
No log	8.2353	420	0.5391	0.6894	0.5391	0.7342
No log	8.2745	422	0.5410	0.6894	0.5410	0.7355
No log	8.3137	424	0.5058	0.6894	0.5058	0.7112
No log	8.3529	426	0.4699	0.6689	0.4699	0.6855
No log	8.3922	428	0.4550	0.6689	0.4550	0.6745
No log	8.4314	430	0.4759	0.6689	0.4759	0.6899
No log	8.4706	432	0.5235	0.6894	0.5235	0.7236
No log	8.5098	434	0.5598	0.6894	0.5598	0.7482
No log	8.5490	436	0.5722	0.6894	0.5722	0.7565
No log	8.5882	438	0.5476	0.6894	0.5476	0.7400
No log	8.6275	440	0.5172	0.6894	0.5172	0.7192
No log	8.6667	442	0.5057	0.6894	0.5057	0.7111
No log	8.7059	444	0.5220	0.6894	0.5220	0.7225
No log	8.7451	446	0.5464	0.6894	0.5464	0.7392
No log	8.7843	448	0.5809	0.6894	0.5809	0.7622
No log	8.8235	450	0.5776	0.6894	0.5776	0.7600
No log	8.8627	452	0.5717	0.6894	0.5717	0.7561
No log	8.9020	454	0.5477	0.6894	0.5477	0.7400
No log	8.9412	456	0.5050	0.6894	0.5050	0.7106
No log	8.9804	458	0.4670	0.6689	0.4670	0.6834
No log	9.0196	460	0.4468	0.6957	0.4468	0.6684
No log	9.0588	462	0.4278	0.7835	0.4278	0.6541
No log	9.0980	464	0.4083	0.7835	0.4083	0.6390
No log	9.1373	466	0.3986	0.8000	0.3986	0.6313
No log	9.1765	468	0.4109	0.7835	0.4109	0.6410
No log	9.2157	470	0.4349	0.7569	0.4349	0.6595
No log	9.2549	472	0.4472	0.6689	0.4472	0.6687
No log	9.2941	474	0.4676	0.6689	0.4676	0.6838
No log	9.3333	476	0.4933	0.6894	0.4933	0.7023
No log	9.3725	478	0.5154	0.6894	0.5154	0.7179
No log	9.4118	480	0.5183	0.6894	0.5183	0.7199
No log	9.4510	482	0.5051	0.6894	0.5051	0.7107
No log	9.4902	484	0.4833	0.6894	0.4833	0.6952
No log	9.5294	486	0.4600	0.6689	0.4600	0.6783
No log	9.5686	488	0.4499	0.6689	0.4499	0.6707
No log	9.6078	490	0.4399	0.6957	0.4399	0.6632
No log	9.6471	492	0.4341	0.6957	0.4341	0.6589
No log	9.6863	494	0.4388	0.6957	0.4388	0.6624
No log	9.7255	496	0.4444	0.6957	0.4444	0.6666
No log	9.7647	498	0.4533	0.6689	0.4533	0.6733
0.4189	9.8039	500	0.4607	0.6689	0.4607	0.6787
0.4189	9.8431	502	0.4661	0.6689	0.4661	0.6827
0.4189	9.8824	504	0.4706	0.6689	0.4706	0.6860
0.4189	9.9216	506	0.4731	0.6689	0.4731	0.6878
0.4189	9.9608	508	0.4735	0.6689	0.4735	0.6881
0.4189	10.0	510	0.4736	0.6689	0.4736	0.6882

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Nov 27, 2024
Updated: Nov 27, 2024