Arabic_FineTuningAraBERT_run3_AugV5_k4_task1_organization_fold0

MayBashendy/Arabic_FineTuningAraBERT_run3_AugV5_k4_task1_organization_fold0

Arabic_FineTuningAraBERT_run3_AugV5_k4_task1_organization_fold0 is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

53% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Nov 28, 2024
Updated: Nov 28, 2024
SHA: c71d6683

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

Arabic_FineTuningAraBERT_run3_AugV5_k4_task1_organization_fold0

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.7954
Qwk: 0.7579
Mse: 0.7954
Rmse: 0.8919

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0392	2	5.9709	-0.1540	5.9709	2.4435
No log	0.0784	4	4.2391	-0.1053	4.2391	2.0589
No log	0.1176	6	2.8698	-0.2000	2.8698	1.6940
No log	0.1569	8	1.5607	0.0	1.5607	1.2493
No log	0.1961	10	1.7955	0.1582	1.7955	1.3400
No log	0.2353	12	2.3398	0.2236	2.3398	1.5296
No log	0.2745	14	2.2601	0.1750	2.2601	1.5034
No log	0.3137	16	1.9193	0.0	1.9193	1.3854
No log	0.3529	18	1.6443	0.0	1.6443	1.2823
No log	0.3922	20	1.4798	-0.0049	1.4798	1.2165
No log	0.4314	22	1.5457	-0.0294	1.5457	1.2432
No log	0.4706	24	1.4675	0.2435	1.4675	1.2114
No log	0.5098	26	1.4341	0.3276	1.4341	1.1975
No log	0.5490	28	1.3736	0.4324	1.3736	1.1720
No log	0.5882	30	1.5093	0.0244	1.5093	1.2285
No log	0.6275	32	1.5992	0.0	1.5992	1.2646
No log	0.6667	34	1.7250	0.0	1.7250	1.3134
No log	0.7059	36	1.7725	0.0	1.7725	1.3313
No log	0.7451	38	1.5807	0.0	1.5807	1.2573
No log	0.7843	40	1.3830	0.0	1.3830	1.1760
No log	0.8235	42	1.3421	0.4074	1.3421	1.1585
No log	0.8627	44	1.3596	0.4074	1.3596	1.1660
No log	0.9020	46	1.4027	0.2032	1.4027	1.1844
No log	0.9412	48	1.4243	0.0	1.4243	1.1935
No log	0.9804	50	1.4140	0.0	1.4140	1.1891
No log	1.0196	52	1.4403	0.0	1.4403	1.2001
No log	1.0588	54	1.4897	0.0	1.4897	1.2206
No log	1.0980	56	1.5153	0.0	1.5153	1.2310
No log	1.1373	58	1.4935	0.0	1.4935	1.2221
No log	1.1765	60	1.4636	0.0	1.4636	1.2098
No log	1.2157	62	1.4055	0.0	1.4055	1.1856
No log	1.2549	64	1.3255	0.2794	1.3255	1.1513
No log	1.2941	66	1.2375	0.4074	1.2375	1.1124
No log	1.3333	68	1.2082	0.3808	1.2082	1.0992
No log	1.3725	70	1.2148	0.3808	1.2148	1.1022
No log	1.4118	72	1.2121	0.4603	1.2121	1.1010
No log	1.4510	74	1.1546	0.4044	1.1546	1.0745
No log	1.4902	76	1.1180	0.3259	1.1180	1.0574
No log	1.5294	78	1.1143	0.3259	1.1143	1.0556
No log	1.5686	80	1.0924	0.3259	1.0924	1.0452
No log	1.6078	82	1.0586	0.3259	1.0586	1.0289
No log	1.6471	84	1.0223	0.3845	1.0223	1.0111
No log	1.6863	86	0.9872	0.3845	0.9872	0.9936
No log	1.7255	88	0.9749	0.4590	0.9749	0.9874
No log	1.7647	90	0.9922	0.4842	0.9922	0.9961
No log	1.8039	92	0.9932	0.4842	0.9932	0.9966
No log	1.8431	94	0.9243	0.4842	0.9243	0.9614
No log	1.8824	96	0.8552	0.4830	0.8552	0.9248
No log	1.9216	98	0.8664	0.4311	0.8664	0.9308
No log	1.9608	100	0.9908	0.5714	0.9908	0.9954
No log	2.0	102	1.0652	0.4557	1.0652	1.0321
No log	2.0392	104	0.9973	0.6257	0.9973	0.9986
No log	2.0784	106	0.8628	0.6157	0.8628	0.9288
No log	2.1176	108	0.8353	0.6839	0.8353	0.9140
No log	2.1569	110	0.8628	0.6103	0.8628	0.9289
No log	2.1961	112	0.9240	0.6469	0.9240	0.9613
No log	2.2353	114	0.8749	0.6469	0.8749	0.9354
No log	2.2745	116	0.9387	0.6469	0.9387	0.9689
No log	2.3137	118	1.0376	0.5556	1.0376	1.0186
No log	2.3529	120	0.9636	0.5532	0.9636	0.9816
No log	2.3922	122	0.8024	0.5812	0.8024	0.8958
No log	2.4314	124	0.7176	0.7112	0.7176	0.8471
No log	2.4706	126	0.7208	0.6909	0.7208	0.8490
No log	2.5098	128	0.7136	0.6909	0.7136	0.8447
No log	2.5490	130	0.7087	0.7139	0.7087	0.8418
No log	2.5882	132	0.8270	0.5973	0.8270	0.9094
No log	2.6275	134	1.0598	0.5366	1.0598	1.0295
No log	2.6667	136	1.1922	0.3430	1.1922	1.0919
No log	2.7059	138	1.1928	0.4337	1.1928	1.0922
No log	2.7451	140	1.2153	0.4311	1.2153	1.1024
No log	2.7843	142	1.3269	0.3391	1.3269	1.1519
No log	2.8235	144	1.5748	0.2961	1.5748	1.2549
No log	2.8627	146	1.5332	0.2961	1.5332	1.2382
No log	2.9020	148	1.2040	0.4678	1.2040	1.0972
No log	2.9412	150	0.8682	0.5890	0.8682	0.9317
No log	2.9804	152	0.7699	0.6550	0.7699	0.8774
No log	3.0196	154	0.7993	0.6934	0.7993	0.8940
No log	3.0588	156	0.8231	0.6303	0.8231	0.9073
No log	3.0980	158	0.7955	0.6303	0.7955	0.8919
No log	3.1373	160	0.7269	0.6802	0.7269	0.8526
No log	3.1765	162	0.6869	0.7612	0.6869	0.8288
No log	3.2157	164	0.6989	0.7427	0.6989	0.8360
No log	3.2549	166	0.7518	0.6510	0.7518	0.8670
No log	3.2941	168	0.7666	0.6510	0.7666	0.8755
No log	3.3333	170	0.7423	0.7616	0.7423	0.8616
No log	3.3725	172	0.8726	0.6135	0.8726	0.9341
No log	3.4118	174	1.1027	0.5163	1.1027	1.0501
No log	3.4510	176	1.1647	0.5163	1.1647	1.0792
No log	3.4902	178	1.0627	0.5862	1.0627	1.0309
No log	3.5294	180	0.9708	0.5896	0.9708	0.9853
No log	3.5686	182	0.8267	0.6219	0.8267	0.9092
No log	3.6078	184	0.7236	0.6627	0.7236	0.8506
No log	3.6471	186	0.6961	0.7058	0.6961	0.8343
No log	3.6863	188	0.6973	0.7058	0.6973	0.8351
No log	3.7255	190	0.7084	0.7058	0.7084	0.8417
No log	3.7647	192	0.6938	0.7612	0.6938	0.8330
No log	3.8039	194	0.6889	0.7058	0.6889	0.8300
No log	3.8431	196	0.6794	0.7875	0.6794	0.8242
No log	3.8824	198	0.6894	0.7342	0.6894	0.8303
No log	3.9216	200	0.7105	0.6752	0.7105	0.8429
No log	3.9608	202	0.7197	0.6091	0.7197	0.8483
No log	4.0	204	0.7336	0.6091	0.7336	0.8565
No log	4.0392	206	0.7778	0.6339	0.7778	0.8819
No log	4.0784	208	0.8845	0.6339	0.8845	0.9405
No log	4.1176	210	1.0206	0.5862	1.0206	1.0102
No log	4.1569	212	1.0333	0.5837	1.0333	1.0165
No log	4.1961	214	0.9449	0.5837	0.9449	0.9720
No log	4.2353	216	0.8100	0.6621	0.8100	0.9000
No log	4.2745	218	0.7233	0.7756	0.7233	0.8505
No log	4.3137	220	0.6955	0.7277	0.6955	0.8340
No log	4.3529	222	0.6913	0.7277	0.6913	0.8315
No log	4.3922	224	0.6902	0.7350	0.6902	0.8308
No log	4.4314	226	0.7285	0.6732	0.7285	0.8535
No log	4.4706	228	0.8768	0.5837	0.8768	0.9364
No log	4.5098	230	0.9962	0.5862	0.9962	0.9981
No log	4.5490	232	1.0228	0.5862	1.0228	1.0114
No log	4.5882	234	0.9296	0.5837	0.9296	0.9642
No log	4.6275	236	0.8075	0.5837	0.8075	0.8986
No log	4.6667	238	0.7621	0.7752	0.7621	0.8730
No log	4.7059	240	0.7336	0.7277	0.7336	0.8565
No log	4.7451	242	0.7623	0.7277	0.7623	0.8731
No log	4.7843	244	0.8599	0.6621	0.8599	0.9273
No log	4.8235	246	0.9887	0.6135	0.9887	0.9943
No log	4.8627	248	1.0381	0.6135	1.0381	1.0189
No log	4.9020	250	1.0312	0.6135	1.0312	1.0155
No log	4.9412	252	1.0204	0.6135	1.0204	1.0102
No log	4.9804	254	1.0474	0.6135	1.0474	1.0234
No log	5.0196	256	1.0077	0.5837	1.0077	1.0038
No log	5.0588	258	0.9524	0.6830	0.9524	0.9759
No log	5.0980	260	0.9257	0.6778	0.9257	0.9621
No log	5.1373	262	0.9370	0.6778	0.9370	0.9680
No log	5.1765	264	0.9844	0.6778	0.9844	0.9922
No log	5.2157	266	1.0118	0.6621	1.0118	1.0059
No log	5.2549	268	1.0270	0.6215	1.0270	1.0134
No log	5.2941	270	1.0245	0.5938	1.0245	1.0122
No log	5.3333	272	0.9800	0.6621	0.9800	0.9899
No log	5.3725	274	0.9306	0.6573	0.9306	0.9647
No log	5.4118	276	0.8613	0.6634	0.8613	0.9281
No log	5.4510	278	0.8437	0.6379	0.8437	0.9185
No log	5.4902	280	0.8544	0.6621	0.8544	0.9244
No log	5.5294	282	0.8711	0.6339	0.8711	0.9333
No log	5.5686	284	0.8213	0.6219	0.8213	0.9063
No log	5.6078	286	0.7643	0.6219	0.7643	0.8742
No log	5.6471	288	0.7251	0.6622	0.7251	0.8515
No log	5.6863	290	0.7271	0.6622	0.7271	0.8527
No log	5.7255	292	0.7289	0.6176	0.7289	0.8537
No log	5.7647	294	0.7395	0.6339	0.7395	0.8599
No log	5.8039	296	0.7693	0.6621	0.7693	0.8771
No log	5.8431	298	0.7736	0.6884	0.7736	0.8795
No log	5.8824	300	0.7579	0.6884	0.7579	0.8706
No log	5.9216	302	0.7440	0.6884	0.7440	0.8625
No log	5.9608	304	0.7490	0.6884	0.7490	0.8655
No log	6.0	306	0.7984	0.6621	0.7984	0.8936
No log	6.0392	308	0.8562	0.5837	0.8562	0.9253
No log	6.0784	310	0.8405	0.6339	0.8405	0.9168
No log	6.1176	312	0.7711	0.6621	0.7711	0.8781
No log	6.1569	314	0.7132	0.7009	0.7132	0.8445
No log	6.1961	316	0.6771	0.7756	0.6771	0.8228
No log	6.2353	318	0.6681	0.7756	0.6681	0.8174
No log	6.2745	320	0.6799	0.7756	0.6799	0.8246
No log	6.3137	322	0.7239	0.7042	0.7239	0.8508
No log	6.3529	324	0.8042	0.6621	0.8042	0.8968
No log	6.3922	326	0.8500	0.6621	0.8500	0.9220
No log	6.4314	328	0.8332	0.6573	0.8332	0.9128
No log	6.4706	330	0.7775	0.6830	0.7775	0.8817
No log	6.5098	332	0.7342	0.7284	0.7342	0.8569
No log	6.5490	334	0.7040	0.7672	0.7040	0.8391
No log	6.5882	336	0.6943	0.7756	0.6943	0.8332
No log	6.6275	338	0.6998	0.7284	0.6998	0.8365
No log	6.6667	340	0.7180	0.6573	0.7180	0.8474
No log	6.7059	342	0.7164	0.6573	0.7164	0.8464
No log	6.7451	344	0.7100	0.6573	0.7100	0.8426
No log	6.7843	346	0.7284	0.6339	0.7284	0.8535
No log	6.8235	348	0.7524	0.6339	0.7524	0.8674
No log	6.8627	350	0.7843	0.6339	0.7843	0.8856
No log	6.9020	352	0.8202	0.6339	0.8202	0.9057
No log	6.9412	354	0.8312	0.6339	0.8312	0.9117
No log	6.9804	356	0.8340	0.6339	0.8340	0.9132
No log	7.0196	358	0.8006	0.6388	0.8006	0.8948
No log	7.0588	360	0.7832	0.6388	0.7832	0.8850
No log	7.0980	362	0.7807	0.6388	0.7807	0.8836
No log	7.1373	364	0.7703	0.6388	0.7703	0.8777
No log	7.1765	366	0.7916	0.6388	0.7916	0.8897
No log	7.2157	368	0.7925	0.6388	0.7925	0.8902
No log	7.2549	370	0.8261	0.6779	0.8261	0.9089
No log	7.2941	372	0.8576	0.6721	0.8576	0.9260
No log	7.3333	374	0.8798	0.7059	0.8798	0.9380
No log	7.3725	376	0.8607	0.6779	0.8607	0.9277
No log	7.4118	378	0.8480	0.6779	0.8480	0.9209
No log	7.4510	380	0.8556	0.6779	0.8556	0.9250
No log	7.4902	382	0.8476	0.6388	0.8476	0.9207
No log	7.5294	384	0.8601	0.6388	0.8601	0.9274
No log	7.5686	386	0.8545	0.6339	0.8545	0.9244
No log	7.6078	388	0.8565	0.6339	0.8565	0.9255
No log	7.6471	390	0.8531	0.6339	0.8531	0.9236
No log	7.6863	392	0.8323	0.6339	0.8323	0.9123
No log	7.7255	394	0.8001	0.6388	0.8001	0.8945
No log	7.7647	396	0.7620	0.6388	0.7620	0.8729
No log	7.8039	398	0.7382	0.6388	0.7382	0.8592
No log	7.8431	400	0.7311	0.7255	0.7311	0.8551
No log	7.8824	402	0.7415	0.6977	0.7415	0.8611
No log	7.9216	404	0.7636	0.6388	0.7636	0.8738
No log	7.9608	406	0.7742	0.6388	0.7742	0.8799
No log	8.0	408	0.7716	0.6907	0.7716	0.8784
No log	8.0392	410	0.7703	0.7178	0.7703	0.8777
No log	8.0784	412	0.7521	0.7255	0.7521	0.8672
No log	8.1176	414	0.7420	0.7182	0.7420	0.8614
No log	8.1569	416	0.7393	0.7182	0.7393	0.8598
No log	8.1961	418	0.7466	0.7255	0.7466	0.8641
No log	8.2353	420	0.7692	0.7178	0.7692	0.8770
No log	8.2745	422	0.7834	0.6907	0.7834	0.8851
No log	8.3137	424	0.7921	0.6841	0.7921	0.8900
No log	8.3529	426	0.7928	0.7106	0.7928	0.8904
No log	8.3922	428	0.7917	0.7178	0.7917	0.8898
No log	8.4314	430	0.7889	0.7178	0.7889	0.8882
No log	8.4706	432	0.7785	0.7178	0.7785	0.8823
No log	8.5098	434	0.7820	0.7178	0.7820	0.8843
No log	8.5490	436	0.7839	0.7178	0.7839	0.8854
No log	8.5882	438	0.7852	0.6677	0.7852	0.8861
No log	8.6275	440	0.7835	0.6677	0.7835	0.8851
No log	8.6667	442	0.7788	0.6388	0.7788	0.8825
No log	8.7059	444	0.7728	0.6388	0.7728	0.8791
No log	8.7451	446	0.7739	0.6388	0.7739	0.8797
No log	8.7843	448	0.7680	0.6388	0.7680	0.8763
No log	8.8235	450	0.7617	0.6907	0.7617	0.8727
No log	8.8627	452	0.7634	0.6907	0.7634	0.8737
No log	8.9020	454	0.7672	0.6907	0.7672	0.8759
No log	8.9412	456	0.7684	0.6907	0.7684	0.8766
No log	8.9804	458	0.7639	0.6907	0.7639	0.8740
No log	9.0196	460	0.7619	0.7178	0.7619	0.8729
No log	9.0588	462	0.7575	0.7178	0.7575	0.8703
No log	9.0980	464	0.7442	0.7110	0.7442	0.8627
No log	9.1373	466	0.7407	0.7110	0.7407	0.8606
No log	9.1765	468	0.7469	0.7110	0.7469	0.8642
No log	9.2157	470	0.7575	0.7434	0.7575	0.8704
No log	9.2549	472	0.7707	0.7434	0.7707	0.8779
No log	9.2941	474	0.7823	0.7264	0.7823	0.8845
No log	9.3333	476	0.7957	0.7579	0.7957	0.8920
No log	9.3725	478	0.8035	0.7579	0.8035	0.8964
No log	9.4118	480	0.8042	0.7123	0.8042	0.8968
No log	9.4510	482	0.8092	0.7123	0.8092	0.8995
No log	9.4902	484	0.8163	0.7123	0.8163	0.9035
No log	9.5294	486	0.8172	0.7123	0.8172	0.9040
No log	9.5686	488	0.8111	0.7123	0.8111	0.9006
No log	9.6078	490	0.8059	0.7123	0.8059	0.8977
No log	9.6471	492	0.8037	0.7123	0.8037	0.8965
No log	9.6863	494	0.8021	0.7123	0.8021	0.8956
No log	9.7255	496	0.7987	0.7579	0.7987	0.8937
No log	9.7647	498	0.7966	0.7579	0.7966	0.8925
0.5449	9.8039	500	0.7946	0.7579	0.7946	0.8914
0.5449	9.8431	502	0.7943	0.7579	0.7943	0.8913
0.5449	9.8824	504	0.7952	0.7579	0.7952	0.8917
0.5449	9.9216	506	0.7958	0.7579	0.7958	0.8921
0.5449	9.9608	508	0.7956	0.7579	0.7956	0.8920
0.5449	10.0	510	0.7954	0.7579	0.7954	0.8919

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Nov 28, 2024
Updated: Nov 28, 2024