Arabic_FineTuningAraBERT_AugV5_k4_task1_organization_fold0

MayBashendy/Arabic_FineTuningAraBERT_AugV5_k4_task1_organization_fold0

Arabic_FineTuningAraBERT_AugV5_k4_task1_organization_fold0 is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

23% of all-time downloads

All-time downloads

Public

Parameters

135M

1.1 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Nov 18, 2024
Updated: Nov 24, 2024
SHA: a15c7d24

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

Arabic_FineTuningAraBERT_AugV5_k4_task1_organization_fold0

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.6734
Qwk: 0.7427
Mse: 0.6734
Rmse: 0.8206

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0392	2	5.3836	-0.1290	5.3836	2.3203
No log	0.0784	4	2.7455	0.1466	2.7455	1.6569
No log	0.1176	6	1.7583	0.2282	1.7583	1.3260
No log	0.1569	8	1.4652	0.0	1.4652	1.2105
No log	0.1961	10	1.4474	0.0	1.4474	1.2031
No log	0.2353	12	1.5589	0.0	1.5589	1.2486
No log	0.2745	14	1.7112	0.0742	1.7112	1.3081
No log	0.3137	16	1.8068	0.1582	1.8068	1.3442
No log	0.3529	18	1.7587	0.1876	1.7587	1.3262
No log	0.3922	20	1.5165	0.0950	1.5165	1.2315
No log	0.4314	22	1.3720	0.1463	1.3720	1.1713
No log	0.4706	24	1.2697	0.2910	1.2697	1.1268
No log	0.5098	26	1.2050	0.4854	1.2050	1.0977
No log	0.5490	28	1.2425	0.3888	1.2425	1.1147
No log	0.5882	30	1.3064	0.2674	1.3064	1.1430
No log	0.6275	32	1.2777	0.3888	1.2777	1.1304
No log	0.6667	34	1.1544	0.4603	1.1544	1.0744
No log	0.7059	36	1.0943	0.4603	1.0943	1.0461
No log	0.7451	38	1.0040	0.4842	1.0040	1.0020
No log	0.7843	40	0.9295	0.4842	0.9295	0.9641
No log	0.8235	42	0.9330	0.4855	0.9330	0.9659
No log	0.8627	44	1.0598	0.6003	1.0598	1.0295
No log	0.9020	46	1.1433	0.5604	1.1433	1.0692
No log	0.9412	48	1.0182	0.6003	1.0182	1.0091
No log	0.9804	50	0.9470	0.4867	0.9470	0.9731
No log	1.0196	52	1.2819	0.1973	1.2819	1.1322
No log	1.0588	54	1.6069	0.0443	1.6069	1.2676
No log	1.0980	56	1.8741	0.0443	1.8741	1.3690
No log	1.1373	58	2.0367	0.0197	2.0367	1.4271
No log	1.1765	60	1.4110	0.1455	1.4110	1.1878
No log	1.2157	62	0.8351	0.4579	0.8351	0.9138
No log	1.2549	64	0.7726	0.6842	0.7726	0.8790
No log	1.2941	66	0.7635	0.6842	0.7635	0.8738
No log	1.3333	68	0.7722	0.6272	0.7722	0.8788
No log	1.3725	70	0.7916	0.5785	0.7916	0.8897
No log	1.4118	72	0.7462	0.6629	0.7462	0.8638
No log	1.4510	74	0.7408	0.6509	0.7408	0.8607
No log	1.4902	76	0.7563	0.6453	0.7563	0.8697
No log	1.5294	78	0.7787	0.6503	0.7787	0.8824
No log	1.5686	80	0.7399	0.7095	0.7399	0.8602
No log	1.6078	82	0.7395	0.7614	0.7395	0.8600
No log	1.6471	84	0.7472	0.7447	0.7472	0.8644
No log	1.6863	86	0.7819	0.6593	0.7819	0.8842
No log	1.7255	88	1.0190	0.6141	1.0190	1.0094
No log	1.7647	90	1.1069	0.5349	1.1069	1.0521
No log	1.8039	92	0.9724	0.6260	0.9724	0.9861
No log	1.8431	94	0.7958	0.6356	0.7958	0.8921
No log	1.8824	96	0.7435	0.6922	0.7435	0.8623
No log	1.9216	98	0.7415	0.6987	0.7415	0.8611
No log	1.9608	100	0.7545	0.6266	0.7545	0.8686
No log	2.0	102	0.7548	0.6569	0.7548	0.8688
No log	2.0392	104	0.7802	0.6569	0.7802	0.8833
No log	2.0784	106	0.7617	0.7208	0.7617	0.8728
No log	2.1176	108	0.7604	0.7152	0.7604	0.8720
No log	2.1569	110	0.7698	0.7064	0.7698	0.8774
No log	2.1961	112	0.7854	0.7148	0.7854	0.8862
No log	2.2353	114	0.8043	0.7216	0.8043	0.8968
No log	2.2745	116	0.7963	0.6799	0.7963	0.8923
No log	2.3137	118	0.7827	0.6473	0.7827	0.8847
No log	2.3529	120	0.7334	0.7019	0.7334	0.8564
No log	2.3922	122	0.6615	0.7443	0.6615	0.8134
No log	2.4314	124	0.6402	0.7614	0.6402	0.8001
No log	2.4706	126	0.6426	0.6856	0.6426	0.8016
No log	2.5098	128	0.6679	0.7019	0.6679	0.8173
No log	2.5490	130	0.6443	0.7879	0.6443	0.8027
No log	2.5882	132	0.6486	0.7879	0.6486	0.8054
No log	2.6275	134	0.6706	0.7019	0.6706	0.8189
No log	2.6667	136	0.7266	0.6147	0.7266	0.8524
No log	2.7059	138	0.7753	0.5876	0.7753	0.8805
No log	2.7451	140	0.8116	0.6388	0.8116	0.9009
No log	2.7843	142	0.8154	0.6182	0.8154	0.9030
No log	2.8235	144	0.8394	0.6388	0.8394	0.9162
No log	2.8627	146	0.9031	0.6115	0.9031	0.9503
No log	2.9020	148	1.0601	0.5166	1.0601	1.0296
No log	2.9412	150	1.0090	0.5166	1.0090	1.0045
No log	2.9804	152	0.7587	0.6435	0.7587	0.8710
No log	3.0196	154	0.6882	0.7514	0.6882	0.8296
No log	3.0588	156	0.6699	0.7354	0.6699	0.8185
No log	3.0980	158	0.6982	0.7208	0.6982	0.8356
No log	3.1373	160	0.7228	0.7208	0.7228	0.8501
No log	3.1765	162	0.7286	0.6741	0.7286	0.8536
No log	3.2157	164	0.7751	0.6677	0.7751	0.8804
No log	3.2549	166	0.8315	0.6213	0.8315	0.9119
No log	3.2941	168	0.7787	0.6462	0.7787	0.8824
No log	3.3333	170	0.7527	0.7014	0.7527	0.8676
No log	3.3725	172	0.7386	0.7086	0.7386	0.8594
No log	3.4118	174	0.7086	0.6987	0.7086	0.8418
No log	3.4510	176	0.6973	0.6987	0.6973	0.8351
No log	3.4902	178	0.6904	0.7264	0.6904	0.8309
No log	3.5294	180	0.6825	0.7058	0.6825	0.8261
No log	3.5686	182	0.6788	0.6627	0.6788	0.8239
No log	3.6078	184	0.6915	0.6569	0.6915	0.8316
No log	3.6471	186	0.6951	0.6519	0.6951	0.8337
No log	3.6863	188	0.6983	0.6519	0.6983	0.8357
No log	3.7255	190	0.6931	0.7281	0.6931	0.8326
No log	3.7647	192	0.7059	0.6519	0.7059	0.8402
No log	3.8039	194	0.7671	0.5869	0.7671	0.8759
No log	3.8431	196	0.8072	0.6071	0.8072	0.8985
No log	3.8824	198	0.7720	0.6071	0.7720	0.8786
No log	3.9216	200	0.7198	0.6309	0.7198	0.8484
No log	3.9608	202	0.6870	0.6316	0.6870	0.8288
No log	4.0	204	0.6719	0.7354	0.6719	0.8197
No log	4.0392	206	0.6801	0.7090	0.6801	0.8247
No log	4.0784	208	0.6953	0.6272	0.6953	0.8338
No log	4.1176	210	0.7760	0.5589	0.7760	0.8809
No log	4.1569	212	0.9216	0.6071	0.9216	0.9600
No log	4.1961	214	0.9385	0.5889	0.9385	0.9688
No log	4.2353	216	0.8443	0.5563	0.8443	0.9189
No log	4.2745	218	0.7346	0.6015	0.7346	0.8571
No log	4.3137	220	0.6825	0.6871	0.6825	0.8261
No log	4.3529	222	0.6909	0.7090	0.6909	0.8312
No log	4.3922	224	0.7052	0.7281	0.7052	0.8398
No log	4.4314	226	0.7088	0.7090	0.7088	0.8419
No log	4.4706	228	0.7573	0.6802	0.7573	0.8702
No log	4.5098	230	0.8424	0.5903	0.8424	0.9178
No log	4.5490	232	0.8608	0.6339	0.8608	0.9278
No log	4.5882	234	0.8435	0.6339	0.8435	0.9184
No log	4.6275	236	0.7996	0.6266	0.7996	0.8942
No log	4.6667	238	0.7702	0.7019	0.7702	0.8776
No log	4.7059	240	0.7672	0.7365	0.7672	0.8759
No log	4.7451	242	0.8174	0.7452	0.8174	0.9041
No log	4.7843	244	0.8702	0.6916	0.8702	0.9328
No log	4.8235	246	0.8297	0.7696	0.8297	0.9109
No log	4.8627	248	0.7389	0.7692	0.7389	0.8596
No log	4.9020	250	0.7234	0.6684	0.7234	0.8505
No log	4.9412	252	0.7958	0.5903	0.7958	0.8921
No log	4.9804	254	0.9754	0.6201	0.9754	0.9876
No log	5.0196	256	1.0211	0.6201	1.0211	1.0105
No log	5.0588	258	0.9085	0.5563	0.9085	0.9532
No log	5.0980	260	0.7736	0.6866	0.7736	0.8795
No log	5.1373	262	0.7120	0.6856	0.7120	0.8438
No log	5.1765	264	0.7253	0.6200	0.7253	0.8516
No log	5.2157	266	0.7209	0.6200	0.7209	0.8490
No log	5.2549	268	0.7076	0.7090	0.7076	0.8412
No log	5.2941	270	0.7450	0.6866	0.7450	0.8631
No log	5.3333	272	0.8738	0.5973	0.8738	0.9348
No log	5.3725	274	1.0209	0.5563	1.0209	1.0104
No log	5.4118	276	1.0694	0.5374	1.0694	1.0341
No log	5.4510	278	0.9807	0.5563	0.9807	0.9903
No log	5.4902	280	0.8809	0.5563	0.8809	0.9386
No log	5.5294	282	0.8044	0.5973	0.8044	0.8969
No log	5.5686	284	0.7455	0.6866	0.7455	0.8634
No log	5.6078	286	0.7176	0.6802	0.7176	0.8471
No log	5.6471	288	0.7085	0.6802	0.7085	0.8417
No log	5.6863	290	0.7125	0.6866	0.7125	0.8441
No log	5.7255	292	0.7554	0.5973	0.7554	0.8691
No log	5.7647	294	0.7903	0.5973	0.7903	0.8890
No log	5.8039	296	0.8400	0.6038	0.8400	0.9165
No log	5.8431	298	0.8226	0.5973	0.8226	0.9069
No log	5.8824	300	0.7617	0.5973	0.7617	0.8727
No log	5.9216	302	0.7063	0.5973	0.7063	0.8404
No log	5.9608	304	0.6631	0.6363	0.6631	0.8143
No log	6.0	306	0.6546	0.6752	0.6546	0.8091
No log	6.0392	308	0.6529	0.6752	0.6529	0.8080
No log	6.0784	310	0.6534	0.6690	0.6534	0.8083
No log	6.1176	312	0.6565	0.6627	0.6565	0.8102
No log	6.1569	314	0.6591	0.6684	0.6591	0.8119
No log	6.1961	316	0.6759	0.5785	0.6759	0.8221
No log	6.2353	318	0.7101	0.5785	0.7101	0.8427
No log	6.2745	320	0.7351	0.6435	0.7351	0.8574
No log	6.3137	322	0.7604	0.6435	0.7604	0.8720
No log	6.3529	324	0.7849	0.6836	0.7849	0.8859
No log	6.3922	326	0.7914	0.7038	0.7914	0.8896
No log	6.4314	328	0.7511	0.7867	0.7511	0.8667
No log	6.4706	330	0.7465	0.7663	0.7465	0.8640
No log	6.5098	332	0.7488	0.7745	0.7488	0.8654
No log	6.5490	334	0.7429	0.7808	0.7429	0.8619
No log	6.5882	336	0.7406	0.7509	0.7406	0.8606
No log	6.6275	338	0.7587	0.6836	0.7587	0.8711
No log	6.6667	340	0.7755	0.6435	0.7755	0.8806
No log	6.7059	342	0.7792	0.5973	0.7792	0.8827
No log	6.7451	344	0.7523	0.6545	0.7523	0.8673
No log	6.7843	346	0.6829	0.5973	0.6829	0.8264
No log	6.8235	348	0.6398	0.6015	0.6398	0.7999
No log	6.8627	350	0.6258	0.6015	0.6258	0.7911
No log	6.9020	352	0.6241	0.6363	0.6241	0.7900
No log	6.9412	354	0.6251	0.6363	0.6251	0.7906
No log	6.9804	356	0.6366	0.6627	0.6366	0.7979
No log	7.0196	358	0.6516	0.6569	0.6516	0.8072
No log	7.0588	360	0.6647	0.6569	0.6647	0.8153
No log	7.0980	362	0.6866	0.6622	0.6866	0.8286
No log	7.1373	364	0.7071	0.7153	0.7071	0.8409
No log	7.1765	366	0.7019	0.7153	0.7019	0.8378
No log	7.2157	368	0.6819	0.6622	0.6819	0.8258
No log	7.2549	370	0.6617	0.6400	0.6617	0.8134
No log	7.2941	372	0.6668	0.7365	0.6668	0.8166
No log	7.3333	374	0.6786	0.7369	0.6786	0.8238
No log	7.3725	376	0.6754	0.7443	0.6754	0.8218
No log	7.4118	378	0.6610	0.6898	0.6610	0.8130
No log	7.4510	380	0.6561	0.6400	0.6561	0.8100
No log	7.4902	382	0.6651	0.6309	0.6651	0.8155
No log	7.5294	384	0.6942	0.6860	0.6942	0.8332
No log	7.5686	386	0.7294	0.6860	0.7294	0.8541
No log	7.6078	388	0.7519	0.6860	0.7519	0.8671
No log	7.6471	390	0.7724	0.6860	0.7724	0.8789
No log	7.6863	392	0.7696	0.6860	0.7696	0.8773
No log	7.7255	394	0.7541	0.6309	0.7541	0.8684
No log	7.7647	396	0.7438	0.6266	0.7438	0.8624
No log	7.8039	398	0.7288	0.6225	0.7288	0.8537
No log	7.8431	400	0.7200	0.6519	0.7200	0.8485
No log	7.8824	402	0.7102	0.6519	0.7102	0.8428
No log	7.9216	404	0.6991	0.7019	0.6991	0.8361
No log	7.9608	406	0.6925	0.6519	0.6925	0.8322
No log	8.0	408	0.7010	0.6266	0.7010	0.8373
No log	8.0392	410	0.7243	0.6309	0.7243	0.8511
No log	8.0784	412	0.7437	0.6309	0.7437	0.8624
No log	8.1176	414	0.7433	0.6309	0.7433	0.8622
No log	8.1569	416	0.7382	0.6309	0.7382	0.8592
No log	8.1961	418	0.7198	0.6309	0.7198	0.8484
No log	8.2353	420	0.6974	0.6266	0.6974	0.8351
No log	8.2745	422	0.6879	0.6627	0.6879	0.8294
No log	8.3137	424	0.6883	0.6856	0.6883	0.8296
No log	8.3529	426	0.6945	0.6856	0.6945	0.8333
No log	8.3922	428	0.7053	0.7657	0.7053	0.8398
No log	8.4314	430	0.7150	0.7038	0.7150	0.8456
No log	8.4706	432	0.7187	0.7101	0.7187	0.8478
No log	8.5098	434	0.7266	0.7101	0.7266	0.8524
No log	8.5490	436	0.7203	0.7101	0.7203	0.8487
No log	8.5882	438	0.7104	0.7101	0.7104	0.8429
No log	8.6275	440	0.7075	0.7101	0.7075	0.8411
No log	8.6667	442	0.7069	0.7101	0.7069	0.8408
No log	8.7059	444	0.7061	0.7101	0.7061	0.8403
No log	8.7451	446	0.7015	0.7101	0.7015	0.8376
No log	8.7843	448	0.7016	0.7101	0.7016	0.8376
No log	8.8235	450	0.7052	0.7101	0.7052	0.8398
No log	8.8627	452	0.7072	0.7101	0.7072	0.8410
No log	8.9020	454	0.6983	0.7101	0.6983	0.8357
No log	8.9412	456	0.6883	0.7101	0.6883	0.8296
No log	8.9804	458	0.6787	0.7819	0.6787	0.8238
No log	9.0196	460	0.6717	0.7273	0.6717	0.8196
No log	9.0588	462	0.6665	0.7273	0.6665	0.8164
No log	9.0980	464	0.6614	0.6917	0.6614	0.8133
No log	9.1373	466	0.6571	0.6917	0.6571	0.8106
No log	9.1765	468	0.6560	0.6982	0.6560	0.8100
No log	9.2157	470	0.6565	0.7346	0.6565	0.8103
No log	9.2549	472	0.6580	0.7250	0.6580	0.8112
No log	9.2941	474	0.6582	0.7250	0.6582	0.8113
No log	9.3333	476	0.6557	0.7250	0.6557	0.8098
No log	9.3725	478	0.6535	0.7250	0.6535	0.8084
No log	9.4118	480	0.6552	0.7250	0.6552	0.8095
No log	9.4510	482	0.6618	0.7250	0.6618	0.8135
No log	9.4902	484	0.6667	0.7101	0.6667	0.8165
No log	9.5294	486	0.6670	0.7586	0.6670	0.8167
No log	9.5686	488	0.6644	0.7586	0.6644	0.8151
No log	9.6078	490	0.6622	0.7586	0.6622	0.8137
No log	9.6471	492	0.6628	0.7427	0.6628	0.8141
No log	9.6863	494	0.6657	0.7586	0.6657	0.8159
No log	9.7255	496	0.6683	0.7586	0.6683	0.8175
No log	9.7647	498	0.6697	0.7427	0.6697	0.8183
0.4304	9.8039	500	0.6707	0.7427	0.6707	0.8190
0.4304	9.8431	502	0.6709	0.7427	0.6709	0.8191
0.4304	9.8824	504	0.6716	0.7427	0.6716	0.8195
0.4304	9.9216	506	0.6724	0.7427	0.6724	0.8200
0.4304	9.9608	508	0.6730	0.7427	0.6730	0.8204
0.4304	10.0	510	0.6734	0.7427	0.6734	0.8206

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Nov 18, 2024
Updated: Nov 24, 2024