Arabic_FineTuningAraBERT_AugV5_k10_task5_organization_fold1

MayBashendy/Arabic_FineTuningAraBERT_AugV5_k10_task5_organization_fold1

Arabic_FineTuningAraBERT_AugV5_k10_task5_organization_fold1 is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

17% of all-time downloads

All-time downloads

Public

Parameters

135M

1.1 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Nov 25, 2024
Updated: Nov 25, 2024
SHA: 22f17c9d

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

Arabic_FineTuningAraBERT_AugV5_k10_task5_organization_fold1

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 1.0856
Qwk: 0.4803
Mse: 1.0856
Rmse: 1.0419

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0377	2	2.3186	0.0402	2.3186	1.5227
No log	0.0755	4	1.6353	-0.3115	1.6353	1.2788
No log	0.1132	6	1.3420	0.0	1.3420	1.1585
No log	0.1509	8	1.2157	0.0	1.2157	1.1026
No log	0.1887	10	1.1405	0.0734	1.1405	1.0680
No log	0.2264	12	1.1468	0.0734	1.1468	1.0709
No log	0.2642	14	1.0841	0.0734	1.0841	1.0412
No log	0.3019	16	1.1091	0.0	1.1091	1.0531
No log	0.3396	18	1.0766	0.0734	1.0766	1.0376
No log	0.3774	20	1.0328	0.0734	1.0328	1.0163
No log	0.4151	22	0.9859	0.0	0.9859	0.9929
No log	0.4528	24	0.9682	0.0	0.9682	0.9840
No log	0.4906	26	0.9919	0.2279	0.9919	0.9959
No log	0.5283	28	1.0547	0.2177	1.0547	1.0270
No log	0.5660	30	1.1596	0.3272	1.1596	1.0769
No log	0.6038	32	1.1723	0.3354	1.1723	1.0827
No log	0.6415	34	1.1473	0.3354	1.1473	1.0711
No log	0.6792	36	1.1196	0.3443	1.1196	1.0581
No log	0.7170	38	1.0611	0.2933	1.0611	1.0301
No log	0.7547	40	1.0460	0.2933	1.0460	1.0227
No log	0.7925	42	1.0467	0.2787	1.0467	1.0231
No log	0.8302	44	1.0457	0.3272	1.0457	1.0226
No log	0.8679	46	1.0106	0.2787	1.0106	1.0053
No log	0.9057	48	1.0416	0.2722	1.0416	1.0206
No log	0.9434	50	1.0343	0.2787	1.0343	1.0170
No log	0.9811	52	0.9796	0.2857	0.9796	0.9898
No log	1.0189	54	0.9250	0.2739	0.9250	0.9618
No log	1.0566	56	0.9243	0.4065	0.9243	0.9614
No log	1.0943	58	0.9021	0.4540	0.9021	0.9498
No log	1.1321	60	0.8845	0.3769	0.8845	0.9405
No log	1.1698	62	0.9010	0.4393	0.9010	0.9492
No log	1.2075	64	0.9669	0.4169	0.9669	0.9833
No log	1.2453	66	1.0527	0.4169	1.0527	1.0260
No log	1.2830	68	1.1829	0.3155	1.1829	1.0876
No log	1.3208	70	1.0350	0.4277	1.0350	1.0173
No log	1.3585	72	0.9379	0.4721	0.9379	0.9685
No log	1.3962	74	0.8921	0.4262	0.8921	0.9445
No log	1.4340	76	0.9620	0.4262	0.9620	0.9808
No log	1.4717	78	1.0638	0.4571	1.0638	1.0314
No log	1.5094	80	1.2387	0.2877	1.2387	1.1129
No log	1.5472	82	1.2439	0.2248	1.2439	1.1153
No log	1.5849	84	1.0003	0.4602	1.0003	1.0002
No log	1.6226	86	0.8222	0.3769	0.8222	0.9068
No log	1.6604	88	0.8282	0.4785	0.8282	0.9100
No log	1.6981	90	0.9363	0.2331	0.9363	0.9676
No log	1.7358	92	0.9503	0.2331	0.9503	0.9749
No log	1.7736	94	0.9340	0.2945	0.9340	0.9664
No log	1.8113	96	0.8474	0.4477	0.8474	0.9206
No log	1.8491	98	0.7935	0.4477	0.7935	0.8908
No log	1.8868	100	0.7877	0.4477	0.7877	0.8875
No log	1.9245	102	0.7896	0.4477	0.7896	0.8886
No log	1.9623	104	0.8176	0.4901	0.8176	0.9042
No log	2.0	106	0.8465	0.4199	0.8465	0.9200
No log	2.0377	108	0.8413	0.4901	0.8413	0.9172
No log	2.0755	110	0.7867	0.4901	0.7867	0.8870
No log	2.1132	112	0.7528	0.4901	0.7528	0.8676
No log	2.1509	114	0.7702	0.5856	0.7702	0.8776
No log	2.1887	116	0.7284	0.5856	0.7284	0.8535
No log	2.2264	118	0.6845	0.6429	0.6845	0.8274
No log	2.2642	120	0.7563	0.5856	0.7563	0.8697
No log	2.3019	122	0.9356	0.5	0.9356	0.9673
No log	2.3396	124	1.0601	0.4344	1.0601	1.0296
No log	2.3774	126	0.9744	0.5110	0.9744	0.9871
No log	2.4151	128	0.7771	0.5402	0.7771	0.8815
No log	2.4528	130	0.7730	0.5511	0.7730	0.8792
No log	2.4906	132	0.8096	0.5745	0.8096	0.8998
No log	2.5283	134	0.7998	0.5745	0.7998	0.8943
No log	2.5660	136	0.7750	0.5745	0.7750	0.8804
No log	2.6038	138	0.7989	0.5624	0.7989	0.8938
No log	2.6415	140	0.8364	0.6768	0.8364	0.9146
No log	2.6792	142	0.8250	0.6768	0.8250	0.9083
No log	2.7170	144	0.7587	0.5778	0.7587	0.8710
No log	2.7547	146	0.7382	0.5918	0.7382	0.8592
No log	2.7925	148	0.7704	0.6756	0.7704	0.8777
No log	2.8302	150	0.7771	0.6755	0.7771	0.8815
No log	2.8679	152	0.7963	0.6755	0.7963	0.8923
No log	2.9057	154	0.8090	0.6888	0.8090	0.8995
No log	2.9434	156	0.8027	0.6909	0.8027	0.8959
No log	2.9811	158	0.8173	0.6909	0.8173	0.9040
No log	3.0189	160	0.8210	0.6484	0.8210	0.9061
No log	3.0566	162	0.8161	0.7053	0.8161	0.9034
No log	3.0943	164	0.9287	0.5644	0.9287	0.9637
No log	3.1321	166	0.9910	0.5644	0.9910	0.9955
No log	3.1698	168	0.9515	0.5907	0.9515	0.9755
No log	3.2075	170	1.1217	0.5536	1.1217	1.0591
No log	3.2453	172	1.3223	0.5872	1.3223	1.1499
No log	3.2830	174	1.2050	0.6069	1.2050	1.0977
No log	3.3208	176	1.1388	0.5717	1.1388	1.0671
No log	3.3585	178	1.1460	0.5470	1.1460	1.0705
No log	3.3962	180	1.2067	0.5470	1.2067	1.0985
No log	3.4340	182	1.0534	0.5353	1.0534	1.0263
No log	3.4717	184	0.9610	0.5353	0.9610	0.9803
No log	3.5094	186	0.7681	0.6756	0.7681	0.8764
No log	3.5472	188	0.6953	0.6756	0.6953	0.8338
No log	3.5849	190	0.7083	0.6617	0.7083	0.8416
No log	3.6226	192	0.7368	0.6215	0.7368	0.8584
No log	3.6604	194	0.7776	0.5772	0.7776	0.8818
No log	3.6981	196	0.9709	0.4892	0.9709	0.9854
No log	3.7358	198	1.1194	0.4477	1.1194	1.0580
No log	3.7736	200	1.1539	0.4477	1.1539	1.0742
No log	3.8113	202	1.0563	0.5353	1.0563	1.0278
No log	3.8491	204	1.0345	0.5463	1.0345	1.0171
No log	3.8868	206	0.9816	0.5370	0.9816	0.9907
No log	3.9245	208	1.0387	0.5370	1.0387	1.0191
No log	3.9623	210	1.0343	0.5480	1.0343	1.0170
No log	4.0	212	0.9313	0.5756	0.9313	0.9651
No log	4.0377	214	0.8592	0.6074	0.8592	0.9269
No log	4.0755	216	0.8612	0.6074	0.8612	0.9280
No log	4.1132	218	0.8705	0.6074	0.8705	0.9330
No log	4.1509	220	0.9438	0.6101	0.9438	0.9715
No log	4.1887	222	0.9425	0.6140	0.9425	0.9708
No log	4.2264	224	0.9167	0.6140	0.9167	0.9574
No log	4.2642	226	0.8756	0.6117	0.8756	0.9358
No log	4.3019	228	0.8761	0.5992	0.8761	0.9360
No log	4.3396	230	0.8600	0.5556	0.8600	0.9274
No log	4.3774	232	0.9101	0.5611	0.9101	0.9540
No log	4.4151	234	0.9009	0.5611	0.9009	0.9492
No log	4.4528	236	0.8657	0.5992	0.8657	0.9304
No log	4.4906	238	0.8879	0.5992	0.8879	0.9423
No log	4.5283	240	0.9412	0.6022	0.9412	0.9701
No log	4.5660	242	1.0350	0.5797	1.0350	1.0174
No log	4.6038	244	1.1712	0.5264	1.1712	1.0822
No log	4.6415	246	1.1297	0.5353	1.1297	1.0629
No log	4.6792	248	0.9272	0.6058	0.9272	0.9629
No log	4.7170	250	0.7987	0.6188	0.7987	0.8937
No log	4.7547	252	0.7690	0.6339	0.7690	0.8769
No log	4.7925	254	0.8055	0.6188	0.8055	0.8975
No log	4.8302	256	0.9064	0.6606	0.9064	0.9521
No log	4.8679	258	0.9744	0.5092	0.9744	0.9871
No log	4.9057	260	0.9486	0.5519	0.9486	0.9739
No log	4.9434	262	0.8667	0.6074	0.8667	0.9310
No log	4.9811	264	0.8747	0.6074	0.8747	0.9352
No log	5.0189	266	0.9002	0.6101	0.9002	0.9488
No log	5.0566	268	0.8255	0.6923	0.8255	0.9086
No log	5.0943	270	0.8153	0.6923	0.8153	0.9030
No log	5.1321	272	0.8980	0.5817	0.8980	0.9476
No log	5.1698	274	1.0667	0.4881	1.0667	1.0328
No log	5.2075	276	1.1624	0.4963	1.1624	1.0781
No log	5.2453	278	1.1584	0.4963	1.1584	1.0763
No log	5.2830	280	1.0500	0.4881	1.0500	1.0247
No log	5.3208	282	0.8699	0.6473	0.8699	0.9327
No log	5.3585	284	0.8027	0.6484	0.8027	0.8959
No log	5.3962	286	0.8334	0.6622	0.8334	0.9129
No log	5.4340	288	0.9655	0.5695	0.9655	0.9826
No log	5.4717	290	1.1861	0.4495	1.1861	1.0891
No log	5.5094	292	1.2582	0.4495	1.2582	1.1217
No log	5.5472	294	1.1472	0.4881	1.1472	1.0711
No log	5.5849	296	0.9413	0.5695	0.9413	0.9702
No log	5.6226	298	0.8717	0.5833	0.8717	0.9337
No log	5.6604	300	0.8636	0.5833	0.8636	0.9293
No log	5.6981	302	0.9587	0.5695	0.9587	0.9791
No log	5.7358	304	1.0689	0.4900	1.0689	1.0339
No log	5.7736	306	1.1301	0.4881	1.1301	1.0631
No log	5.8113	308	1.1971	0.5312	1.1971	1.0941
No log	5.8491	310	1.1031	0.4881	1.1031	1.0503
No log	5.8868	312	0.9637	0.5800	0.9637	0.9817
No log	5.9245	314	0.7940	0.6114	0.7940	0.8911
No log	5.9623	316	0.7399	0.6324	0.7399	0.8602
No log	6.0	318	0.7475	0.5970	0.7475	0.8646
No log	6.0377	320	0.8259	0.5991	0.8259	0.9088
No log	6.0755	322	0.9892	0.5546	0.9892	0.9946
No log	6.1132	324	1.1325	0.4328	1.1325	1.0642
No log	6.1509	326	1.1454	0.4195	1.1454	1.0702
No log	6.1887	328	1.0260	0.4881	1.0260	1.0129
No log	6.2264	330	0.8875	0.6086	0.8875	0.9421
No log	6.2642	332	0.7977	0.6468	0.7977	0.8931
No log	6.3019	334	0.7855	0.6632	0.7855	0.8863
No log	6.3396	336	0.8097	0.6336	0.8097	0.8998
No log	6.3774	338	0.9377	0.5370	0.9377	0.9683
No log	6.4151	340	1.1256	0.4881	1.1256	1.0610
No log	6.4528	342	1.2884	0.4965	1.2884	1.1351
No log	6.4906	344	1.2865	0.4965	1.2865	1.1342
No log	6.5283	346	1.1764	0.4881	1.1764	1.0846
No log	6.5660	348	1.0171	0.5370	1.0171	1.0085
No log	6.6038	350	0.8648	0.6468	0.8648	0.9299
No log	6.6415	352	0.8123	0.6061	0.8123	0.9013
No log	6.6792	354	0.8032	0.6061	0.8032	0.8962
No log	6.7170	356	0.8303	0.6336	0.8303	0.9112
No log	6.7547	358	0.8988	0.5695	0.8988	0.9481
No log	6.7925	360	0.9986	0.5264	0.9986	0.9993
No log	6.8302	362	1.1064	0.4803	1.1064	1.0519
No log	6.8679	364	1.1462	0.4881	1.1462	1.0706
No log	6.9057	366	1.1196	0.4803	1.1196	1.0581
No log	6.9434	368	1.0293	0.4803	1.0293	1.0145
No log	6.9811	370	0.9701	0.5264	0.9701	0.9849
No log	7.0189	372	0.9657	0.5577	0.9657	0.9827
No log	7.0566	374	1.0292	0.5264	1.0292	1.0145
No log	7.0943	376	1.0763	0.4803	1.0763	1.0374
No log	7.1321	378	1.1375	0.4803	1.1375	1.0665
No log	7.1698	380	1.1625	0.4803	1.1625	1.0782
No log	7.2075	382	1.1324	0.4803	1.1324	1.0641
No log	7.2453	384	1.0421	0.5907	1.0421	1.0208
No log	7.2830	386	0.9542	0.5992	0.9542	0.9769
No log	7.3208	388	0.9295	0.5992	0.9295	0.9641
No log	7.3585	390	0.9526	0.5992	0.9526	0.9760
No log	7.3962	392	0.9573	0.5817	0.9573	0.9784
No log	7.4340	394	0.9872	0.5817	0.9872	0.9936
No log	7.4717	396	0.9930	0.5519	0.9930	0.9965
No log	7.5094	398	0.9943	0.5519	0.9943	0.9972
No log	7.5472	400	0.9704	0.5519	0.9704	0.9851
No log	7.5849	402	0.9809	0.5519	0.9809	0.9904
No log	7.6226	404	0.9923	0.5577	0.9923	0.9961
No log	7.6604	406	1.0388	0.5085	1.0388	1.0192
No log	7.6981	408	1.1040	0.4803	1.1040	1.0507
No log	7.7358	410	1.1654	0.4881	1.1654	1.0795
No log	7.7736	412	1.1482	0.4881	1.1482	1.0715
No log	7.8113	414	1.1183	0.4803	1.1183	1.0575
No log	7.8491	416	1.0612	0.5085	1.0612	1.0301
No log	7.8868	418	1.0276	0.5085	1.0276	1.0137
No log	7.9245	420	1.0102	0.5085	1.0102	1.0051
No log	7.9623	422	1.0006	0.5370	1.0006	1.0003
No log	8.0	424	0.9574	0.5857	0.9574	0.9784
No log	8.0377	426	0.9558	0.5907	0.9558	0.9777
No log	8.0755	428	0.9646	0.5907	0.9646	0.9821
No log	8.1132	430	0.9327	0.5907	0.9327	0.9658
No log	8.1509	432	0.9229	0.5907	0.9229	0.9607
No log	8.1887	434	0.9478	0.5907	0.9478	0.9736
No log	8.2264	436	0.9926	0.5370	0.9926	0.9963
No log	8.2642	438	1.0118	0.5370	1.0118	1.0059
No log	8.3019	440	1.0012	0.5370	1.0012	1.0006
No log	8.3396	442	0.9905	0.5370	0.9905	0.9952
No log	8.3774	444	0.9953	0.5085	0.9953	0.9977
No log	8.4151	446	0.9820	0.5085	0.9820	0.9910
No log	8.4528	448	0.9385	0.5577	0.9385	0.9688
No log	8.4906	450	0.9170	0.5577	0.9170	0.9576
No log	8.5283	452	0.9244	0.5577	0.9244	0.9615
No log	8.5660	454	0.9529	0.5577	0.9529	0.9762
No log	8.6038	456	1.0120	0.5174	1.0120	1.0060
No log	8.6415	458	1.0615	0.5174	1.0615	1.0303
No log	8.6792	460	1.1033	0.4963	1.1033	1.0504
No log	8.7170	462	1.1362	0.4963	1.1362	1.0659
No log	8.7547	464	1.1363	0.4881	1.1363	1.0660
No log	8.7925	466	1.1013	0.4881	1.1013	1.0495
No log	8.8302	468	1.0575	0.4803	1.0575	1.0284
No log	8.8679	470	1.0167	0.5577	1.0167	1.0083
No log	8.9057	472	0.9668	0.5857	0.9668	0.9833
No log	8.9434	474	0.9323	0.5977	0.9323	0.9655
No log	8.9811	476	0.9260	0.5977	0.9260	0.9623
No log	9.0189	478	0.9265	0.5977	0.9265	0.9625
No log	9.0566	480	0.9479	0.5857	0.9479	0.9736
No log	9.0943	482	0.9713	0.5857	0.9713	0.9855
No log	9.1321	484	1.0008	0.5857	1.0008	1.0004
No log	9.1698	486	1.0128	0.5577	1.0128	1.0064
No log	9.2075	488	1.0119	0.5577	1.0119	1.0059
No log	9.2453	490	1.0046	0.5577	1.0046	1.0023
No log	9.2830	492	0.9837	0.5577	0.9837	0.9918
No log	9.3208	494	0.9622	0.5577	0.9622	0.9809
No log	9.3585	496	0.9579	0.5577	0.9579	0.9787
No log	9.3962	498	0.9688	0.5577	0.9688	0.9843
0.3623	9.4340	500	0.9805	0.5577	0.9805	0.9902
0.3623	9.4717	502	1.0004	0.5577	1.0004	1.0002
0.3623	9.5094	504	1.0240	0.5577	1.0240	1.0119
0.3623	9.5472	506	1.0519	0.5264	1.0519	1.0256
0.3623	9.5849	508	1.0756	0.4803	1.0756	1.0371
0.3623	9.6226	510	1.0839	0.4803	1.0839	1.0411
0.3623	9.6604	512	1.0877	0.4803	1.0877	1.0429
0.3623	9.6981	514	1.0905	0.4803	1.0905	1.0443
0.3623	9.7358	516	1.0958	0.4803	1.0958	1.0468
0.3623	9.7736	518	1.0989	0.4803	1.0989	1.0483
0.3623	9.8113	520	1.0988	0.4803	1.0988	1.0482
0.3623	9.8491	522	1.0949	0.4803	1.0949	1.0464
0.3623	9.8868	524	1.0904	0.4803	1.0904	1.0442
0.3623	9.9245	526	1.0874	0.4803	1.0874	1.0428
0.3623	9.9623	528	1.0860	0.4803	1.0860	1.0421
0.3623	10.0	530	1.0856	0.4803	1.0856	1.0419

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Nov 25, 2024
Updated: Nov 25, 2024