ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k7_task1_organization

MayBashendy/ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k7_task1_organization

ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k7_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

59% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 23, 2024
Updated: Dec 23, 2024
SHA: 4e156932

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k7_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 1.0120
Qwk: 0.5698
Mse: 1.0120
Rmse: 1.0060

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 16
eval_batch_size: 16
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1111	2	7.8763	-0.0494	7.8763	2.8065
No log	0.2222	4	5.5553	-0.0378	5.5553	2.3570
No log	0.3333	6	3.8583	0.0279	3.8583	1.9642
No log	0.4444	8	2.8128	0.1205	2.8128	1.6771
No log	0.5556	10	2.0847	0.1420	2.0847	1.4438
No log	0.6667	12	1.5927	0.1788	1.5927	1.2620
No log	0.7778	14	1.2751	0.3177	1.2751	1.1292
No log	0.8889	16	1.1247	0.3525	1.1247	1.0605
No log	1.0	18	1.0837	0.3141	1.0837	1.0410
No log	1.1111	20	1.0355	0.3169	1.0355	1.0176
No log	1.2222	22	0.9777	0.4432	0.9777	0.9888
No log	1.3333	24	0.9491	0.4631	0.9491	0.9742
No log	1.4444	26	0.9372	0.4709	0.9372	0.9681
No log	1.5556	28	0.9247	0.4971	0.9247	0.9616
No log	1.6667	30	0.9234	0.4872	0.9234	0.9610
No log	1.7778	32	0.9080	0.4947	0.9080	0.9529
No log	1.8889	34	0.9312	0.4648	0.9312	0.9650
No log	2.0	36	0.9407	0.4888	0.9407	0.9699
No log	2.1111	38	0.9842	0.4999	0.9842	0.9921
No log	2.2222	40	1.0404	0.4401	1.0404	1.0200
No log	2.3333	42	1.0181	0.4444	1.0181	1.0090
No log	2.4444	44	0.9569	0.5219	0.9569	0.9782
No log	2.5556	46	1.0180	0.4568	1.0180	1.0089
No log	2.6667	48	1.3390	0.3938	1.3390	1.1571
No log	2.7778	50	1.5447	0.3466	1.5447	1.2429
No log	2.8889	52	1.3690	0.4131	1.3690	1.1700
No log	3.0	54	0.9887	0.4548	0.9887	0.9944
No log	3.1111	56	0.8284	0.5752	0.8284	0.9101
No log	3.2222	58	0.7825	0.5851	0.7825	0.8846
No log	3.3333	60	0.8214	0.5781	0.8214	0.9063
No log	3.4444	62	0.8499	0.5804	0.8499	0.9219
No log	3.5556	64	0.9066	0.5736	0.9066	0.9521
No log	3.6667	66	0.8231	0.5901	0.8231	0.9073
No log	3.7778	68	0.7163	0.5990	0.7163	0.8463
No log	3.8889	70	0.7638	0.5630	0.7638	0.8739
No log	4.0	72	0.8275	0.5478	0.8275	0.9097
No log	4.1111	74	0.8072	0.5284	0.8072	0.8984
No log	4.2222	76	0.7179	0.5860	0.7179	0.8473
No log	4.3333	78	0.7256	0.6177	0.7256	0.8518
No log	4.4444	80	0.6954	0.6350	0.6954	0.8339
No log	4.5556	82	0.6843	0.6172	0.6843	0.8272
No log	4.6667	84	0.6898	0.6335	0.6898	0.8306
No log	4.7778	86	0.6602	0.6282	0.6602	0.8126
No log	4.8889	88	0.6992	0.6605	0.6992	0.8362
No log	5.0	90	0.7311	0.6405	0.7311	0.8551
No log	5.1111	92	0.6860	0.6492	0.6860	0.8283
No log	5.2222	94	0.6893	0.6605	0.6893	0.8303
No log	5.3333	96	0.7808	0.5825	0.7808	0.8836
No log	5.4444	98	0.7666	0.5868	0.7666	0.8756
No log	5.5556	100	0.6832	0.6344	0.6832	0.8266
No log	5.6667	102	0.7211	0.6295	0.7211	0.8492
No log	5.7778	104	0.8189	0.6244	0.8189	0.9050
No log	5.8889	106	0.8167	0.6150	0.8167	0.9037
No log	6.0	108	0.7513	0.6459	0.7513	0.8668
No log	6.1111	110	0.7235	0.6509	0.7235	0.8506
No log	6.2222	112	0.6969	0.6463	0.6969	0.8348
No log	6.3333	114	0.6720	0.6498	0.6720	0.8198
No log	6.4444	116	0.6841	0.6404	0.6841	0.8271
No log	6.5556	118	0.6781	0.6734	0.6781	0.8235
No log	6.6667	120	0.6602	0.6820	0.6602	0.8125
No log	6.7778	122	0.7378	0.6845	0.7378	0.8590
No log	6.8889	124	0.7432	0.6833	0.7432	0.8621
No log	7.0	126	0.6691	0.6919	0.6691	0.8180
No log	7.1111	128	0.6485	0.6952	0.6485	0.8053
No log	7.2222	130	0.6392	0.7165	0.6392	0.7995
No log	7.3333	132	0.6738	0.6639	0.6738	0.8209
No log	7.4444	134	0.6677	0.6844	0.6677	0.8171
No log	7.5556	136	0.6317	0.7190	0.6317	0.7948
No log	7.6667	138	0.6731	0.7014	0.6731	0.8204
No log	7.7778	140	0.6857	0.6797	0.6857	0.8281
No log	7.8889	142	0.6616	0.6973	0.6616	0.8134
No log	8.0	144	0.6470	0.6979	0.6470	0.8044
No log	8.1111	146	0.6884	0.6570	0.6884	0.8297
No log	8.2222	148	0.7153	0.6613	0.7153	0.8458
No log	8.3333	150	0.6840	0.6576	0.6840	0.8271
No log	8.4444	152	0.6952	0.6779	0.6952	0.8338
No log	8.5556	154	0.7040	0.6887	0.7040	0.8391
No log	8.6667	156	0.7001	0.6869	0.7001	0.8367
No log	8.7778	158	0.7108	0.7005	0.7108	0.8431
No log	8.8889	160	0.7228	0.6509	0.7228	0.8502
No log	9.0	162	0.7522	0.6666	0.7522	0.8673
No log	9.1111	164	0.7566	0.6641	0.7566	0.8698
No log	9.2222	166	0.7233	0.6701	0.7233	0.8505
No log	9.3333	168	0.7098	0.6844	0.7098	0.8425
No log	9.4444	170	0.7263	0.6901	0.7263	0.8523
No log	9.5556	172	0.7151	0.6671	0.7151	0.8456
No log	9.6667	174	0.7820	0.6489	0.7820	0.8843
No log	9.7778	176	0.8398	0.6166	0.8398	0.9164
No log	9.8889	178	0.7723	0.6707	0.7723	0.8788
No log	10.0	180	0.7346	0.6955	0.7346	0.8571
No log	10.1111	182	0.7738	0.7046	0.7738	0.8797
No log	10.2222	184	0.7657	0.6721	0.7657	0.8751
No log	10.3333	186	0.7502	0.6987	0.7502	0.8662
No log	10.4444	188	0.7712	0.6603	0.7712	0.8782
No log	10.5556	190	0.7652	0.6562	0.7652	0.8747
No log	10.6667	192	0.7465	0.6908	0.7465	0.8640
No log	10.7778	194	0.7425	0.6809	0.7425	0.8617
No log	10.8889	196	0.7503	0.6798	0.7503	0.8662
No log	11.0	198	0.7517	0.6751	0.7517	0.8670
No log	11.1111	200	0.7497	0.6896	0.7497	0.8658
No log	11.2222	202	0.7550	0.6849	0.7550	0.8689
No log	11.3333	204	0.7744	0.6762	0.7744	0.8800
No log	11.4444	206	0.8335	0.6422	0.8335	0.9130
No log	11.5556	208	0.8233	0.6348	0.8233	0.9074
No log	11.6667	210	0.7867	0.6721	0.7867	0.8869
No log	11.7778	212	0.7856	0.6612	0.7856	0.8863
No log	11.8889	214	0.7822	0.6530	0.7822	0.8844
No log	12.0	216	0.7729	0.6745	0.7729	0.8792
No log	12.1111	218	0.7762	0.6493	0.7762	0.8810
No log	12.2222	220	0.7709	0.6802	0.7709	0.8780
No log	12.3333	222	0.7957	0.6566	0.7957	0.8920
No log	12.4444	224	0.8077	0.6551	0.8077	0.8987
No log	12.5556	226	0.8036	0.6733	0.8036	0.8964
No log	12.6667	228	0.8039	0.6616	0.8039	0.8966
No log	12.7778	230	0.8340	0.6195	0.8340	0.9133
No log	12.8889	232	0.8256	0.6226	0.8256	0.9086
No log	13.0	234	0.8402	0.6265	0.8402	0.9166
No log	13.1111	236	0.8093	0.6505	0.8093	0.8996
No log	13.2222	238	0.8075	0.6704	0.8075	0.8986
No log	13.3333	240	0.8148	0.6246	0.8148	0.9026
No log	13.4444	242	0.8438	0.6018	0.8438	0.9186
No log	13.5556	244	0.8203	0.6195	0.8203	0.9057
No log	13.6667	246	0.8381	0.6588	0.8381	0.9155
No log	13.7778	248	0.9522	0.5577	0.9522	0.9758
No log	13.8889	250	0.9414	0.5739	0.9414	0.9703
No log	14.0	252	0.8267	0.6691	0.8267	0.9092
No log	14.1111	254	0.8301	0.6006	0.8301	0.9111
No log	14.2222	256	0.8424	0.6031	0.8424	0.9178
No log	14.3333	258	0.8214	0.6091	0.8214	0.9063
No log	14.4444	260	0.8221	0.6480	0.8221	0.9067
No log	14.5556	262	0.8381	0.6333	0.8381	0.9155
No log	14.6667	264	0.8527	0.6242	0.8527	0.9234
No log	14.7778	266	0.8854	0.6154	0.8854	0.9409
No log	14.8889	268	0.9070	0.6151	0.9070	0.9524
No log	15.0	270	0.9068	0.6074	0.9068	0.9523
No log	15.1111	272	0.9477	0.5875	0.9477	0.9735
No log	15.2222	274	0.9205	0.6090	0.9205	0.9594
No log	15.3333	276	0.8800	0.5946	0.8800	0.9381
No log	15.4444	278	0.8184	0.6309	0.8184	0.9047
No log	15.5556	280	0.8085	0.6521	0.8085	0.8992
No log	15.6667	282	0.8356	0.6029	0.8356	0.9141
No log	15.7778	284	0.8522	0.5937	0.8522	0.9231
No log	15.8889	286	0.8465	0.6237	0.8465	0.9200
No log	16.0	288	0.8439	0.6237	0.8439	0.9187
No log	16.1111	290	0.8554	0.6108	0.8554	0.9249
No log	16.2222	292	0.8565	0.6148	0.8565	0.9255
No log	16.3333	294	0.8798	0.6176	0.8798	0.9380
No log	16.4444	296	0.8959	0.6176	0.8959	0.9465
No log	16.5556	298	0.8928	0.6162	0.8928	0.9449
No log	16.6667	300	0.8979	0.6212	0.8979	0.9476
No log	16.7778	302	0.9088	0.6125	0.9088	0.9533
No log	16.8889	304	0.8555	0.6345	0.8555	0.9249
No log	17.0	306	0.8285	0.6281	0.8285	0.9102
No log	17.1111	308	0.8662	0.6215	0.8662	0.9307
No log	17.2222	310	0.9733	0.5890	0.9733	0.9865
No log	17.3333	312	1.0128	0.5745	1.0128	1.0064
No log	17.4444	314	0.9266	0.5982	0.9266	0.9626
No log	17.5556	316	0.8667	0.6259	0.8667	0.9310
No log	17.6667	318	0.8672	0.6088	0.8672	0.9312
No log	17.7778	320	0.8804	0.6109	0.8804	0.9383
No log	17.8889	322	0.9103	0.6145	0.9103	0.9541
No log	18.0	324	0.8938	0.6158	0.8938	0.9454
No log	18.1111	326	0.8692	0.6310	0.8692	0.9323
No log	18.2222	328	0.8767	0.6295	0.8767	0.9363
No log	18.3333	330	0.9109	0.6123	0.9109	0.9544
No log	18.4444	332	0.9614	0.5809	0.9614	0.9805
No log	18.5556	334	0.9745	0.5691	0.9745	0.9872
No log	18.6667	336	0.9114	0.6153	0.9114	0.9546
No log	18.7778	338	0.9123	0.6140	0.9123	0.9551
No log	18.8889	340	0.9067	0.6244	0.9067	0.9522
No log	19.0	342	0.9510	0.5525	0.9510	0.9752
No log	19.1111	344	0.9405	0.5876	0.9405	0.9698
No log	19.2222	346	0.9011	0.6330	0.9011	0.9493
No log	19.3333	348	0.9301	0.6042	0.9301	0.9644
No log	19.4444	350	0.9533	0.5911	0.9533	0.9764
No log	19.5556	352	0.9169	0.6042	0.9169	0.9576
No log	19.6667	354	0.9405	0.5867	0.9405	0.9698
No log	19.7778	356	0.9099	0.6063	0.9099	0.9539
No log	19.8889	358	0.9162	0.6063	0.9162	0.9572
No log	20.0	360	0.9442	0.6003	0.9442	0.9717
No log	20.1111	362	0.9797	0.5965	0.9797	0.9898
No log	20.2222	364	1.0260	0.5675	1.0260	1.0129
No log	20.3333	366	0.9625	0.5961	0.9625	0.9811
No log	20.4444	368	0.9475	0.6081	0.9475	0.9734
No log	20.5556	370	0.9322	0.5998	0.9322	0.9655
No log	20.6667	372	0.8888	0.6092	0.8888	0.9428
No log	20.7778	374	0.8872	0.6118	0.8872	0.9419
No log	20.8889	376	0.9243	0.6038	0.9243	0.9614
No log	21.0	378	0.9713	0.5900	0.9713	0.9855
No log	21.1111	380	0.9328	0.6085	0.9328	0.9658
No log	21.2222	382	0.8892	0.6151	0.8892	0.9430
No log	21.3333	384	0.8878	0.6103	0.8878	0.9422
No log	21.4444	386	0.9667	0.6142	0.9667	0.9832
No log	21.5556	388	1.0725	0.5572	1.0725	1.0356
No log	21.6667	390	1.0669	0.5641	1.0669	1.0329
No log	21.7778	392	0.9758	0.5938	0.9758	0.9878
No log	21.8889	394	0.8917	0.6071	0.8917	0.9443
No log	22.0	396	0.9084	0.5803	0.9084	0.9531
No log	22.1111	398	0.9822	0.5787	0.9822	0.9911
No log	22.2222	400	1.0150	0.5730	1.0150	1.0075
No log	22.3333	402	0.9489	0.5867	0.9489	0.9741
No log	22.4444	404	0.9068	0.6063	0.9068	0.9523
No log	22.5556	406	0.9004	0.6161	0.9004	0.9489
No log	22.6667	408	0.9252	0.6199	0.9252	0.9619
No log	22.7778	410	0.9364	0.6191	0.9364	0.9677
No log	22.8889	412	0.9028	0.6148	0.9028	0.9502
No log	23.0	414	0.8709	0.6215	0.8709	0.9332
No log	23.1111	416	0.8812	0.6083	0.8812	0.9387
No log	23.2222	418	0.9255	0.5865	0.9255	0.9620
No log	23.3333	420	0.9246	0.6011	0.9246	0.9616
No log	23.4444	422	0.9504	0.5953	0.9504	0.9749
No log	23.5556	424	0.9553	0.5850	0.9553	0.9774
No log	23.6667	426	0.9995	0.5750	0.9995	0.9997
No log	23.7778	428	1.0271	0.5709	1.0271	1.0135
No log	23.8889	430	0.9958	0.5729	0.9958	0.9979
No log	24.0	432	0.9919	0.5885	0.9919	0.9959
No log	24.1111	434	0.9423	0.6137	0.9423	0.9707
No log	24.2222	436	0.9093	0.6350	0.9093	0.9535
No log	24.3333	438	0.8866	0.6156	0.8866	0.9416
No log	24.4444	440	0.8965	0.6379	0.8965	0.9468
No log	24.5556	442	0.9096	0.6011	0.9096	0.9537
No log	24.6667	444	0.9869	0.5700	0.9869	0.9934
No log	24.7778	446	1.0292	0.5430	1.0292	1.0145
No log	24.8889	448	0.9947	0.5724	0.9947	0.9973
No log	25.0	450	0.9202	0.5875	0.9202	0.9593
No log	25.1111	452	0.9000	0.6209	0.9000	0.9487
No log	25.2222	454	0.9422	0.5864	0.9422	0.9707
No log	25.3333	456	1.0796	0.5705	1.0796	1.0390
No log	25.4444	458	1.1527	0.5404	1.1527	1.0736
No log	25.5556	460	1.0971	0.5461	1.0971	1.0474
No log	25.6667	462	1.0345	0.5609	1.0345	1.0171
No log	25.7778	464	0.9941	0.5792	0.9941	0.9971
No log	25.8889	466	1.0548	0.5810	1.0548	1.0270
No log	26.0	468	1.1179	0.5684	1.1179	1.0573
No log	26.1111	470	1.0893	0.5756	1.0893	1.0437
No log	26.2222	472	1.0116	0.5799	1.0116	1.0058
No log	26.3333	474	0.9798	0.5914	0.9798	0.9898
No log	26.4444	476	0.9784	0.5874	0.9784	0.9891
No log	26.5556	478	0.9901	0.5622	0.9901	0.9950
No log	26.6667	480	1.0781	0.5631	1.0781	1.0383
No log	26.7778	482	1.0798	0.5562	1.0798	1.0391
No log	26.8889	484	1.0063	0.5440	1.0063	1.0032
No log	27.0	486	0.9331	0.5888	0.9331	0.9660
No log	27.1111	488	0.8956	0.5789	0.8956	0.9464
No log	27.2222	490	0.9194	0.5802	0.9194	0.9588
No log	27.3333	492	1.0127	0.5566	1.0127	1.0063
No log	27.4444	494	1.0610	0.5694	1.0610	1.0301
No log	27.5556	496	1.0138	0.5774	1.0138	1.0069
No log	27.6667	498	0.9354	0.6100	0.9354	0.9672
0.5354	27.7778	500	0.9267	0.6047	0.9267	0.9627
0.5354	27.8889	502	0.9653	0.6024	0.9653	0.9825
0.5354	28.0	504	1.0256	0.5918	1.0256	1.0127
0.5354	28.1111	506	1.0574	0.5756	1.0574	1.0283
0.5354	28.2222	508	1.0871	0.5503	1.0871	1.0426
0.5354	28.3333	510	1.0120	0.5698	1.0120	1.0060

Framework versions

Transformers 4.44.2
Pytorch 2.4.1+cu121
Datasets 3.2.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 23, 2024
Updated: Dec 23, 2024