ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k15_task1_organization

MayBashendy/ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k15_task1_organization

ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k15_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

59% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 23, 2024
Updated: Dec 23, 2024
SHA: 74fe2615

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k15_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.9040
Qwk: 0.5892
Mse: 0.9040
Rmse: 0.9508

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 16
eval_batch_size: 16
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0526	2	7.9492	-0.0493	7.9492	2.8194
No log	0.1053	4	5.6772	-0.0585	5.6772	2.3827
No log	0.1579	6	3.9528	0.0217	3.9528	1.9882
No log	0.2105	8	2.8222	0.0879	2.8222	1.6799
No log	0.2632	10	2.1072	0.1737	2.1072	1.4516
No log	0.3158	12	1.6262	0.1523	1.6262	1.2752
No log	0.3684	14	1.3343	0.2668	1.3343	1.1551
No log	0.4211	16	1.1911	0.3177	1.1911	1.0914
No log	0.4737	18	1.1075	0.3203	1.1075	1.0524
No log	0.5263	20	1.0466	0.3453	1.0466	1.0230
No log	0.5789	22	1.0334	0.4245	1.0334	1.0165
No log	0.6316	24	1.0670	0.4121	1.0670	1.0330
No log	0.6842	26	1.0184	0.3902	1.0184	1.0091
No log	0.7368	28	0.9933	0.4155	0.9933	0.9966
No log	0.7895	30	0.9953	0.3718	0.9953	0.9976
No log	0.8421	32	1.0053	0.3296	1.0053	1.0026
No log	0.8947	34	0.9600	0.3379	0.9600	0.9798
No log	0.9474	36	0.9110	0.4333	0.9110	0.9544
No log	1.0	38	0.9726	0.4447	0.9726	0.9862
No log	1.0526	40	1.0598	0.3976	1.0598	1.0295
No log	1.1053	42	1.0431	0.4251	1.0431	1.0213
No log	1.1579	44	0.9451	0.4638	0.9451	0.9722
No log	1.2105	46	0.8753	0.5070	0.8753	0.9356
No log	1.2632	48	0.8313	0.6004	0.8313	0.9117
No log	1.3158	50	0.7848	0.6028	0.7848	0.8859
No log	1.3684	52	0.7674	0.6173	0.7674	0.8760
No log	1.4211	54	0.7711	0.6119	0.7711	0.8781
No log	1.4737	56	0.7469	0.5931	0.7469	0.8642
No log	1.5263	58	0.7527	0.6258	0.7527	0.8676
No log	1.5789	60	0.7958	0.6306	0.7958	0.8921
No log	1.6316	62	0.8461	0.6263	0.8461	0.9199
No log	1.6842	64	0.8365	0.6256	0.8365	0.9146
No log	1.7368	66	0.7768	0.6244	0.7768	0.8814
No log	1.7895	68	0.7283	0.5539	0.7283	0.8534
No log	1.8421	70	0.9149	0.4654	0.9149	0.9565
No log	1.8947	72	0.9764	0.4699	0.9764	0.9881
No log	1.9474	74	0.8305	0.5235	0.8305	0.9113
No log	2.0	76	0.7177	0.6055	0.7177	0.8472
No log	2.0526	78	0.7672	0.6534	0.7672	0.8759
No log	2.1053	80	0.7782	0.6473	0.7782	0.8821
No log	2.1579	82	0.7892	0.6523	0.7892	0.8884
No log	2.2105	84	0.7242	0.6293	0.7242	0.8510
No log	2.2632	86	0.7020	0.6404	0.7020	0.8379
No log	2.3158	88	0.6841	0.6202	0.6841	0.8271
No log	2.3684	90	0.6812	0.6654	0.6812	0.8253
No log	2.4211	92	0.7073	0.6429	0.7073	0.8410
No log	2.4737	94	0.8223	0.6121	0.8223	0.9068
No log	2.5263	96	0.8892	0.6027	0.8892	0.9430
No log	2.5789	98	0.8640	0.6415	0.8640	0.9295
No log	2.6316	100	0.7309	0.6344	0.7309	0.8549
No log	2.6842	102	0.6659	0.6309	0.6659	0.8160
No log	2.7368	104	0.6807	0.6171	0.6807	0.8250
No log	2.7895	106	0.6697	0.6400	0.6697	0.8183
No log	2.8421	108	0.6905	0.6358	0.6905	0.8310
No log	2.8947	110	0.7139	0.6351	0.7139	0.8449
No log	2.9474	112	0.7217	0.6195	0.7217	0.8495
No log	3.0	114	0.7832	0.6353	0.7832	0.8850
No log	3.0526	116	0.8904	0.6086	0.8904	0.9436
No log	3.1053	118	0.8502	0.6381	0.8502	0.9221
No log	3.1579	120	0.8203	0.6363	0.8203	0.9057
No log	3.2105	122	0.7330	0.6169	0.7330	0.8562
No log	3.2632	124	0.7103	0.6284	0.7103	0.8428
No log	3.3158	126	0.7147	0.6428	0.7147	0.8454
No log	3.3684	128	0.7134	0.6226	0.7134	0.8446
No log	3.4211	130	0.8020	0.6248	0.8020	0.8955
No log	3.4737	132	0.8808	0.5862	0.8808	0.9385
No log	3.5263	134	0.8212	0.6000	0.8212	0.9062
No log	3.5789	136	0.7666	0.6171	0.7666	0.8756
No log	3.6316	138	0.7053	0.6063	0.7053	0.8398
No log	3.6842	140	0.6999	0.6595	0.6999	0.8366
No log	3.7368	142	0.7192	0.6574	0.7192	0.8481
No log	3.7895	144	0.7102	0.6634	0.7102	0.8428
No log	3.8421	146	0.7165	0.6322	0.7165	0.8464
No log	3.8947	148	0.8332	0.6429	0.8332	0.9128
No log	3.9474	150	0.9172	0.6030	0.9172	0.9577
No log	4.0	152	0.8393	0.6308	0.8393	0.9162
No log	4.0526	154	0.7231	0.6729	0.7231	0.8504
No log	4.1053	156	0.7454	0.6510	0.7454	0.8633
No log	4.1579	158	0.8947	0.5260	0.8947	0.9459
No log	4.2105	160	0.9242	0.4952	0.9242	0.9614
No log	4.2632	162	0.7966	0.5578	0.7966	0.8925
No log	4.3158	164	0.6822	0.6463	0.6822	0.8259
No log	4.3684	166	0.6899	0.6578	0.6899	0.8306
No log	4.4211	168	0.6900	0.6727	0.6900	0.8306
No log	4.4737	170	0.6627	0.6795	0.6627	0.8141
No log	4.5263	172	0.6704	0.6901	0.6704	0.8188
No log	4.5789	174	0.7233	0.6671	0.7233	0.8505
No log	4.6316	176	0.7546	0.6286	0.7546	0.8687
No log	4.6842	178	0.7452	0.6385	0.7452	0.8633
No log	4.7368	180	0.6973	0.7167	0.6973	0.8350
No log	4.7895	182	0.7608	0.6597	0.7608	0.8722
No log	4.8421	184	0.8312	0.6620	0.8312	0.9117
No log	4.8947	186	0.7891	0.6538	0.7891	0.8883
No log	4.9474	188	0.7430	0.6375	0.7430	0.8620
No log	5.0	190	0.7385	0.6671	0.7385	0.8593
No log	5.0526	192	0.7418	0.6639	0.7418	0.8613
No log	5.1053	194	0.7650	0.6572	0.7650	0.8746
No log	5.1579	196	0.8427	0.6387	0.8427	0.9180
No log	5.2105	198	0.8536	0.6484	0.8536	0.9239
No log	5.2632	200	0.7728	0.6435	0.7728	0.8791
No log	5.3158	202	0.7357	0.6492	0.7357	0.8577
No log	5.3684	204	0.8373	0.5721	0.8373	0.9150
No log	5.4211	206	0.8637	0.5592	0.8637	0.9294
No log	5.4737	208	0.7872	0.6252	0.7872	0.8872
No log	5.5263	210	0.7182	0.6752	0.7182	0.8475
No log	5.5789	212	0.7325	0.6692	0.7325	0.8558
No log	5.6316	214	0.7374	0.6532	0.7374	0.8587
No log	5.6842	216	0.7168	0.6957	0.7168	0.8466
No log	5.7368	218	0.7222	0.6900	0.7222	0.8498
No log	5.7895	220	0.7626	0.6363	0.7626	0.8733
No log	5.8421	222	0.7699	0.6215	0.7699	0.8775
No log	5.8947	224	0.7401	0.6261	0.7401	0.8603
No log	5.9474	226	0.7357	0.6790	0.7357	0.8577
No log	6.0	228	0.7387	0.6796	0.7387	0.8595
No log	6.0526	230	0.7498	0.6541	0.7498	0.8659
No log	6.1053	232	0.7406	0.6684	0.7406	0.8606
No log	6.1579	234	0.7325	0.6655	0.7325	0.8559
No log	6.2105	236	0.7246	0.6637	0.7246	0.8513
No log	6.2632	238	0.7072	0.7007	0.7072	0.8410
No log	6.3158	240	0.7270	0.6705	0.7270	0.8526
No log	6.3684	242	0.7233	0.6657	0.7233	0.8505
No log	6.4211	244	0.6974	0.6956	0.6974	0.8351
No log	6.4737	246	0.7228	0.6643	0.7228	0.8502
No log	6.5263	248	0.7575	0.6545	0.7575	0.8704
No log	6.5789	250	0.7658	0.6629	0.7658	0.8751
No log	6.6316	252	0.7698	0.6681	0.7698	0.8774
No log	6.6842	254	0.7747	0.6701	0.7747	0.8802
No log	6.7368	256	0.7733	0.6508	0.7733	0.8794
No log	6.7895	258	0.7892	0.6591	0.7892	0.8884
No log	6.8421	260	0.7751	0.6949	0.7751	0.8804
No log	6.8947	262	0.7755	0.6870	0.7755	0.8806
No log	6.9474	264	0.7979	0.6741	0.7979	0.8932
No log	7.0	266	0.7974	0.6741	0.7974	0.8930
No log	7.0526	268	0.7675	0.6833	0.7675	0.8761
No log	7.1053	270	0.7673	0.6905	0.7673	0.8759
No log	7.1579	272	0.7929	0.6650	0.7929	0.8904
No log	7.2105	274	0.7621	0.7015	0.7621	0.8730
No log	7.2632	276	0.7477	0.6646	0.7477	0.8647
No log	7.3158	278	0.8439	0.5901	0.8439	0.9186
No log	7.3684	280	0.8646	0.5782	0.8646	0.9298
No log	7.4211	282	0.7734	0.6418	0.7734	0.8795
No log	7.4737	284	0.7242	0.7040	0.7242	0.8510
No log	7.5263	286	0.7719	0.6580	0.7719	0.8786
No log	7.5789	288	0.7530	0.6700	0.7530	0.8677
No log	7.6316	290	0.7087	0.7012	0.7087	0.8418
No log	7.6842	292	0.7104	0.6745	0.7104	0.8428
No log	7.7368	294	0.7175	0.6581	0.7175	0.8471
No log	7.7895	296	0.7011	0.6512	0.7011	0.8373
No log	7.8421	298	0.6927	0.6781	0.6927	0.8323
No log	7.8947	300	0.6994	0.6626	0.6994	0.8363
No log	7.9474	302	0.7278	0.6796	0.7278	0.8531
No log	8.0	304	0.7425	0.6831	0.7425	0.8617
No log	8.0526	306	0.7368	0.6738	0.7368	0.8584
No log	8.1053	308	0.7606	0.6697	0.7606	0.8721
No log	8.1579	310	0.8271	0.6235	0.8271	0.9094
No log	8.2105	312	0.8182	0.6407	0.8182	0.9045
No log	8.2632	314	0.7945	0.6419	0.7945	0.8913
No log	8.3158	316	0.7909	0.6555	0.7909	0.8893
No log	8.3684	318	0.7950	0.6586	0.7950	0.8916
No log	8.4211	320	0.8068	0.6706	0.8068	0.8982
No log	8.4737	322	0.8003	0.6809	0.8003	0.8946
No log	8.5263	324	0.7986	0.6792	0.7986	0.8936
No log	8.5789	326	0.7896	0.6845	0.7896	0.8886
No log	8.6316	328	0.8068	0.6788	0.8068	0.8982
No log	8.6842	330	0.7922	0.6774	0.7922	0.8900
No log	8.7368	332	0.7732	0.6919	0.7732	0.8793
No log	8.7895	334	0.7629	0.7016	0.7629	0.8734
No log	8.8421	336	0.7671	0.6978	0.7671	0.8758
No log	8.8947	338	0.7567	0.6997	0.7567	0.8699
No log	8.9474	340	0.7561	0.6997	0.7561	0.8696
No log	9.0	342	0.7812	0.6789	0.7812	0.8839
No log	9.0526	344	0.8402	0.6533	0.8402	0.9166
No log	9.1053	346	0.9315	0.6014	0.9315	0.9651
No log	9.1579	348	0.8989	0.6162	0.8989	0.9481
No log	9.2105	350	0.8179	0.6712	0.8179	0.9044
No log	9.2632	352	0.8065	0.6809	0.8065	0.8981
No log	9.3158	354	0.8207	0.6681	0.8207	0.9059
No log	9.3684	356	0.8127	0.6703	0.8127	0.9015
No log	9.4211	358	0.8244	0.6621	0.8244	0.9079
No log	9.4737	360	0.8043	0.6741	0.8043	0.8968
No log	9.5263	362	0.8010	0.6681	0.8010	0.8950
No log	9.5789	364	0.8333	0.6564	0.8333	0.9128
No log	9.6316	366	0.8942	0.5975	0.8942	0.9456
No log	9.6842	368	0.9018	0.6101	0.9018	0.9496
No log	9.7368	370	0.8378	0.6436	0.8378	0.9153
No log	9.7895	372	0.7993	0.6398	0.7993	0.8940
No log	9.8421	374	0.8162	0.6391	0.8162	0.9034
No log	9.8947	376	0.8628	0.6421	0.8628	0.9289
No log	9.9474	378	0.9670	0.5812	0.9670	0.9834
No log	10.0	380	0.9645	0.6053	0.9645	0.9821
No log	10.0526	382	0.9310	0.6020	0.9310	0.9649
No log	10.1053	384	0.9617	0.6053	0.9617	0.9807
No log	10.1579	386	0.9521	0.5929	0.9521	0.9758
No log	10.2105	388	0.9218	0.6150	0.9218	0.9601
No log	10.2632	390	0.9569	0.6178	0.9569	0.9782
No log	10.3158	392	1.0301	0.5892	1.0301	1.0149
No log	10.3684	394	0.9968	0.6275	0.9968	0.9984
No log	10.4211	396	0.9419	0.6347	0.9419	0.9705
No log	10.4737	398	0.9677	0.6373	0.9677	0.9837
No log	10.5263	400	0.9690	0.6415	0.9690	0.9844
No log	10.5789	402	0.9022	0.6464	0.9022	0.9499
No log	10.6316	404	0.8668	0.6430	0.8668	0.9310
No log	10.6842	406	0.8345	0.6842	0.8345	0.9135
No log	10.7368	408	0.8390	0.6767	0.8390	0.9160
No log	10.7895	410	0.8744	0.6549	0.8744	0.9351
No log	10.8421	412	0.9032	0.6442	0.9032	0.9504
No log	10.8947	414	0.9317	0.6592	0.9317	0.9652
No log	10.9474	416	0.8998	0.6454	0.8998	0.9486
No log	11.0	418	0.8302	0.6783	0.8302	0.9112
No log	11.0526	420	0.8108	0.6652	0.8108	0.9005
No log	11.1053	422	0.8173	0.6713	0.8173	0.9041
No log	11.1579	424	0.8101	0.6607	0.8101	0.9001
No log	11.2105	426	0.8579	0.6362	0.8579	0.9262
No log	11.2632	428	0.8780	0.6362	0.8780	0.9370
No log	11.3158	430	0.8995	0.6362	0.8995	0.9484
No log	11.3684	432	0.8634	0.6314	0.8634	0.9292
No log	11.4211	434	0.8163	0.6662	0.8163	0.9035
No log	11.4737	436	0.8282	0.6642	0.8282	0.9101
No log	11.5263	438	0.8342	0.6600	0.8342	0.9133
No log	11.5789	440	0.8544	0.6544	0.8544	0.9244
No log	11.6316	442	0.9008	0.6244	0.9008	0.9491
No log	11.6842	444	0.9212	0.6270	0.9212	0.9598
No log	11.7368	446	0.9275	0.6270	0.9275	0.9631
No log	11.7895	448	0.9050	0.6220	0.9050	0.9513
No log	11.8421	450	0.8479	0.6386	0.8479	0.9208
No log	11.8947	452	0.8390	0.6401	0.8390	0.9160
No log	11.9474	454	0.8471	0.6252	0.8471	0.9204
No log	12.0	456	0.9107	0.6326	0.9107	0.9543
No log	12.0526	458	1.0111	0.5921	1.0111	1.0055
No log	12.1053	460	1.0124	0.5802	1.0124	1.0062
No log	12.1579	462	0.9272	0.6331	0.9272	0.9629
No log	12.2105	464	0.8412	0.6383	0.8412	0.9172
No log	12.2632	466	0.8124	0.6575	0.8124	0.9013
No log	12.3158	468	0.8186	0.6575	0.8186	0.9048
No log	12.3684	470	0.8026	0.6575	0.8026	0.8959
No log	12.4211	472	0.7751	0.6889	0.7751	0.8804
No log	12.4737	474	0.8006	0.6628	0.8006	0.8948
No log	12.5263	476	0.8389	0.6441	0.8389	0.9159
No log	12.5789	478	0.8414	0.6441	0.8414	0.9173
No log	12.6316	480	0.8447	0.6456	0.8447	0.9191
No log	12.6842	482	0.8305	0.6531	0.8305	0.9113
No log	12.7368	484	0.8382	0.6291	0.8382	0.9155
No log	12.7895	486	0.8722	0.6567	0.8722	0.9339
No log	12.8421	488	0.8655	0.6603	0.8655	0.9303
No log	12.8947	490	0.8399	0.6580	0.8399	0.9164
No log	12.9474	492	0.8239	0.6519	0.8239	0.9077
No log	13.0	494	0.8363	0.6423	0.8363	0.9145
No log	13.0526	496	0.8629	0.6451	0.8629	0.9289
No log	13.1053	498	0.9035	0.6459	0.9035	0.9505
0.6259	13.1579	500	0.9594	0.6260	0.9594	0.9795
0.6259	13.2105	502	0.9528	0.6260	0.9528	0.9761
0.6259	13.2632	504	0.9486	0.6337	0.9486	0.9739
0.6259	13.3158	506	0.9049	0.6368	0.9049	0.9513
0.6259	13.3684	508	0.8434	0.625	0.8434	0.9184
0.6259	13.4211	510	0.8369	0.6372	0.8369	0.9148
0.6259	13.4737	512	0.8843	0.6382	0.8843	0.9404
0.6259	13.5263	514	0.9164	0.6359	0.9164	0.9573
0.6259	13.5789	516	0.8607	0.6212	0.8607	0.9277
0.6259	13.6316	518	0.7921	0.6587	0.7921	0.8900
0.6259	13.6842	520	0.7852	0.6597	0.7852	0.8861
0.6259	13.7368	522	0.8046	0.6379	0.8046	0.8970
0.6259	13.7895	524	0.9286	0.6469	0.9286	0.9636
0.6259	13.8421	526	1.0182	0.5943	1.0182	1.0091
0.6259	13.8947	528	0.9800	0.6174	0.9800	0.9899
0.6259	13.9474	530	0.9365	0.6303	0.9365	0.9677
0.6259	14.0	532	0.8383	0.6230	0.8383	0.9156
0.6259	14.0526	534	0.7982	0.6410	0.7982	0.8934
0.6259	14.1053	536	0.8074	0.6395	0.8074	0.8986
0.6259	14.1579	538	0.8627	0.6146	0.8627	0.9288
0.6259	14.2105	540	0.9183	0.6209	0.9183	0.9583
0.6259	14.2632	542	0.9617	0.6427	0.9617	0.9807
0.6259	14.3158	544	0.9513	0.6359	0.9513	0.9753
0.6259	14.3684	546	0.8700	0.6209	0.8700	0.9327
0.6259	14.4211	548	0.8196	0.6459	0.8196	0.9053
0.6259	14.4737	550	0.8327	0.6324	0.8327	0.9125
0.6259	14.5263	552	0.9237	0.6024	0.9237	0.9611
0.6259	14.5789	554	0.9781	0.6109	0.9781	0.9890
0.6259	14.6316	556	1.0370	0.5858	1.0370	1.0184
0.6259	14.6842	558	1.0118	0.5879	1.0118	1.0059
0.6259	14.7368	560	0.9040	0.5892	0.9040	0.9508

Framework versions

Transformers 4.44.2
Pytorch 2.4.1+cu121
Datasets 3.2.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 23, 2024
Updated: Dec 23, 2024