ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k14_task3_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k14_task3_organization

ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k14_task3_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

39% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: 09a5019a

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k14_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.7594
Qwk: 0.1675
Mse: 0.7594
Rmse: 0.8714

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0357	2	3.5317	-0.0066	3.5317	1.8793
No log	0.0714	4	2.0296	-0.0390	2.0296	1.4247
No log	0.1071	6	1.1918	0.0255	1.1918	1.0917
No log	0.1429	8	0.8041	0.0823	0.8041	0.8967
No log	0.1786	10	0.7694	0.0647	0.7694	0.8771
No log	0.2143	12	0.7437	-0.1200	0.7437	0.8624
No log	0.25	14	0.8116	-0.0945	0.8116	0.9009
No log	0.2857	16	0.8989	0.0569	0.8989	0.9481
No log	0.3214	18	0.9873	0.0078	0.9873	0.9936
No log	0.3571	20	0.8649	-0.0333	0.8649	0.9300
No log	0.3929	22	0.6660	0.0638	0.6660	0.8161
No log	0.4286	24	0.6432	0.1407	0.6432	0.8020
No log	0.4643	26	0.6302	0.1206	0.6302	0.7939
No log	0.5	28	0.6194	0.1667	0.6194	0.7870
No log	0.5357	30	0.6390	0.0	0.6390	0.7994
No log	0.5714	32	0.6491	0.0303	0.6491	0.8057
No log	0.6071	34	0.7073	0.1020	0.7073	0.8410
No log	0.6429	36	0.7367	0.0692	0.7367	0.8583
No log	0.6786	38	0.6913	0.0692	0.6913	0.8314
No log	0.7143	40	0.6175	0.0303	0.6175	0.7858
No log	0.75	42	0.5912	0.0388	0.5912	0.7689
No log	0.7857	44	0.5769	0.1111	0.5769	0.7595
No log	0.8214	46	0.5789	0.0569	0.5789	0.7609
No log	0.8571	48	0.7110	0.0	0.7110	0.8432
No log	0.8929	50	0.6431	0.0	0.6431	0.8019
No log	0.9286	52	0.6023	0.1111	0.6023	0.7761
No log	0.9643	54	0.6401	0.1373	0.6401	0.8000
No log	1.0	56	0.6283	0.1667	0.6283	0.7926
No log	1.0357	58	0.6262	0.0725	0.6262	0.7913
No log	1.0714	60	0.6344	0.0	0.6344	0.7965
No log	1.1071	62	0.6145	0.1008	0.6145	0.7839
No log	1.1429	64	0.7006	0.1398	0.7006	0.8370
No log	1.1786	66	0.7229	0.2258	0.7229	0.8502
No log	1.2143	68	0.6249	0.1233	0.6249	0.7905
No log	1.25	70	0.8514	0.1053	0.8514	0.9227
No log	1.2857	72	0.8594	0.0476	0.8594	0.9270
No log	1.3214	74	0.6548	0.0588	0.6548	0.8092
No log	1.3571	76	0.5815	0.1795	0.5815	0.7626
No log	1.3929	78	0.6066	0.2189	0.6066	0.7788
No log	1.4286	80	0.6522	0.1698	0.6522	0.8076
No log	1.4643	82	0.7461	0.1351	0.7461	0.8638
No log	1.5	84	0.7538	0.1111	0.7538	0.8682
No log	1.5357	86	0.7030	0.0210	0.7030	0.8385
No log	1.5714	88	0.7371	0.1020	0.7371	0.8586
No log	1.6071	90	0.7595	0.1617	0.7595	0.8715
No log	1.6429	92	0.8297	0.1832	0.8297	0.9109
No log	1.6786	94	0.8779	0.2239	0.8779	0.9370
No log	1.7143	96	0.8739	0.0435	0.8739	0.9348
No log	1.75	98	0.8602	0.0270	0.8602	0.9275
No log	1.7857	100	0.8873	0.0103	0.8873	0.9420
No log	1.8214	102	0.9588	-0.0467	0.9588	0.9792
No log	1.8571	104	0.9776	-0.0046	0.9776	0.9887
No log	1.8929	106	0.9504	-0.0046	0.9504	0.9749
No log	1.9286	108	0.8335	0.0707	0.8335	0.9129
No log	1.9643	110	0.8517	-0.0653	0.8517	0.9229
No log	2.0	112	0.8528	0.0654	0.8528	0.9235
No log	2.0357	114	0.8318	0.1373	0.8318	0.9120
No log	2.0714	116	0.8282	0.1373	0.8282	0.9101
No log	2.1071	118	0.7255	0.1083	0.7255	0.8518
No log	2.1429	120	0.7105	0.0617	0.7105	0.8429
No log	2.1786	122	0.8191	0.1133	0.8191	0.9051
No log	2.2143	124	0.8457	0.0400	0.8457	0.9196
No log	2.25	126	0.8353	-0.0049	0.8353	0.9140
No log	2.2857	128	0.8003	0.0196	0.8003	0.8946
No log	2.3214	130	0.9645	0.0130	0.9645	0.9821
No log	2.3571	132	1.1352	0.0621	1.1352	1.0654
No log	2.3929	134	1.0602	0.125	1.0602	1.0297
No log	2.4286	136	0.7966	0.1489	0.7966	0.8925
No log	2.4643	138	0.7954	0.1600	0.7954	0.8919
No log	2.5	140	0.7706	0.1414	0.7706	0.8778
No log	2.5357	142	1.1130	0.1111	1.1130	1.0550
No log	2.5714	144	1.2062	0.0915	1.2062	1.0983
No log	2.6071	146	0.9566	0.1020	0.9566	0.9781
No log	2.6429	148	0.6988	0.1746	0.6988	0.8359
No log	2.6786	150	0.6779	0.1828	0.6779	0.8233
No log	2.7143	152	0.8327	0.2381	0.8327	0.9125
No log	2.75	154	1.0415	0.0745	1.0415	1.0206
No log	2.7857	156	0.9804	0.1644	0.9804	0.9901
No log	2.8214	158	0.7296	0.1086	0.7296	0.8541
No log	2.8571	160	0.6696	0.2251	0.6696	0.8183
No log	2.8929	162	0.7711	0.1256	0.7711	0.8781
No log	2.9286	164	0.6437	0.2195	0.6437	0.8023
No log	2.9643	166	0.6532	0.1138	0.6532	0.8082
No log	3.0	168	0.6991	0.1264	0.6991	0.8361
No log	3.0357	170	0.6888	0.0769	0.6888	0.8299
No log	3.0714	172	0.7116	0.0391	0.7116	0.8435
No log	3.1071	174	0.7081	0.0870	0.7081	0.8415
No log	3.1429	176	0.8650	0.1619	0.8650	0.9301
No log	3.1786	178	0.8836	0.1256	0.8836	0.9400
No log	3.2143	180	0.7706	0.1919	0.7706	0.8778
No log	3.25	182	0.6034	0.0920	0.6034	0.7768
No log	3.2857	184	0.6084	0.2663	0.6084	0.7800
No log	3.3214	186	0.5935	0.1373	0.5935	0.7704
No log	3.3571	188	0.7323	0.1515	0.7323	0.8557
No log	3.3929	190	0.9188	0.2000	0.9188	0.9585
No log	3.4286	192	0.8817	0.2000	0.8817	0.9390
No log	3.4643	194	0.7146	0.1233	0.7146	0.8453
No log	3.5	196	0.6117	0.1392	0.6117	0.7821
No log	3.5357	198	0.6927	0.0983	0.6927	0.8323
No log	3.5714	200	0.6375	0.1500	0.6375	0.7984
No log	3.6071	202	0.7089	0.2179	0.7089	0.8419
No log	3.6429	204	0.8308	0.1456	0.8308	0.9115
No log	3.6786	206	0.9443	0.1000	0.9443	0.9717
No log	3.7143	208	0.9224	0.1864	0.9224	0.9604
No log	3.75	210	0.7505	0.0457	0.7505	0.8663
No log	3.7857	212	0.6909	0.1828	0.6909	0.8312
No log	3.8214	214	0.7070	0.1158	0.7070	0.8409
No log	3.8571	216	0.8262	0.1402	0.8262	0.9089
No log	3.8929	218	0.9172	0.1852	0.9172	0.9577
No log	3.9286	220	0.9360	0.1781	0.9360	0.9675
No log	3.9643	222	0.8259	0.1179	0.8259	0.9088
No log	4.0	224	0.8261	0.1416	0.8261	0.9089
No log	4.0357	226	0.9298	0.1538	0.9298	0.9643
No log	4.0714	228	1.2879	0.0173	1.2879	1.1348
No log	4.1071	230	1.5713	-0.0265	1.5713	1.2535
No log	4.1429	232	1.5093	0.0596	1.5093	1.2285
No log	4.1786	234	1.1592	0.0909	1.1592	1.0766
No log	4.2143	236	0.8815	0.1245	0.8815	0.9389
No log	4.25	238	0.8492	0.0769	0.8492	0.9215
No log	4.2857	240	0.8131	0.2332	0.8131	0.9017
No log	4.3214	242	0.9182	0.1429	0.9182	0.9582
No log	4.3571	244	1.0567	0.1562	1.0567	1.0279
No log	4.3929	246	0.9892	0.1545	0.9892	0.9946
No log	4.4286	248	0.7409	0.1658	0.7409	0.8608
No log	4.4643	250	0.6908	0.1163	0.6908	0.8311
No log	4.5	252	0.7196	0.1461	0.7196	0.8483
No log	4.5357	254	0.6623	0.1243	0.6623	0.8138
No log	4.5714	256	0.7273	0.1739	0.7273	0.8528
No log	4.6071	258	0.8337	0.1845	0.8337	0.9131
No log	4.6429	260	0.8625	0.1855	0.8625	0.9287
No log	4.6786	262	0.7623	0.1340	0.7623	0.8731
No log	4.7143	264	0.7021	0.1323	0.7021	0.8379
No log	4.75	266	0.7167	0.1323	0.7167	0.8466
No log	4.7857	268	0.8330	0.2432	0.8330	0.9127
No log	4.8214	270	1.0286	0.1545	1.0286	1.0142
No log	4.8571	272	1.0417	0.1545	1.0417	1.0206
No log	4.8929	274	0.8421	0.2143	0.8421	0.9177
No log	4.9286	276	0.6637	0.2340	0.6637	0.8147
No log	4.9643	278	0.6361	0.2410	0.6361	0.7975
No log	5.0	280	0.6305	0.25	0.6305	0.7940
No log	5.0357	282	0.7186	0.2161	0.7186	0.8477
No log	5.0714	284	0.8610	0.1848	0.8610	0.9279
No log	5.1071	286	0.8768	0.1848	0.8768	0.9364
No log	5.1429	288	0.7306	0.1841	0.7306	0.8548
No log	5.1786	290	0.6081	0.3161	0.6081	0.7798
No log	5.2143	292	0.6102	0.3161	0.6102	0.7811
No log	5.25	294	0.7175	0.2161	0.7175	0.8470
No log	5.2857	296	0.8034	0.2153	0.8034	0.8963
No log	5.3214	298	0.8341	0.2153	0.8341	0.9133
No log	5.3571	300	0.8264	0.2153	0.8264	0.9091
No log	5.3929	302	0.8279	0.2153	0.8279	0.9099
No log	5.4286	304	0.7798	0.2079	0.7798	0.8831
No log	5.4643	306	0.7458	0.2079	0.7458	0.8636
No log	5.5	308	0.7620	0.2464	0.7620	0.8729
No log	5.5357	310	0.8160	0.2442	0.8160	0.9033
No log	5.5714	312	0.9200	0.2389	0.9200	0.9591
No log	5.6071	314	0.9631	0.1803	0.9631	0.9814
No log	5.6429	316	1.0242	0.0977	1.0242	1.0120
No log	5.6786	318	1.0059	0.1496	1.0059	1.0030
No log	5.7143	320	0.9826	0.1475	0.9826	0.9913
No log	5.75	322	0.8949	0.2140	0.8949	0.9460
No log	5.7857	324	0.8920	0.2140	0.8920	0.9445
No log	5.8214	326	0.9752	0.1475	0.9752	0.9875
No log	5.8571	328	1.0409	0.125	1.0409	1.0202
No log	5.8929	330	1.0641	0.1278	1.0641	1.0315
No log	5.9286	332	1.0416	0.0866	1.0416	1.0206
No log	5.9643	334	0.9448	0.1475	0.9448	0.9720
No log	6.0	336	0.8767	0.2146	0.8767	0.9363
No log	6.0357	338	0.8238	0.2075	0.8238	0.9076
No log	6.0714	340	0.7409	0.1220	0.7409	0.8608
No log	6.1071	342	0.7487	0.1619	0.7487	0.8653
No log	6.1429	344	0.8668	0.2070	0.8668	0.9310
No log	6.1786	346	1.0963	0.1882	1.0963	1.0471
No log	6.2143	348	1.1767	0.1615	1.1767	1.0847
No log	6.25	350	1.0624	0.1882	1.0624	1.0307
No log	6.2857	352	0.8768	0.2066	0.8768	0.9364
No log	6.3214	354	0.7537	0.2744	0.7537	0.8682
No log	6.3571	356	0.6914	0.3010	0.6914	0.8315
No log	6.3929	358	0.6912	0.3077	0.6912	0.8314
No log	6.4286	360	0.7243	0.3237	0.7243	0.8511
No log	6.4643	362	0.7217	0.2871	0.7217	0.8495
No log	6.5	364	0.7179	0.2871	0.7179	0.8473
No log	6.5357	366	0.6474	0.3010	0.6474	0.8046
No log	6.5714	368	0.6425	0.3035	0.6425	0.8015
No log	6.6071	370	0.7025	0.2871	0.7025	0.8381
No log	6.6429	372	0.8308	0.2217	0.8308	0.9115
No log	6.6786	374	0.8834	0.1861	0.8834	0.9399
No log	6.7143	376	0.7860	0.2233	0.7860	0.8866
No log	6.75	378	0.7365	0.2153	0.7365	0.8582
No log	6.7857	380	0.7049	0.2549	0.7049	0.8396
No log	6.8214	382	0.6699	0.2000	0.6699	0.8185
No log	6.8571	384	0.6944	0.3237	0.6944	0.8333
No log	6.8929	386	0.7527	0.2233	0.7527	0.8676
No log	6.9286	388	0.8711	0.2217	0.8711	0.9333
No log	6.9643	390	0.9149	0.2287	0.9149	0.9565
No log	7.0	392	0.9011	0.2217	0.9011	0.9492
No log	7.0357	394	0.7766	0.2607	0.7766	0.8812
No log	7.0714	396	0.6585	0.2821	0.6585	0.8115
No log	7.1071	398	0.6475	0.2821	0.6475	0.8047
No log	7.1429	400	0.6927	0.3143	0.6927	0.8323
No log	7.1786	402	0.8016	0.2607	0.8016	0.8953
No log	7.2143	404	0.9118	0.1858	0.9118	0.9549
No log	7.25	406	1.0066	0.0958	1.0066	1.0033
No log	7.2857	408	1.0198	0.0958	1.0198	1.0099
No log	7.3214	410	0.9015	0.1464	0.9015	0.9494
No log	7.3571	412	0.7543	0.2744	0.7543	0.8685
No log	7.3929	414	0.6860	0.2323	0.6860	0.8282
No log	7.4286	416	0.6730	0.3439	0.6730	0.8203
No log	7.4643	418	0.6848	0.2323	0.6848	0.8275
No log	7.5	420	0.7869	0.2830	0.7869	0.8871
No log	7.5357	422	0.9555	0.1790	0.9555	0.9775
No log	7.5714	424	1.1302	0.0813	1.1302	1.0631
No log	7.6071	426	1.1679	-0.0169	1.1679	1.0807
No log	7.6429	428	1.1033	0.0491	1.1033	1.0504
No log	7.6786	430	0.9768	0.0795	0.9768	0.9883
No log	7.7143	432	0.8213	0.2153	0.8213	0.9063
No log	7.75	434	0.7137	0.24	0.7137	0.8448
No log	7.7857	436	0.6800	0.3089	0.6800	0.8246
No log	7.8214	438	0.6735	0.3118	0.6735	0.8207
No log	7.8571	440	0.6905	0.2421	0.6905	0.8310
No log	7.8929	442	0.7378	0.2079	0.7378	0.8589
No log	7.9286	444	0.8089	0.2153	0.8089	0.8994
No log	7.9643	446	0.8241	0.2153	0.8241	0.9078
No log	8.0	448	0.8122	0.2153	0.8122	0.9012
No log	8.0357	450	0.8387	0.2150	0.8387	0.9158
No log	8.0714	452	0.8245	0.2153	0.8245	0.9080
No log	8.1071	454	0.8062	0.2153	0.8062	0.8979
No log	8.1429	456	0.7944	0.2464	0.7944	0.8913
No log	8.1786	458	0.8078	0.2830	0.8078	0.8988
No log	8.2143	460	0.8106	0.2464	0.8106	0.9003
No log	8.25	462	0.8017	0.2464	0.8017	0.8954
No log	8.2857	464	0.8070	0.2464	0.8070	0.8983
No log	8.3214	466	0.8402	0.2830	0.8402	0.9166
No log	8.3571	468	0.8501	0.3180	0.8501	0.9220
No log	8.3929	470	0.8605	0.3180	0.8605	0.9277
No log	8.4286	472	0.8582	0.2523	0.8582	0.9264
No log	8.4643	474	0.8698	0.2523	0.8698	0.9327
No log	8.5	476	0.8774	0.2523	0.8774	0.9367
No log	8.5357	478	0.8839	0.2523	0.8839	0.9402
No log	8.5714	480	0.8569	0.2523	0.8569	0.9257
No log	8.6071	482	0.8188	0.2464	0.8188	0.9049
No log	8.6429	484	0.8104	0.2464	0.8104	0.9002
No log	8.6786	486	0.7837	0.2464	0.7837	0.8853
No log	8.7143	488	0.7636	0.2079	0.7636	0.8738
No log	8.75	490	0.7500	0.2079	0.7500	0.8660
No log	8.7857	492	0.7467	0.2079	0.7467	0.8641
No log	8.8214	494	0.7566	0.2079	0.7566	0.8698
No log	8.8571	496	0.7722	0.1357	0.7722	0.8788
No log	8.8929	498	0.7723	0.1765	0.7723	0.8788
0.4282	8.9286	500	0.7970	0.1765	0.7970	0.8928
0.4282	8.9643	502	0.8150	0.2153	0.8150	0.9028
0.4282	9.0	504	0.8090	0.1765	0.8090	0.8995
0.4282	9.0357	506	0.7905	0.1765	0.7905	0.8891
0.4282	9.0714	508	0.7894	0.1765	0.7894	0.8885
0.4282	9.1071	510	0.8022	0.2523	0.8022	0.8957
0.4282	9.1429	512	0.8069	0.2523	0.8069	0.8983
0.4282	9.1786	514	0.8094	0.2523	0.8094	0.8997
0.4282	9.2143	516	0.8133	0.2523	0.8133	0.9018
0.4282	9.25	518	0.8144	0.2523	0.8144	0.9025
0.4282	9.2857	520	0.8069	0.2153	0.8069	0.8983
0.4282	9.3214	522	0.7888	0.1675	0.7888	0.8881
0.4282	9.3571	524	0.7634	0.1675	0.7634	0.8738
0.4282	9.3929	526	0.7494	0.1675	0.7494	0.8657
0.4282	9.4286	528	0.7514	0.1675	0.7514	0.8668
0.4282	9.4643	530	0.7605	0.1675	0.7605	0.8721
0.4282	9.5	532	0.7741	0.1675	0.7741	0.8798
0.4282	9.5357	534	0.7937	0.2079	0.7937	0.8909
0.4282	9.5714	536	0.8015	0.2464	0.8015	0.8953
0.4282	9.6071	538	0.8123	0.2523	0.8123	0.9013
0.4282	9.6429	540	0.8163	0.2523	0.8163	0.9035
0.4282	9.6786	542	0.8131	0.2523	0.8131	0.9017
0.4282	9.7143	544	0.8017	0.2464	0.8017	0.8954
0.4282	9.75	546	0.7925	0.2464	0.7925	0.8902
0.4282	9.7857	548	0.7860	0.1675	0.7860	0.8866
0.4282	9.8214	550	0.7791	0.1675	0.7791	0.8827
0.4282	9.8571	552	0.7737	0.1675	0.7737	0.8796
0.4282	9.8929	554	0.7671	0.1675	0.7671	0.8759
0.4282	9.9286	556	0.7627	0.1675	0.7627	0.8733
0.4282	9.9643	558	0.7605	0.1675	0.7605	0.8721
0.4282	10.0	560	0.7594	0.1675	0.7594	0.8714

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024