ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k16_task5_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k16_task5_organization

ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k16_task5_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

42% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: 3fa34e43

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k16_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.9219
Qwk: 0.6431
Mse: 0.9219
Rmse: 0.9602

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0408	2	2.2517	-0.0109	2.2517	1.5006
No log	0.0816	4	1.6953	0.1293	1.6953	1.3021
No log	0.1224	6	1.7006	0.0406	1.7006	1.3041
No log	0.1633	8	1.6042	0.1757	1.6042	1.2666
No log	0.2041	10	1.7129	0.2613	1.7129	1.3088
No log	0.2449	12	1.5557	0.2380	1.5557	1.2473
No log	0.2857	14	1.3558	0.1543	1.3558	1.1644
No log	0.3265	16	1.3300	0.1453	1.3300	1.1533
No log	0.3673	18	1.3271	0.1588	1.3271	1.1520
No log	0.4082	20	1.4514	0.2564	1.4514	1.2047
No log	0.4490	22	1.7220	0.3383	1.7220	1.3123
No log	0.4898	24	2.0191	0.2910	2.0191	1.4210
No log	0.5306	26	2.1194	0.2710	2.1194	1.4558
No log	0.5714	28	2.2202	0.2051	2.2202	1.4900
No log	0.6122	30	2.2114	0.2175	2.2114	1.4871
No log	0.6531	32	2.3176	0.1815	2.3176	1.5224
No log	0.6939	34	1.9249	0.2803	1.9249	1.3874
No log	0.7347	36	1.5368	0.3308	1.5368	1.2397
No log	0.7755	38	1.5483	0.3615	1.5483	1.2443
No log	0.8163	40	1.8886	0.3175	1.8886	1.3743
No log	0.8571	42	2.4422	0.1666	2.4422	1.5628
No log	0.8980	44	2.3507	0.2027	2.3507	1.5332
No log	0.9388	46	1.6553	0.3382	1.6553	1.2866
No log	0.9796	48	1.1623	0.4116	1.1623	1.0781
No log	1.0204	50	1.0911	0.3987	1.0911	1.0445
No log	1.0612	52	1.1483	0.4374	1.1483	1.0716
No log	1.1020	54	1.4727	0.3966	1.4727	1.2136
No log	1.1429	56	1.7913	0.3679	1.7913	1.3384
No log	1.1837	58	1.6996	0.4210	1.6996	1.3037
No log	1.2245	60	1.2704	0.4416	1.2704	1.1271
No log	1.2653	62	0.9503	0.5612	0.9503	0.9748
No log	1.3061	64	0.9150	0.5971	0.9150	0.9566
No log	1.3469	66	0.9063	0.6194	0.9063	0.9520
No log	1.3878	68	1.2204	0.5017	1.2204	1.1047
No log	1.4286	70	1.8358	0.3502	1.8358	1.3549
No log	1.4694	72	1.9915	0.2951	1.9915	1.4112
No log	1.5102	74	2.1528	0.2890	2.1528	1.4672
No log	1.5510	76	1.8715	0.3795	1.8715	1.3680
No log	1.5918	78	1.4727	0.4337	1.4727	1.2136
No log	1.6327	80	1.2341	0.5086	1.2341	1.1109
No log	1.6735	82	1.3192	0.4843	1.3192	1.1486
No log	1.7143	84	1.6910	0.4796	1.6910	1.3004
No log	1.7551	86	2.1240	0.4014	2.1240	1.4574
No log	1.7959	88	2.0834	0.4052	2.0834	1.4434
No log	1.8367	90	1.5730	0.5042	1.5730	1.2542
No log	1.8776	92	1.1247	0.5086	1.1247	1.0605
No log	1.9184	94	0.9486	0.5386	0.9486	0.9739
No log	1.9592	96	0.9576	0.5517	0.9576	0.9786
No log	2.0	98	1.0426	0.5560	1.0426	1.0211
No log	2.0408	100	1.0795	0.5520	1.0795	1.0390
No log	2.0816	102	0.9380	0.5998	0.9380	0.9685
No log	2.1224	104	0.7210	0.6840	0.7210	0.8491
No log	2.1633	106	0.6523	0.7009	0.6523	0.8077
No log	2.2041	108	0.6374	0.6951	0.6374	0.7984
No log	2.2449	110	0.6625	0.7475	0.6625	0.8139
No log	2.2857	112	0.8197	0.7001	0.8197	0.9054
No log	2.3265	114	0.9219	0.6275	0.9219	0.9601
No log	2.3673	116	0.8479	0.6774	0.8479	0.9208
No log	2.4082	118	0.7576	0.7170	0.7576	0.8704
No log	2.4490	120	0.8084	0.6873	0.8084	0.8991
No log	2.4898	122	0.9556	0.6202	0.9556	0.9775
No log	2.5306	124	1.0627	0.6167	1.0627	1.0309
No log	2.5714	126	1.0529	0.6166	1.0529	1.0261
No log	2.6122	128	0.9145	0.6349	0.9145	0.9563
No log	2.6531	130	0.7934	0.6773	0.7934	0.8907
No log	2.6939	132	0.7793	0.6923	0.7793	0.8828
No log	2.7347	134	0.8626	0.6862	0.8626	0.9288
No log	2.7755	136	1.1282	0.6197	1.1282	1.0622
No log	2.8163	138	1.3495	0.5638	1.3495	1.1617
No log	2.8571	140	1.3149	0.5646	1.3149	1.1467
No log	2.8980	142	1.3230	0.5655	1.3230	1.1502
No log	2.9388	144	1.2775	0.5802	1.2775	1.1303
No log	2.9796	146	1.1482	0.5968	1.1482	1.0715
No log	3.0204	148	0.9923	0.6114	0.9923	0.9961
No log	3.0612	150	0.9213	0.6520	0.9213	0.9598
No log	3.1020	152	1.0500	0.6205	1.0500	1.0247
No log	3.1429	154	1.4176	0.5540	1.4176	1.1906
No log	3.1837	156	1.5713	0.5222	1.5713	1.2535
No log	3.2245	158	1.4595	0.5436	1.4595	1.2081
No log	3.2653	160	1.2277	0.6012	1.2277	1.1080
No log	3.3061	162	1.1287	0.6180	1.1287	1.0624
No log	3.3469	164	1.2270	0.5726	1.2270	1.1077
No log	3.3878	166	1.4720	0.5186	1.4720	1.2133
No log	3.4286	168	1.6759	0.5095	1.6759	1.2946
No log	3.4694	170	1.6418	0.5204	1.6418	1.2813
No log	3.5102	172	1.4078	0.5235	1.4078	1.1865
No log	3.5510	174	1.1488	0.5536	1.1488	1.0718
No log	3.5918	176	1.0035	0.6357	1.0035	1.0017
No log	3.6327	178	0.9671	0.6488	0.9671	0.9834
No log	3.6735	180	1.0521	0.6059	1.0521	1.0257
No log	3.7143	182	1.2058	0.5696	1.2058	1.0981
No log	3.7551	184	1.5011	0.5290	1.5011	1.2252
No log	3.7959	186	1.7002	0.5003	1.7002	1.3039
No log	3.8367	188	1.6637	0.4910	1.6637	1.2898
No log	3.8776	190	1.4585	0.5120	1.4585	1.2077
No log	3.9184	192	1.2002	0.5422	1.2002	1.0955
No log	3.9592	194	0.9734	0.6500	0.9734	0.9866
No log	4.0	196	0.8762	0.6939	0.8762	0.9360
No log	4.0408	198	0.8753	0.6925	0.8753	0.9356
No log	4.0816	200	0.9712	0.6706	0.9712	0.9855
No log	4.1224	202	1.1272	0.5871	1.1272	1.0617
No log	4.1633	204	1.2419	0.5382	1.2419	1.1144
No log	4.2041	206	1.1952	0.5478	1.1952	1.0933
No log	4.2449	208	1.0579	0.6257	1.0579	1.0285
No log	4.2857	210	0.9114	0.6748	0.9114	0.9547
No log	4.3265	212	0.8435	0.6925	0.8435	0.9184
No log	4.3673	214	0.8120	0.7009	0.8120	0.9011
No log	4.4082	216	0.7954	0.7171	0.7954	0.8919
No log	4.4490	218	0.7859	0.7112	0.7859	0.8865
No log	4.4898	220	0.8650	0.6856	0.8650	0.9300
No log	4.5306	222	0.9833	0.6467	0.9833	0.9916
No log	4.5714	224	0.9465	0.6571	0.9465	0.9729
No log	4.6122	226	0.8594	0.6720	0.8594	0.9270
No log	4.6531	228	0.7856	0.7130	0.7856	0.8863
No log	4.6939	230	0.7890	0.7130	0.7890	0.8882
No log	4.7347	232	0.7721	0.7256	0.7721	0.8787
No log	4.7755	234	0.7369	0.7096	0.7369	0.8584
No log	4.8163	236	0.7678	0.7157	0.7678	0.8763
No log	4.8571	238	0.8363	0.6713	0.8363	0.9145
No log	4.8980	240	0.9753	0.6303	0.9753	0.9876
No log	4.9388	242	1.1105	0.6108	1.1105	1.0538
No log	4.9796	244	1.0969	0.6099	1.0969	1.0473
No log	5.0204	246	1.0194	0.6347	1.0194	1.0097
No log	5.0612	248	0.9140	0.6456	0.9140	0.9561
No log	5.1020	250	0.8529	0.6602	0.8529	0.9236
No log	5.1429	252	0.8488	0.6723	0.8488	0.9213
No log	5.1837	254	0.8823	0.6663	0.8823	0.9393
No log	5.2245	256	0.9499	0.6477	0.9499	0.9746
No log	5.2653	258	0.9735	0.6498	0.9735	0.9867
No log	5.3061	260	1.0294	0.6289	1.0294	1.0146
No log	5.3469	262	1.0518	0.6288	1.0518	1.0256
No log	5.3878	264	0.9528	0.6455	0.9528	0.9761
No log	5.4286	266	0.8648	0.6864	0.8648	0.9299
No log	5.4694	268	0.8167	0.7201	0.8167	0.9037
No log	5.5102	270	0.8422	0.7037	0.8422	0.9177
No log	5.5510	272	0.8824	0.6809	0.8824	0.9394
No log	5.5918	274	0.9441	0.6571	0.9441	0.9717
No log	5.6327	276	1.0353	0.6327	1.0353	1.0175
No log	5.6735	278	1.1401	0.5865	1.1401	1.0678
No log	5.7143	280	1.2253	0.5795	1.2253	1.1069
No log	5.7551	282	1.2049	0.5696	1.2049	1.0977
No log	5.7959	284	1.0913	0.6183	1.0913	1.0446
No log	5.8367	286	0.9959	0.6314	0.9959	0.9979
No log	5.8776	288	0.9627	0.6376	0.9627	0.9812
No log	5.9184	290	0.9038	0.6434	0.9038	0.9507
No log	5.9592	292	0.8834	0.6553	0.8834	0.9399
No log	6.0	294	0.8665	0.6903	0.8665	0.9308
No log	6.0408	296	0.9184	0.6488	0.9184	0.9583
No log	6.0816	298	1.0235	0.6280	1.0235	1.0117
No log	6.1224	300	1.0424	0.6280	1.0424	1.0210
No log	6.1633	302	0.9663	0.6540	0.9663	0.9830
No log	6.2041	304	0.8549	0.6923	0.8549	0.9246
No log	6.2449	306	0.8273	0.7134	0.8273	0.9096
No log	6.2857	308	0.8305	0.6965	0.8305	0.9113
No log	6.3265	310	0.8323	0.6965	0.8323	0.9123
No log	6.3673	312	0.8605	0.6806	0.8605	0.9276
No log	6.4082	314	0.8445	0.6756	0.8445	0.9190
No log	6.4490	316	0.8646	0.6569	0.8646	0.9298
No log	6.4898	318	0.9042	0.6370	0.9042	0.9509
No log	6.5306	320	0.9230	0.6370	0.9230	0.9607
No log	6.5714	322	0.8922	0.6621	0.8922	0.9445
No log	6.6122	324	0.8736	0.6739	0.8736	0.9347
No log	6.6531	326	0.8360	0.7015	0.8360	0.9143
No log	6.6939	328	0.8521	0.7026	0.8521	0.9231
No log	6.7347	330	0.9142	0.7026	0.9142	0.9561
No log	6.7755	332	0.9689	0.6498	0.9689	0.9843
No log	6.8163	334	0.9832	0.6498	0.9832	0.9915
No log	6.8571	336	0.9412	0.6807	0.9412	0.9702
No log	6.8980	338	0.8640	0.6975	0.8640	0.9295
No log	6.9388	340	0.8285	0.7044	0.8285	0.9102
No log	6.9796	342	0.8456	0.6898	0.8456	0.9196
No log	7.0204	344	0.9017	0.6514	0.9017	0.9496
No log	7.0612	346	0.8984	0.6503	0.8984	0.9478
No log	7.1020	348	0.8606	0.6731	0.8606	0.9277
No log	7.1429	350	0.8083	0.6795	0.8083	0.8990
No log	7.1837	352	0.7860	0.7046	0.7860	0.8865
No log	7.2245	354	0.8029	0.6902	0.8029	0.8960
No log	7.2653	356	0.8542	0.6862	0.8542	0.9242
No log	7.3061	358	0.9265	0.6505	0.9265	0.9625
No log	7.3469	360	0.9530	0.6419	0.9530	0.9762
No log	7.3878	362	0.9446	0.6419	0.9446	0.9719
No log	7.4286	364	0.9255	0.6530	0.9255	0.9620
No log	7.4694	366	0.8728	0.6807	0.8728	0.9343
No log	7.5102	368	0.8314	0.7134	0.8314	0.9118
No log	7.5510	370	0.7891	0.7254	0.7891	0.8883
No log	7.5918	372	0.7780	0.7393	0.7780	0.8820
No log	7.6327	374	0.8042	0.7254	0.8042	0.8968
No log	7.6735	376	0.8385	0.6975	0.8385	0.9157
No log	7.7143	378	0.8692	0.6919	0.8692	0.9323
No log	7.7551	380	0.8779	0.6879	0.8779	0.9370
No log	7.7959	382	0.8712	0.6946	0.8712	0.9334
No log	7.8367	384	0.8774	0.6821	0.8774	0.9367
No log	7.8776	386	0.9128	0.6647	0.9128	0.9554
No log	7.9184	388	0.9509	0.6314	0.9509	0.9752
No log	7.9592	390	0.9689	0.6314	0.9689	0.9843
No log	8.0	392	0.9653	0.6314	0.9653	0.9825
No log	8.0408	394	0.9301	0.6314	0.9301	0.9644
No log	8.0816	396	0.8868	0.6488	0.8868	0.9417
No log	8.1224	398	0.8749	0.6697	0.8749	0.9354
No log	8.1633	400	0.8900	0.6461	0.8900	0.9434
No log	8.2041	402	0.9064	0.6314	0.9064	0.9520
No log	8.2449	404	0.9199	0.6314	0.9199	0.9591
No log	8.2857	406	0.9047	0.6342	0.9047	0.9512
No log	8.3265	408	0.8641	0.6714	0.8641	0.9296
No log	8.3673	410	0.8332	0.6826	0.8332	0.9128
No log	8.4082	412	0.8270	0.7019	0.8270	0.9094
No log	8.4490	414	0.8337	0.6976	0.8337	0.9131
No log	8.4898	416	0.8403	0.6826	0.8403	0.9167
No log	8.5306	418	0.8662	0.6783	0.8662	0.9307
No log	8.5714	420	0.8839	0.6461	0.8839	0.9402
No log	8.6122	422	0.9065	0.6461	0.9065	0.9521
No log	8.6531	424	0.9289	0.6252	0.9289	0.9638
No log	8.6939	426	0.9417	0.6252	0.9417	0.9704
No log	8.7347	428	0.9478	0.6314	0.9478	0.9735
No log	8.7755	430	0.9614	0.6314	0.9614	0.9805
No log	8.8163	432	0.9665	0.6314	0.9665	0.9831
No log	8.8571	434	0.9621	0.6196	0.9621	0.9809
No log	8.8980	436	0.9552	0.6314	0.9552	0.9774
No log	8.9388	438	0.9452	0.6252	0.9452	0.9722
No log	8.9796	440	0.9465	0.6252	0.9465	0.9729
No log	9.0204	442	0.9315	0.6252	0.9315	0.9651
No log	9.0612	444	0.9062	0.6406	0.9062	0.9519
No log	9.1020	446	0.8892	0.6646	0.8892	0.9430
No log	9.1429	448	0.8685	0.6861	0.8685	0.9319
No log	9.1837	450	0.8453	0.7140	0.8453	0.9194
No log	9.2245	452	0.8400	0.7240	0.8400	0.9165
No log	9.2653	454	0.8358	0.7318	0.8358	0.9142
No log	9.3061	456	0.8428	0.7220	0.8428	0.9180
No log	9.3469	458	0.8489	0.7220	0.8489	0.9214
No log	9.3878	460	0.8596	0.7123	0.8596	0.9271
No log	9.4286	462	0.8672	0.7103	0.8672	0.9312
No log	9.4694	464	0.8805	0.6849	0.8805	0.9384
No log	9.5102	466	0.8940	0.6613	0.8940	0.9455
No log	9.5510	468	0.9057	0.6431	0.9057	0.9517
No log	9.5918	470	0.9088	0.6431	0.9088	0.9533
No log	9.6327	472	0.9135	0.6431	0.9135	0.9558
No log	9.6735	474	0.9229	0.6431	0.9229	0.9607
No log	9.7143	476	0.9284	0.6431	0.9284	0.9636
No log	9.7551	478	0.9303	0.6431	0.9303	0.9645
No log	9.7959	480	0.9294	0.6431	0.9294	0.9640
No log	9.8367	482	0.9300	0.6431	0.9300	0.9644
No log	9.8776	484	0.9275	0.6431	0.9275	0.9631
No log	9.9184	486	0.9249	0.6431	0.9249	0.9617
No log	9.9592	488	0.9231	0.6431	0.9231	0.9608
No log	10.0	490	0.9219	0.6431	0.9219	0.9602

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024