ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k15_task5_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k15_task5_organization

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k15_task5_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

38% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: f761f4f7

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k15_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.8512
Qwk: 0.6784
Mse: 0.8512
Rmse: 0.9226

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0435	2	2.1472	0.0327	2.1472	1.4653
No log	0.0870	4	1.4425	0.2048	1.4425	1.2010
No log	0.1304	6	1.4836	0.1516	1.4836	1.2180
No log	0.1739	8	1.7919	0.2139	1.7919	1.3386
No log	0.2174	10	1.8884	0.2471	1.8884	1.3742
No log	0.2609	12	1.5775	0.2556	1.5775	1.2560
No log	0.3043	14	1.4141	0.2156	1.4141	1.1891
No log	0.3478	16	1.3197	0.2524	1.3197	1.1488
No log	0.3913	18	1.2625	0.3167	1.2625	1.1236
No log	0.4348	20	1.6052	0.3137	1.6052	1.2670
No log	0.4783	22	1.8141	0.2936	1.8141	1.3469
No log	0.5217	24	1.5626	0.3294	1.5626	1.2500
No log	0.5652	26	1.3803	0.3521	1.3803	1.1749
No log	0.6087	28	1.3485	0.3302	1.3485	1.1612
No log	0.6522	30	1.4421	0.3646	1.4421	1.2009
No log	0.6957	32	1.4513	0.3440	1.4513	1.2047
No log	0.7391	34	1.6335	0.3208	1.6335	1.2781
No log	0.7826	36	1.6812	0.2913	1.6812	1.2966
No log	0.8261	38	1.5097	0.3224	1.5097	1.2287
No log	0.8696	40	1.2102	0.3607	1.2102	1.1001
No log	0.9130	42	1.1195	0.3423	1.1195	1.0581
No log	0.9565	44	1.1036	0.3783	1.1036	1.0505
No log	1.0	46	1.3073	0.3711	1.3073	1.1434
No log	1.0435	48	1.8570	0.2537	1.8570	1.3627
No log	1.0870	50	1.9925	0.2278	1.9925	1.4116
No log	1.1304	52	1.5464	0.3106	1.5464	1.2435
No log	1.1739	54	1.1462	0.4759	1.1462	1.0706
No log	1.2174	56	0.9016	0.5796	0.9016	0.9495
No log	1.2609	58	0.7857	0.6632	0.7857	0.8864
No log	1.3043	60	0.7785	0.6786	0.7785	0.8824
No log	1.3478	62	0.9317	0.6135	0.9317	0.9652
No log	1.3913	64	1.5118	0.3765	1.5118	1.2295
No log	1.4348	66	1.6813	0.3572	1.6813	1.2967
No log	1.4783	68	1.3289	0.5223	1.3289	1.1528
No log	1.5217	70	1.0060	0.6174	1.0060	1.0030
No log	1.5652	72	0.8240	0.6837	0.8240	0.9078
No log	1.6087	74	0.8812	0.6641	0.8812	0.9387
No log	1.6522	76	1.2375	0.5641	1.2375	1.1124
No log	1.6957	78	1.5027	0.5494	1.5027	1.2258
No log	1.7391	80	1.4617	0.5558	1.4617	1.2090
No log	1.7826	82	1.1794	0.5608	1.1794	1.0860
No log	1.8261	84	0.9731	0.6194	0.9731	0.9865
No log	1.8696	86	0.8780	0.6198	0.8780	0.9370
No log	1.9130	88	0.8307	0.6608	0.8307	0.9114
No log	1.9565	90	0.9029	0.6270	0.9029	0.9502
No log	2.0	92	1.1961	0.5632	1.1961	1.0936
No log	2.0435	94	1.2445	0.5540	1.2445	1.1156
No log	2.0870	96	1.0638	0.5713	1.0638	1.0314
No log	2.1304	98	1.0829	0.5724	1.0829	1.0406
No log	2.1739	100	1.0691	0.5690	1.0691	1.0340
No log	2.2174	102	0.9942	0.6004	0.9942	0.9971
No log	2.2609	104	0.9052	0.6546	0.9052	0.9514
No log	2.3043	106	0.7384	0.6610	0.7384	0.8593
No log	2.3478	108	0.7242	0.6525	0.7242	0.8510
No log	2.3913	110	0.7305	0.6506	0.7305	0.8547
No log	2.4348	112	0.8636	0.6622	0.8636	0.9293
No log	2.4783	114	1.0797	0.5970	1.0797	1.0391
No log	2.5217	116	1.1906	0.5394	1.1906	1.0911
No log	2.5652	118	1.1378	0.5519	1.1378	1.0667
No log	2.6087	120	0.9611	0.6192	0.9611	0.9804
No log	2.6522	122	0.8880	0.6264	0.8880	0.9424
No log	2.6957	124	0.9102	0.6149	0.9102	0.9540
No log	2.7391	126	1.0355	0.5814	1.0355	1.0176
No log	2.7826	128	1.1950	0.5305	1.1950	1.0931
No log	2.8261	130	1.2152	0.5433	1.2152	1.1024
No log	2.8696	132	1.1142	0.5648	1.1142	1.0555
No log	2.9130	134	0.9963	0.6153	0.9963	0.9982
No log	2.9565	136	1.0099	0.6172	1.0099	1.0049
No log	3.0	138	1.1481	0.5591	1.1481	1.0715
No log	3.0435	140	1.1377	0.5495	1.1377	1.0666
No log	3.0870	142	1.1943	0.5459	1.1943	1.0928
No log	3.1304	144	1.1006	0.5616	1.1006	1.0491
No log	3.1739	146	0.9825	0.5632	0.9825	0.9912
No log	3.2174	148	0.8512	0.5704	0.8512	0.9226
No log	3.2609	150	0.8282	0.5756	0.8282	0.9101
No log	3.3043	152	0.8575	0.5770	0.8575	0.9260
No log	3.3478	154	0.9152	0.6093	0.9152	0.9567
No log	3.3913	156	0.9505	0.6093	0.9505	0.9749
No log	3.4348	158	0.8551	0.6633	0.8551	0.9247
No log	3.4783	160	0.8653	0.6633	0.8653	0.9302
No log	3.5217	162	0.9959	0.6428	0.9959	0.9980
No log	3.5652	164	0.9904	0.6345	0.9904	0.9952
No log	3.6087	166	0.9485	0.6345	0.9485	0.9739
No log	3.6522	168	0.8613	0.6753	0.8613	0.9281
No log	3.6957	170	0.8178	0.6659	0.8178	0.9043
No log	3.7391	172	0.8879	0.6599	0.8879	0.9423
No log	3.7826	174	1.0598	0.5935	1.0598	1.0295
No log	3.8261	176	1.0588	0.6043	1.0588	1.0290
No log	3.8696	178	0.8968	0.6812	0.8968	0.9470
No log	3.9130	180	0.7377	0.7218	0.7377	0.8589
No log	3.9565	182	0.7205	0.6980	0.7205	0.8488
No log	4.0	184	0.7609	0.7099	0.7609	0.8723
No log	4.0435	186	0.9230	0.6531	0.9230	0.9608
No log	4.0870	188	1.0659	0.5778	1.0659	1.0324
No log	4.1304	190	1.1474	0.5797	1.1474	1.0712
No log	4.1739	192	1.1725	0.5696	1.1725	1.0828
No log	4.2174	194	1.0737	0.5907	1.0737	1.0362
No log	4.2609	196	0.9171	0.6627	0.9171	0.9576
No log	4.3043	198	0.8678	0.6753	0.8678	0.9315
No log	4.3478	200	0.8373	0.6688	0.8373	0.9151
No log	4.3913	202	0.8608	0.6753	0.8608	0.9278
No log	4.4348	204	0.9462	0.6241	0.9462	0.9727
No log	4.4783	206	1.0054	0.6185	1.0054	1.0027
No log	4.5217	208	0.9370	0.6350	0.9370	0.9680
No log	4.5652	210	0.8483	0.6769	0.8483	0.9211
No log	4.6087	212	0.7554	0.7078	0.7554	0.8691
No log	4.6522	214	0.7128	0.6976	0.7128	0.8442
No log	4.6957	216	0.7268	0.7039	0.7268	0.8525
No log	4.7391	218	0.7916	0.6883	0.7916	0.8897
No log	4.7826	220	0.9253	0.6389	0.9253	0.9619
No log	4.8261	222	1.1021	0.5935	1.1021	1.0498
No log	4.8696	224	1.1841	0.5906	1.1841	1.0882
No log	4.9130	226	1.0997	0.6040	1.0997	1.0486
No log	4.9565	228	0.9316	0.6246	0.9316	0.9652
No log	5.0	230	0.7617	0.7265	0.7617	0.8728
No log	5.0435	232	0.7080	0.7210	0.7080	0.8414
No log	5.0870	234	0.7223	0.7098	0.7223	0.8499
No log	5.1304	236	0.7979	0.6915	0.7979	0.8933
No log	5.1739	238	0.9225	0.6374	0.9225	0.9605
No log	5.2174	240	1.0890	0.5905	1.0890	1.0436
No log	5.2609	242	1.1838	0.5967	1.1838	1.0880
No log	5.3043	244	1.1264	0.5874	1.1264	1.0613
No log	5.3478	246	1.0076	0.6105	1.0076	1.0038
No log	5.3913	248	0.8571	0.6600	0.8571	0.9258
No log	5.4348	250	0.7803	0.7274	0.7803	0.8834
No log	5.4783	252	0.7861	0.7237	0.7861	0.8866
No log	5.5217	254	0.8561	0.7089	0.8561	0.9252
No log	5.5652	256	0.9376	0.6555	0.9376	0.9683
No log	5.6087	258	0.9636	0.6424	0.9636	0.9816
No log	5.6522	260	1.0010	0.6334	1.0010	1.0005
No log	5.6957	262	0.9358	0.6454	0.9358	0.9673
No log	5.7391	264	0.8422	0.7053	0.8422	0.9177
No log	5.7826	266	0.7988	0.7201	0.7988	0.8937
No log	5.8261	268	0.7549	0.7221	0.7549	0.8688
No log	5.8696	270	0.7460	0.7347	0.7460	0.8637
No log	5.9130	272	0.7718	0.7222	0.7718	0.8785
No log	5.9565	274	0.8393	0.7156	0.8393	0.9161
No log	6.0	276	0.8720	0.6969	0.8720	0.9338
No log	6.0435	278	0.9186	0.6778	0.9186	0.9584
No log	6.0870	280	0.9078	0.6778	0.9078	0.9528
No log	6.1304	282	0.8646	0.7192	0.8646	0.9298
No log	6.1739	284	0.8647	0.7018	0.8647	0.9299
No log	6.2174	286	0.8619	0.7018	0.8619	0.9284
No log	6.2609	288	0.8445	0.7136	0.8445	0.9190
No log	6.3043	290	0.7920	0.7337	0.7920	0.8899
No log	6.3478	292	0.7740	0.7281	0.7740	0.8798
No log	6.3913	294	0.7576	0.7245	0.7576	0.8704
No log	6.4348	296	0.7713	0.7281	0.7713	0.8782
No log	6.4783	298	0.7656	0.7260	0.7656	0.8750
No log	6.5217	300	0.7723	0.7180	0.7723	0.8788
No log	6.5652	302	0.8134	0.7064	0.8134	0.9019
No log	6.6087	304	0.8488	0.6876	0.8488	0.9213
No log	6.6522	306	0.8302	0.6810	0.8302	0.9112
No log	6.6957	308	0.7948	0.7180	0.7948	0.8915
No log	6.7391	310	0.7608	0.7201	0.7608	0.8722
No log	6.7826	312	0.7543	0.7201	0.7543	0.8685
No log	6.8261	314	0.7616	0.7164	0.7616	0.8727
No log	6.8696	316	0.7763	0.7164	0.7763	0.8811
No log	6.9130	318	0.7841	0.7121	0.7841	0.8855
No log	6.9565	320	0.7939	0.7121	0.7939	0.8910
No log	7.0	322	0.8303	0.6998	0.8303	0.9112
No log	7.0435	324	0.9336	0.6565	0.9336	0.9662
No log	7.0870	326	1.0656	0.6307	1.0656	1.0323
No log	7.1304	328	1.1176	0.6197	1.1176	1.0572
No log	7.1739	330	1.1075	0.6000	1.1075	1.0524
No log	7.2174	332	1.0399	0.6280	1.0399	1.0198
No log	7.2609	334	0.9663	0.6521	0.9663	0.9830
No log	7.3043	336	0.9403	0.6526	0.9403	0.9697
No log	7.3478	338	0.9183	0.6485	0.9183	0.9583
No log	7.3913	340	0.8760	0.6327	0.8760	0.9360
No log	7.4348	342	0.8678	0.6327	0.8678	0.9315
No log	7.4783	344	0.8847	0.6394	0.8847	0.9406
No log	7.5217	346	0.8674	0.6410	0.8674	0.9313
No log	7.5652	348	0.8506	0.6243	0.8506	0.9223
No log	7.6087	350	0.8660	0.6394	0.8660	0.9306
No log	7.6522	352	0.8961	0.6612	0.8961	0.9466
No log	7.6957	354	0.9373	0.6739	0.9373	0.9681
No log	7.7391	356	0.9673	0.6480	0.9673	0.9835
No log	7.7826	358	0.9456	0.6583	0.9456	0.9724
No log	7.8261	360	0.9212	0.6739	0.9212	0.9598
No log	7.8696	362	0.9010	0.6781	0.9010	0.9492
No log	7.9130	364	0.8715	0.6934	0.8715	0.9336
No log	7.9565	366	0.8568	0.6934	0.8568	0.9256
No log	8.0	368	0.8368	0.6926	0.8368	0.9148
No log	8.0435	370	0.8164	0.6777	0.8164	0.9035
No log	8.0870	372	0.8212	0.6788	0.8212	0.9062
No log	8.1304	374	0.8546	0.6751	0.8546	0.9244
No log	8.1739	376	0.8685	0.6465	0.8685	0.9320
No log	8.2174	378	0.8853	0.6556	0.8853	0.9409
No log	8.2609	380	0.9070	0.6612	0.9070	0.9523
No log	8.3043	382	0.9130	0.6654	0.9130	0.9555
No log	8.3478	384	0.8927	0.6816	0.8927	0.9448
No log	8.3913	386	0.8791	0.6816	0.8791	0.9376
No log	8.4348	388	0.8788	0.6934	0.8788	0.9374
No log	8.4783	390	0.8890	0.6816	0.8890	0.9429
No log	8.5217	392	0.9010	0.6654	0.9010	0.9492
No log	8.5652	394	0.9089	0.6654	0.9089	0.9533
No log	8.6087	396	0.9249	0.6612	0.9249	0.9617
No log	8.6522	398	0.9286	0.6672	0.9286	0.9637
No log	8.6957	400	0.9192	0.6612	0.9192	0.9587
No log	8.7391	402	0.9199	0.6612	0.9199	0.9591
No log	8.7826	404	0.9240	0.6672	0.9240	0.9613
No log	8.8261	406	0.9507	0.6689	0.9507	0.9750
No log	8.8696	408	0.9621	0.6603	0.9621	0.9809
No log	8.9130	410	0.9536	0.6594	0.9536	0.9765
No log	8.9565	412	0.9566	0.6594	0.9566	0.9781
No log	9.0	414	0.9510	0.6483	0.9510	0.9752
No log	9.0435	416	0.9575	0.6483	0.9575	0.9785
No log	9.0870	418	0.9534	0.6483	0.9534	0.9764
No log	9.1304	420	0.9378	0.6637	0.9378	0.9684
No log	9.1739	422	0.9133	0.6609	0.9133	0.9557
No log	9.2174	424	0.9017	0.6670	0.9017	0.9496
No log	9.2609	426	0.8990	0.6679	0.8990	0.9482
No log	9.3043	428	0.9043	0.6850	0.9043	0.9510
No log	9.3478	430	0.9056	0.6850	0.9056	0.9516
No log	9.3913	432	0.9038	0.6850	0.9038	0.9507
No log	9.4348	434	0.8939	0.6934	0.8939	0.9455
No log	9.4783	436	0.8849	0.6934	0.8849	0.9407
No log	9.5217	438	0.8722	0.6953	0.8722	0.9339
No log	9.5652	440	0.8594	0.6784	0.8594	0.9270
No log	9.6087	442	0.8550	0.6784	0.8550	0.9247
No log	9.6522	444	0.8515	0.6784	0.8515	0.9227
No log	9.6957	446	0.8458	0.6784	0.8458	0.9197
No log	9.7391	448	0.8409	0.6784	0.8409	0.9170
No log	9.7826	450	0.8403	0.6784	0.8403	0.9167
No log	9.8261	452	0.8420	0.6784	0.8420	0.9176
No log	9.8696	454	0.8459	0.6784	0.8459	0.9197
No log	9.9130	456	0.8482	0.6784	0.8482	0.9210
No log	9.9565	458	0.8503	0.6784	0.8503	0.9221
No log	10.0	460	0.8512	0.6784	0.8512	0.9226

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024