ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k15_task5_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k15_task5_organization

ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k15_task5_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

38% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: 9559f344

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k15_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.8506
Qwk: 0.6784
Mse: 0.8506
Rmse: 0.9223

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0435	2	2.1472	0.0327	2.1472	1.4653
No log	0.0870	4	1.4425	0.2048	1.4425	1.2010
No log	0.1304	6	1.4836	0.1516	1.4836	1.2180
No log	0.1739	8	1.7919	0.2139	1.7919	1.3386
No log	0.2174	10	1.8884	0.2471	1.8884	1.3742
No log	0.2609	12	1.5775	0.2556	1.5775	1.2560
No log	0.3043	14	1.4141	0.2156	1.4141	1.1891
No log	0.3478	16	1.3197	0.2524	1.3197	1.1488
No log	0.3913	18	1.2625	0.3167	1.2625	1.1236
No log	0.4348	20	1.6052	0.3137	1.6052	1.2670
No log	0.4783	22	1.8141	0.2936	1.8141	1.3469
No log	0.5217	24	1.5626	0.3294	1.5626	1.2500
No log	0.5652	26	1.3803	0.3521	1.3803	1.1749
No log	0.6087	28	1.3485	0.3302	1.3485	1.1612
No log	0.6522	30	1.4421	0.3646	1.4421	1.2009
No log	0.6957	32	1.4513	0.3440	1.4513	1.2047
No log	0.7391	34	1.6335	0.3208	1.6335	1.2781
No log	0.7826	36	1.6812	0.2913	1.6812	1.2966
No log	0.8261	38	1.5097	0.3224	1.5097	1.2287
No log	0.8696	40	1.2102	0.3607	1.2102	1.1001
No log	0.9130	42	1.1195	0.3423	1.1195	1.0581
No log	0.9565	44	1.1036	0.3783	1.1036	1.0505
No log	1.0	46	1.3073	0.3711	1.3073	1.1434
No log	1.0435	48	1.8570	0.2537	1.8570	1.3627
No log	1.0870	50	1.9925	0.2278	1.9925	1.4116
No log	1.1304	52	1.5464	0.3106	1.5464	1.2435
No log	1.1739	54	1.1462	0.4759	1.1462	1.0706
No log	1.2174	56	0.9016	0.5796	0.9016	0.9495
No log	1.2609	58	0.7857	0.6632	0.7857	0.8864
No log	1.3043	60	0.7785	0.6786	0.7785	0.8824
No log	1.3478	62	0.9317	0.6135	0.9317	0.9652
No log	1.3913	64	1.5118	0.3765	1.5118	1.2296
No log	1.4348	66	1.6814	0.3572	1.6814	1.2967
No log	1.4783	68	1.3289	0.5223	1.3289	1.1528
No log	1.5217	70	1.0060	0.6174	1.0060	1.0030
No log	1.5652	72	0.8240	0.6837	0.8240	0.9078
No log	1.6087	74	0.8812	0.6641	0.8812	0.9387
No log	1.6522	76	1.2375	0.5641	1.2375	1.1124
No log	1.6957	78	1.5027	0.5494	1.5027	1.2258
No log	1.7391	80	1.4617	0.5558	1.4617	1.2090
No log	1.7826	82	1.1794	0.5608	1.1794	1.0860
No log	1.8261	84	0.9731	0.6194	0.9731	0.9865
No log	1.8696	86	0.8780	0.6198	0.8780	0.9370
No log	1.9130	88	0.8307	0.6608	0.8307	0.9114
No log	1.9565	90	0.9028	0.6270	0.9028	0.9502
No log	2.0	92	1.1961	0.5632	1.1961	1.0937
No log	2.0435	94	1.2445	0.5540	1.2445	1.1156
No log	2.0870	96	1.0638	0.5713	1.0638	1.0314
No log	2.1304	98	1.0829	0.5724	1.0829	1.0406
No log	2.1739	100	1.0691	0.5690	1.0691	1.0340
No log	2.2174	102	0.9942	0.6004	0.9942	0.9971
No log	2.2609	104	0.9053	0.6546	0.9053	0.9515
No log	2.3043	106	0.7384	0.6610	0.7384	0.8593
No log	2.3478	108	0.7242	0.6525	0.7242	0.8510
No log	2.3913	110	0.7305	0.6506	0.7305	0.8547
No log	2.4348	112	0.8636	0.6622	0.8636	0.9293
No log	2.4783	114	1.0797	0.5970	1.0797	1.0391
No log	2.5217	116	1.1907	0.5394	1.1907	1.0912
No log	2.5652	118	1.1378	0.5519	1.1378	1.0667
No log	2.6087	120	0.9612	0.6192	0.9612	0.9804
No log	2.6522	122	0.8880	0.6264	0.8880	0.9424
No log	2.6957	124	0.9101	0.6149	0.9101	0.9540
No log	2.7391	126	1.0354	0.5814	1.0354	1.0175
No log	2.7826	128	1.1949	0.5305	1.1949	1.0931
No log	2.8261	130	1.2151	0.5433	1.2151	1.1023
No log	2.8696	132	1.1142	0.5648	1.1142	1.0555
No log	2.9130	134	0.9964	0.6153	0.9964	0.9982
No log	2.9565	136	1.0098	0.6172	1.0098	1.0049
No log	3.0	138	1.1480	0.5591	1.1480	1.0715
No log	3.0435	140	1.1376	0.5495	1.1376	1.0666
No log	3.0870	142	1.1942	0.5459	1.1942	1.0928
No log	3.1304	144	1.1005	0.5616	1.1005	1.0491
No log	3.1739	146	0.9827	0.5632	0.9827	0.9913
No log	3.2174	148	0.8514	0.5704	0.8514	0.9227
No log	3.2609	150	0.8282	0.5756	0.8282	0.9101
No log	3.3043	152	0.8574	0.5770	0.8574	0.9260
No log	3.3478	154	0.9152	0.6093	0.9152	0.9567
No log	3.3913	156	0.9503	0.6093	0.9503	0.9748
No log	3.4348	158	0.8550	0.6633	0.8550	0.9246
No log	3.4783	160	0.8652	0.6633	0.8652	0.9302
No log	3.5217	162	0.9959	0.6428	0.9959	0.9979
No log	3.5652	164	0.9904	0.6345	0.9904	0.9952
No log	3.6087	166	0.9485	0.6345	0.9485	0.9739
No log	3.6522	168	0.8614	0.6753	0.8614	0.9281
No log	3.6957	170	0.8179	0.6659	0.8179	0.9044
No log	3.7391	172	0.8880	0.6599	0.8880	0.9424
No log	3.7826	174	1.0596	0.5935	1.0596	1.0294
No log	3.8261	176	1.0584	0.6043	1.0584	1.0288
No log	3.8696	178	0.8963	0.6856	0.8963	0.9467
No log	3.9130	180	0.7375	0.7218	0.7375	0.8588
No log	3.9565	182	0.7204	0.6980	0.7204	0.8488
No log	4.0	184	0.7609	0.7099	0.7609	0.8723
No log	4.0435	186	0.9233	0.6531	0.9233	0.9609
No log	4.0870	188	1.0659	0.5778	1.0659	1.0324
No log	4.1304	190	1.1465	0.5797	1.1465	1.0707
No log	4.1739	192	1.1710	0.5696	1.1710	1.0821
No log	4.2174	194	1.0727	0.5907	1.0727	1.0357
No log	4.2609	196	0.9169	0.6627	0.9169	0.9575
No log	4.3043	198	0.8678	0.6753	0.8678	0.9316
No log	4.3478	200	0.8374	0.6688	0.8374	0.9151
No log	4.3913	202	0.8607	0.6753	0.8607	0.9277
No log	4.4348	204	0.9457	0.6241	0.9457	0.9725
No log	4.4783	206	1.0045	0.6185	1.0045	1.0022
No log	4.5217	208	0.9361	0.6350	0.9361	0.9675
No log	4.5652	210	0.8481	0.6769	0.8481	0.9209
No log	4.6087	212	0.7558	0.7078	0.7558	0.8694
No log	4.6522	214	0.7132	0.6976	0.7132	0.8445
No log	4.6957	216	0.7275	0.7039	0.7275	0.8530
No log	4.7391	218	0.7928	0.6883	0.7928	0.8904
No log	4.7826	220	0.9258	0.6389	0.9258	0.9622
No log	4.8261	222	1.1001	0.5935	1.1001	1.0488
No log	4.8696	224	1.1797	0.5906	1.1797	1.0861
No log	4.9130	226	1.0939	0.6108	1.0939	1.0459
No log	4.9565	228	0.9273	0.6246	0.9273	0.9629
No log	5.0	230	0.7597	0.7370	0.7597	0.8716
No log	5.0435	232	0.7072	0.7210	0.7072	0.8410
No log	5.0870	234	0.7221	0.7186	0.7221	0.8498
No log	5.1304	236	0.7986	0.6915	0.7986	0.8936
No log	5.1739	238	0.9236	0.6374	0.9236	0.9610
No log	5.2174	240	1.0876	0.5905	1.0876	1.0429
No log	5.2609	242	1.1778	0.5967	1.1778	1.0853
No log	5.3043	244	1.1176	0.5874	1.1176	1.0572
No log	5.3478	246	0.9998	0.6105	0.9998	0.9999
No log	5.3913	248	0.8522	0.6766	0.8522	0.9231
No log	5.4348	250	0.7780	0.7274	0.7780	0.8820
No log	5.4783	252	0.7856	0.7237	0.7856	0.8864
No log	5.5217	254	0.8575	0.7089	0.8575	0.9260
No log	5.5652	256	0.9399	0.6597	0.9399	0.9695
No log	5.6087	258	0.9649	0.6409	0.9649	0.9823
No log	5.6522	260	1.0004	0.6334	1.0004	1.0002
No log	5.6957	262	0.9337	0.6439	0.9337	0.9663
No log	5.7391	264	0.8403	0.7053	0.8403	0.9167
No log	5.7826	266	0.7982	0.7201	0.7982	0.8934
No log	5.8261	268	0.7551	0.7221	0.7551	0.8690
No log	5.8696	270	0.7475	0.7221	0.7475	0.8646
No log	5.9130	272	0.7729	0.7222	0.7729	0.8791
No log	5.9565	274	0.8386	0.7156	0.8386	0.9158
No log	6.0	276	0.8700	0.6969	0.8700	0.9327
No log	6.0435	278	0.9165	0.6778	0.9165	0.9574
No log	6.0870	280	0.9062	0.6778	0.9062	0.9520
No log	6.1304	282	0.8643	0.7192	0.8643	0.9297
No log	6.1739	284	0.8658	0.7018	0.8658	0.9305
No log	6.2174	286	0.8650	0.7018	0.8650	0.9301
No log	6.2609	288	0.8489	0.7136	0.8489	0.9214
No log	6.3043	290	0.7965	0.7337	0.7965	0.8925
No log	6.3478	292	0.7780	0.7281	0.7780	0.8820
No log	6.3913	294	0.7601	0.7245	0.7601	0.8718
No log	6.4348	296	0.7725	0.7281	0.7725	0.8789
No log	6.4783	298	0.7656	0.7260	0.7656	0.8750
No log	6.5217	300	0.7721	0.7180	0.7721	0.8787
No log	6.5652	302	0.8160	0.7143	0.8160	0.9034
No log	6.6087	304	0.8566	0.6958	0.8566	0.9255
No log	6.6522	306	0.8382	0.6894	0.8382	0.9155
No log	6.6957	308	0.7972	0.7180	0.7972	0.8929
No log	6.7391	310	0.7585	0.7201	0.7585	0.8709
No log	6.7826	312	0.7504	0.7199	0.7504	0.8662
No log	6.8261	314	0.7585	0.7164	0.7585	0.8709
No log	6.8696	316	0.7746	0.7164	0.7746	0.8801
No log	6.9130	318	0.7861	0.7121	0.7861	0.8866
No log	6.9565	320	0.7982	0.7137	0.7982	0.8934
No log	7.0	322	0.8349	0.6998	0.8349	0.9137
No log	7.0435	324	0.9387	0.6565	0.9387	0.9689
No log	7.0870	326	1.0668	0.6307	1.0668	1.0329
No log	7.1304	328	1.1131	0.6141	1.1131	1.0550
No log	7.1739	330	1.1015	0.6111	1.1015	1.0495
No log	7.2174	332	1.0356	0.6280	1.0356	1.0177
No log	7.2609	334	0.9648	0.6521	0.9648	0.9822
No log	7.3043	336	0.9409	0.6646	0.9409	0.9700
No log	7.3478	338	0.9197	0.6485	0.9197	0.9590
No log	7.3913	340	0.8769	0.6489	0.8769	0.9364
No log	7.4348	342	0.8669	0.6327	0.8669	0.9311
No log	7.4783	344	0.8818	0.6394	0.8818	0.9391
No log	7.5217	346	0.8635	0.6410	0.8635	0.9292
No log	7.5652	348	0.8457	0.6243	0.8457	0.9196
No log	7.6087	350	0.8602	0.6394	0.8602	0.9275
No log	7.6522	352	0.8895	0.6612	0.8895	0.9431
No log	7.6957	354	0.9302	0.6739	0.9302	0.9644
No log	7.7391	356	0.9610	0.6567	0.9610	0.9803
No log	7.7826	358	0.9411	0.6583	0.9411	0.9701
No log	7.8261	360	0.9183	0.6839	0.9183	0.9583
No log	7.8696	362	0.8985	0.6781	0.8985	0.9479
No log	7.9130	364	0.8698	0.6934	0.8698	0.9326
No log	7.9565	366	0.8560	0.6934	0.8560	0.9252
No log	8.0	368	0.8365	0.6932	0.8365	0.9146
No log	8.0435	370	0.8148	0.6777	0.8148	0.9027
No log	8.0870	372	0.8185	0.6864	0.8185	0.9047
No log	8.1304	374	0.8513	0.6751	0.8513	0.9227
No log	8.1739	376	0.8652	0.6510	0.8652	0.9302
No log	8.2174	378	0.8823	0.6556	0.8823	0.9393
No log	8.2609	380	0.9045	0.6612	0.9045	0.9511
No log	8.3043	382	0.9112	0.6654	0.9112	0.9546
No log	8.3478	384	0.8919	0.6816	0.8919	0.9444
No log	8.3913	386	0.8782	0.6816	0.8782	0.9371
No log	8.4348	388	0.8776	0.6934	0.8776	0.9368
No log	8.4783	390	0.8870	0.6816	0.8870	0.9418
No log	8.5217	392	0.8981	0.6816	0.8981	0.9477
No log	8.5652	394	0.9055	0.6654	0.9055	0.9516
No log	8.6087	396	0.9221	0.6612	0.9221	0.9603
No log	8.6522	398	0.9265	0.6672	0.9265	0.9626
No log	8.6957	400	0.9180	0.6612	0.9180	0.9581
No log	8.7391	402	0.9198	0.6612	0.9198	0.9590
No log	8.7826	404	0.9244	0.6612	0.9244	0.9614
No log	8.8261	406	0.9510	0.6689	0.9510	0.9752
No log	8.8696	408	0.9620	0.6689	0.9620	0.9808
No log	8.9130	410	0.9533	0.6594	0.9533	0.9764
No log	8.9565	412	0.9565	0.6594	0.9565	0.9780
No log	9.0	414	0.9510	0.6483	0.9510	0.9752
No log	9.0435	416	0.9575	0.6483	0.9575	0.9785
No log	9.0870	418	0.9534	0.6483	0.9534	0.9764
No log	9.1304	420	0.9377	0.6637	0.9377	0.9684
No log	9.1739	422	0.9130	0.6609	0.9130	0.9555
No log	9.2174	424	0.9014	0.6670	0.9014	0.9494
No log	9.2609	426	0.8986	0.6679	0.8986	0.9480
No log	9.3043	428	0.9040	0.6850	0.9040	0.9508
No log	9.3478	430	0.9054	0.6850	0.9054	0.9515
No log	9.3913	432	0.9037	0.6892	0.9037	0.9506
No log	9.4348	434	0.8940	0.6934	0.8940	0.9455
No log	9.4783	436	0.8851	0.6934	0.8851	0.9408
No log	9.5217	438	0.8725	0.6934	0.8725	0.9341
No log	9.5652	440	0.8597	0.6784	0.8597	0.9272
No log	9.6087	442	0.8553	0.6784	0.8553	0.9248
No log	9.6522	444	0.8515	0.6784	0.8515	0.9227
No log	9.6957	446	0.8456	0.6784	0.8456	0.9196
No log	9.7391	448	0.8405	0.6784	0.8405	0.9168
No log	9.7826	450	0.8397	0.6784	0.8397	0.9164
No log	9.8261	452	0.8414	0.6784	0.8414	0.9173
No log	9.8696	454	0.8453	0.6784	0.8453	0.9194
No log	9.9130	456	0.8476	0.6784	0.8476	0.9207
No log	9.9565	458	0.8497	0.6784	0.8497	0.9218
No log	10.0	460	0.8506	0.6784	0.8506	0.9223

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024