Arabic_FineTuningAraBERT_AugV5_k5_task3_organization_fold0

MayBashendy/Arabic_FineTuningAraBERT_AugV5_k5_task3_organization_fold0

Arabic_FineTuningAraBERT_AugV5_k5_task3_organization_fold0 is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

23% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Nov 25, 2024
Updated: Nov 25, 2024
SHA: 91370e1c

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

Arabic_FineTuningAraBERT_AugV5_k5_task3_organization_fold0

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 1.0721
Qwk: 0.0320
Mse: 1.0721
Rmse: 1.0354

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0690	2	4.1885	0.0	4.1885	2.0466
No log	0.1379	4	2.5940	-0.0722	2.5940	1.6106
No log	0.2069	6	1.3888	0.0	1.3888	1.1785
No log	0.2759	8	1.2229	0.0873	1.2229	1.1058
No log	0.3448	10	1.1674	0.0833	1.1674	1.0805
No log	0.4138	12	1.3871	0.0873	1.3871	1.1777
No log	0.4828	14	1.9014	0.0	1.9014	1.3789
No log	0.5517	16	1.9484	0.0	1.9484	1.3959
No log	0.6207	18	1.6140	0.0	1.6140	1.2704
No log	0.6897	20	1.4608	0.0873	1.4608	1.2086
No log	0.7586	22	1.2102	-0.0421	1.2102	1.1001
No log	0.8276	24	1.1588	0.0678	1.1588	1.0765
No log	0.8966	26	1.0733	-0.375	1.0733	1.0360
No log	0.9655	28	1.1398	-0.0732	1.1398	1.0676
No log	1.0345	30	1.2664	0.0788	1.2664	1.1253
No log	1.1034	32	1.2452	0.0788	1.2452	1.1159
No log	1.1724	34	1.1299	-0.0927	1.1299	1.0630
No log	1.2414	36	0.9519	0.0	0.9519	0.9757
No log	1.3103	38	0.8893	0.0	0.8893	0.9430
No log	1.3793	40	0.9101	0.0	0.9101	0.9540
No log	1.4483	42	1.0639	0.0610	1.0639	1.0314
No log	1.5172	44	1.4392	0.0788	1.4392	1.1997
No log	1.5862	46	1.4235	0.0788	1.4235	1.1931
No log	1.6552	48	1.0913	-0.0565	1.0913	1.0447
No log	1.7241	50	0.9766	-0.1786	0.9766	0.9882
No log	1.7931	52	1.3897	0.1921	1.3897	1.1788
No log	1.8621	54	1.1684	-0.0927	1.1684	1.0809
No log	1.9310	56	0.9748	-0.1440	0.9748	0.9873
No log	2.0	58	0.8563	-0.1786	0.8563	0.9254
No log	2.0690	60	0.8546	-0.1786	0.8546	0.9245
No log	2.1379	62	0.8948	0.2029	0.8948	0.9460
No log	2.2069	64	0.8917	0.0	0.8917	0.9443
No log	2.2759	66	0.9783	-0.1786	0.9783	0.9891
No log	2.3448	68	1.0941	-0.496	1.0941	1.0460
No log	2.4138	70	1.1644	-0.3841	1.1644	1.0791
No log	2.4828	72	1.0626	-0.1786	1.0626	1.0308
No log	2.5517	74	0.9459	0.0	0.9459	0.9726
No log	2.6207	76	0.7763	0.0	0.7763	0.8811
No log	2.6897	78	0.6909	0.0	0.6909	0.8312
No log	2.7586	80	0.7735	0.384	0.7735	0.8795
No log	2.8276	82	0.8477	0.3623	0.8477	0.9207
No log	2.8966	84	0.7372	0.3623	0.7372	0.8586
No log	2.9655	86	0.6294	0.384	0.6294	0.7934
No log	3.0345	88	0.9122	-0.1786	0.9122	0.9551
No log	3.1034	90	1.1260	-0.1786	1.1260	1.0612
No log	3.1724	92	1.1147	-0.1786	1.1147	1.0558
No log	3.2414	94	1.2246	-0.1786	1.2246	1.1066
No log	3.3103	96	1.5202	-0.0809	1.5202	1.2329
No log	3.3793	98	1.4703	0.0435	1.4703	1.2125
No log	3.4483	100	1.2610	-0.1786	1.2610	1.1229
No log	3.5172	102	0.9938	-0.1818	0.9938	0.9969
No log	3.5862	104	0.9884	-0.1786	0.9884	0.9942
No log	3.6552	106	1.0704	-0.1786	1.0704	1.0346
No log	3.7241	108	0.9934	-0.1786	0.9934	0.9967
No log	3.7931	110	0.8899	0.0320	0.8899	0.9433
No log	3.8621	112	0.7882	0.1987	0.7882	0.8878
No log	3.9310	114	0.7985	0.3623	0.7985	0.8936
No log	4.0	116	0.7811	0.3623	0.7811	0.8838
No log	4.0690	118	0.7651	0.2143	0.7651	0.8747
No log	4.1379	120	0.8421	-0.1786	0.8421	0.9176
No log	4.2069	122	0.9053	-0.1786	0.9053	0.9515
No log	4.2759	124	0.9171	-0.1786	0.9171	0.9576
No log	4.3448	126	0.9381	-0.1786	0.9381	0.9686
No log	4.4138	128	0.9889	-0.1786	0.9889	0.9944
No log	4.4828	130	1.0551	-0.1786	1.0551	1.0272
No log	4.5517	132	1.0896	-0.1786	1.0896	1.0438
No log	4.6207	134	1.0310	-0.1786	1.0310	1.0154
No log	4.6897	136	0.9818	-0.1786	0.9818	0.9909
No log	4.7586	138	0.9456	-0.1786	0.9456	0.9724
No log	4.8276	140	0.9495	-0.1786	0.9495	0.9744
No log	4.8966	142	1.0176	-0.1786	1.0176	1.0087
No log	4.9655	144	1.0409	-0.1786	1.0409	1.0203
No log	5.0345	146	1.0781	-0.1786	1.0781	1.0383
No log	5.1034	148	1.0436	-0.1786	1.0436	1.0216
No log	5.1724	150	1.0365	-0.1786	1.0365	1.0181
No log	5.2414	152	0.9707	-0.1786	0.9707	0.9852
No log	5.3103	154	0.9263	-0.1786	0.9263	0.9625
No log	5.3793	156	0.8796	0.0320	0.8796	0.9379
No log	5.4483	158	0.8757	0.0320	0.8757	0.9358
No log	5.5172	160	0.9100	-0.1786	0.9100	0.9539
No log	5.5862	162	0.9935	-0.1786	0.9935	0.9967
No log	5.6552	164	1.0782	-0.1818	1.0782	1.0383
No log	5.7241	166	1.1261	-0.1818	1.1261	1.0612
No log	5.7931	168	1.1391	-0.1818	1.1391	1.0673
No log	5.8621	170	1.0994	-0.1846	1.0994	1.0485
No log	5.9310	172	0.9894	-0.3453	0.9894	0.9947
No log	6.0	174	0.9488	0.1818	0.9488	0.9741
No log	6.0690	176	0.9745	0.384	0.9745	0.9872
No log	6.1379	178	0.9356	0.1818	0.9356	0.9673
No log	6.2069	180	0.9533	0.0149	0.9533	0.9763
No log	6.2759	182	1.0249	-0.1846	1.0249	1.0124
No log	6.3448	184	1.0595	-0.1846	1.0595	1.0293
No log	6.4138	186	1.0192	-0.1818	1.0192	1.0096
No log	6.4828	188	0.9179	0.0320	0.9179	0.9581
No log	6.5517	190	0.8743	0.0320	0.8743	0.9350
No log	6.6207	192	0.8694	0.0320	0.8694	0.9324
No log	6.6897	194	0.8637	0.0320	0.8637	0.9294
No log	6.7586	196	0.9243	-0.1786	0.9243	0.9614
No log	6.8276	198	0.9954	0.0	0.9954	0.9977
No log	6.8966	200	0.9812	0.0	0.9812	0.9906
No log	6.9655	202	0.9331	-0.1786	0.9331	0.9660
No log	7.0345	204	0.8905	0.0320	0.8905	0.9437
No log	7.1034	206	0.8974	0.0320	0.8974	0.9473
No log	7.1724	208	0.8968	0.0320	0.8968	0.9470
No log	7.2414	210	0.8848	0.0320	0.8848	0.9406
No log	7.3103	212	0.9323	-0.1786	0.9323	0.9656
No log	7.3793	214	0.9790	-0.0154	0.9790	0.9894
No log	7.4483	216	0.9717	-0.1818	0.9717	0.9857
No log	7.5172	218	0.9282	0.0149	0.9282	0.9634
No log	7.5862	220	0.9143	0.0320	0.9143	0.9562
No log	7.6552	222	0.9305	0.0149	0.9305	0.9646
No log	7.7241	224	0.9338	0.0149	0.9338	0.9663
No log	7.7931	226	0.9402	0.0	0.9402	0.9697
No log	7.8621	228	0.9679	0.0	0.9679	0.9838
No log	7.9310	230	1.0028	-0.1846	1.0028	1.0014
No log	8.0	232	1.0372	-0.1846	1.0372	1.0184
No log	8.0690	234	1.0461	-0.1818	1.0461	1.0228
No log	8.1379	236	1.0253	-0.1818	1.0253	1.0126
No log	8.2069	238	1.0014	-0.1818	1.0014	1.0007
No log	8.2759	240	0.9814	0.0149	0.9814	0.9906
No log	8.3448	242	0.9790	0.0320	0.9790	0.9894
No log	8.4138	244	0.9901	0.0320	0.9901	0.9950
No log	8.4828	246	1.0052	0.0320	1.0052	1.0026
No log	8.5517	248	1.0265	0.0320	1.0265	1.0132
No log	8.6207	250	1.0466	-0.1786	1.0466	1.0230
No log	8.6897	252	1.0604	-0.1786	1.0604	1.0298
No log	8.7586	254	1.0875	-0.1786	1.0875	1.0428
No log	8.8276	256	1.1114	-0.1786	1.1114	1.0542
No log	8.8966	258	1.1164	-0.1786	1.1164	1.0566
No log	8.9655	260	1.1052	-0.1786	1.1052	1.0513
No log	9.0345	262	1.0874	-0.1786	1.0874	1.0428
No log	9.1034	264	1.0654	0.0320	1.0654	1.0322
No log	9.1724	266	1.0510	0.0320	1.0510	1.0252
No log	9.2414	268	1.0472	0.0320	1.0472	1.0233
No log	9.3103	270	1.0478	0.0320	1.0478	1.0236
No log	9.3793	272	1.0484	0.0320	1.0484	1.0239
No log	9.4483	274	1.0516	0.0320	1.0516	1.0255
No log	9.5172	276	1.0584	0.0320	1.0584	1.0288
No log	9.5862	278	1.0635	0.0320	1.0635	1.0313
No log	9.6552	280	1.0685	0.0320	1.0685	1.0337
No log	9.7241	282	1.0709	0.0320	1.0709	1.0348
No log	9.7931	284	1.0713	0.0320	1.0713	1.0350
No log	9.8621	286	1.0716	0.0320	1.0716	1.0352
No log	9.9310	288	1.0720	0.0320	1.0720	1.0354
No log	10.0	290	1.0721	0.0320	1.0721	1.0354

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Nov 25, 2024
Updated: Nov 25, 2024