ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k11_task3_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k11_task3_organization

ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k11_task3_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

38% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: 1a865da4

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k11_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.6078
Qwk: 0.3739
Mse: 0.6078
Rmse: 0.7796

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0444	2	3.3201	-0.0078	3.3201	1.8221
No log	0.0889	4	2.1564	-0.0182	2.1564	1.4685
No log	0.1333	6	1.2681	0.0255	1.2681	1.1261
No log	0.1778	8	1.0806	0.0418	1.0806	1.0395
No log	0.2222	10	0.6667	0.1373	0.6667	0.8165
No log	0.2667	12	0.6557	0.0569	0.6557	0.8098
No log	0.3111	14	0.9597	0.0222	0.9597	0.9797
No log	0.3556	16	1.1741	-0.0268	1.1741	1.0836
No log	0.4	18	0.8984	0.0	0.8984	0.9479
No log	0.4444	20	0.6897	0.2653	0.6897	0.8305
No log	0.4889	22	0.6600	0.3185	0.6600	0.8124
No log	0.5333	24	0.6442	0.2653	0.6442	0.8026
No log	0.5778	26	0.5881	0.2381	0.5881	0.7669
No log	0.6222	28	0.5561	0.0	0.5561	0.7457
No log	0.6667	30	0.5814	0.0	0.5814	0.7625
No log	0.7111	32	0.5574	0.0	0.5574	0.7466
No log	0.7556	34	0.5284	0.0	0.5284	0.7269
No log	0.8	36	0.5304	0.1220	0.5304	0.7283
No log	0.8444	38	0.5359	0.1220	0.5359	0.7320
No log	0.8889	40	0.5469	0.1220	0.5469	0.7396
No log	0.9333	42	0.6874	0.2381	0.6874	0.8291
No log	0.9778	44	0.9653	0.0345	0.9653	0.9825
No log	1.0222	46	0.8084	0.0769	0.8084	0.8991
No log	1.0667	48	0.5957	0.0	0.5957	0.7718
No log	1.1111	50	0.5821	0.0	0.5821	0.7630
No log	1.1556	52	0.5643	0.0	0.5643	0.7512
No log	1.2	54	0.5666	0.1220	0.5666	0.7527
No log	1.2444	56	0.6357	0.2109	0.6357	0.7973
No log	1.2889	58	0.6520	0.1795	0.6520	0.8075
No log	1.3333	60	0.6698	0.2000	0.6698	0.8184
No log	1.3778	62	0.6362	-0.0081	0.6362	0.7976
No log	1.4222	64	0.6229	0.0	0.6229	0.7892
No log	1.4667	66	0.6367	0.0	0.6367	0.7979
No log	1.5111	68	0.6236	0.0	0.6236	0.7897
No log	1.5556	70	0.5985	0.0	0.5985	0.7737
No log	1.6	72	0.6433	0.2485	0.6433	0.8020
No log	1.6444	74	0.6963	0.2157	0.6963	0.8344
No log	1.6889	76	0.5736	0.2464	0.5736	0.7574
No log	1.7333	78	0.5570	0.0	0.5570	0.7463
No log	1.7778	80	0.5652	0.0	0.5652	0.7518
No log	1.8222	82	0.5795	0.0	0.5795	0.7613
No log	1.8667	84	0.5827	0.0	0.5827	0.7634
No log	1.9111	86	0.5771	-0.0159	0.5771	0.7597
No log	1.9556	88	0.5697	-0.0159	0.5697	0.7548
No log	2.0	90	0.5482	0.3333	0.5482	0.7404
No log	2.0444	92	0.6895	0.2410	0.6895	0.8303
No log	2.0889	94	1.6971	0.1708	1.6971	1.3027
No log	2.1333	96	1.6566	0.1963	1.6566	1.2871
No log	2.1778	98	1.2234	0.2516	1.2234	1.1061
No log	2.2222	100	0.6309	0.1429	0.6309	0.7943
No log	2.2667	102	0.5952	0.1467	0.5952	0.7715
No log	2.3111	104	0.5764	0.1206	0.5764	0.7592
No log	2.3556	106	0.5768	0.0638	0.5768	0.7595
No log	2.4	108	0.6081	0.1282	0.6081	0.7798
No log	2.4444	110	0.6644	0.2090	0.6644	0.8151
No log	2.4889	112	0.6816	0.25	0.6816	0.8256
No log	2.5333	114	0.5498	0.1884	0.5498	0.7415
No log	2.5778	116	0.6310	0.0154	0.6310	0.7943
No log	2.6222	118	0.6530	0.0222	0.6530	0.8081
No log	2.6667	120	0.6017	0.0210	0.6017	0.7757
No log	2.7111	122	0.5887	0.0949	0.5887	0.7673
No log	2.7556	124	0.6897	0.1648	0.6897	0.8305
No log	2.8	126	0.9396	0.1193	0.9396	0.9693
No log	2.8444	128	0.9081	0.1174	0.9081	0.9529
No log	2.8889	130	1.0863	0.0427	1.0863	1.0423
No log	2.9333	132	0.9711	0.0427	0.9711	0.9855
No log	2.9778	134	0.7513	0.2000	0.7513	0.8668
No log	3.0222	136	0.6706	0.2857	0.6706	0.8189
No log	3.0667	138	0.5714	0.1628	0.5714	0.7559
No log	3.1111	140	0.5700	0.2366	0.5700	0.7550
No log	3.1556	142	0.5787	0.2201	0.5787	0.7607
No log	3.2	144	0.6469	0.2527	0.6469	0.8043
No log	3.2444	146	0.7725	0.2315	0.7725	0.8789
No log	3.2889	148	0.6824	0.3103	0.6824	0.8261
No log	3.3333	150	0.5990	0.3575	0.5989	0.7739
No log	3.3778	152	0.6378	0.3242	0.6378	0.7986
No log	3.4222	154	0.6235	0.3200	0.6235	0.7896
No log	3.4667	156	0.7435	0.3929	0.7435	0.8623
No log	3.5111	158	0.7056	0.3645	0.7056	0.8400
No log	3.5556	160	0.6386	0.2527	0.6386	0.7992
No log	3.6	162	0.6594	0.2088	0.6594	0.8121
No log	3.6444	164	0.5998	0.2273	0.5998	0.7744
No log	3.6889	166	0.6079	0.3508	0.6079	0.7797
No log	3.7333	168	0.7145	0.2607	0.7145	0.8453
No log	3.7778	170	0.5761	0.2360	0.5761	0.7590
No log	3.8222	172	0.5898	0.3061	0.5898	0.7680
No log	3.8667	174	0.6836	0.3214	0.6836	0.8268
No log	3.9111	176	0.6694	0.3480	0.6694	0.8182
No log	3.9556	178	0.6599	0.3514	0.6599	0.8124
No log	4.0	180	0.6593	0.3180	0.6593	0.8120
No log	4.0444	182	0.6224	0.2607	0.6224	0.7889
No log	4.0889	184	0.6141	0.2607	0.6141	0.7836
No log	4.1333	186	0.5972	0.3623	0.5972	0.7728
No log	4.1778	188	0.6176	0.2897	0.6176	0.7858
No log	4.2222	190	0.7360	0.3448	0.7360	0.8579
No log	4.2667	192	0.8546	0.3011	0.8546	0.9245
No log	4.3111	194	0.7274	0.2961	0.7274	0.8529
No log	4.3556	196	0.6775	0.2897	0.6775	0.8231
No log	4.4	198	0.7128	0.3043	0.7128	0.8443
No log	4.4444	200	0.8499	0.2941	0.8499	0.9219
No log	4.4889	202	0.7746	0.3651	0.7746	0.8801
No log	4.5333	204	0.7112	0.2877	0.7112	0.8433
No log	4.5778	206	0.7199	0.2877	0.7199	0.8485
No log	4.6222	208	0.7493	0.2744	0.7493	0.8656
No log	4.6667	210	0.7953	0.3000	0.7953	0.8918
No log	4.7111	212	0.8651	0.3386	0.8651	0.9301
No log	4.7556	214	0.9062	0.2714	0.9062	0.9520
No log	4.8	216	0.9271	0.1635	0.9271	0.9629
No log	4.8444	218	0.9008	0.1680	0.9008	0.9491
No log	4.8889	220	0.7280	0.3702	0.7280	0.8532
No log	4.9333	222	0.7214	0.3982	0.7214	0.8494
No log	4.9778	224	0.8595	0.2698	0.8595	0.9271
No log	5.0222	226	0.7725	0.3667	0.7725	0.8789
No log	5.0667	228	0.6080	0.3469	0.6080	0.7797
No log	5.1111	230	0.7409	0.3171	0.7409	0.8607
No log	5.1556	232	0.8939	0.3103	0.8939	0.9455
No log	5.2	234	0.9001	0.3333	0.9001	0.9487
No log	5.2444	236	0.7128	0.3527	0.7128	0.8443
No log	5.2889	238	0.6347	0.3448	0.6347	0.7967
No log	5.3333	240	0.5921	0.3365	0.5921	0.7695
No log	5.3778	242	0.6103	0.3833	0.6103	0.7812
No log	5.4222	244	0.6211	0.3422	0.6211	0.7881
No log	5.4667	246	0.7042	0.3115	0.7042	0.8392
No log	5.5111	248	0.7798	0.3147	0.7798	0.8831
No log	5.5556	250	0.6869	0.2775	0.6869	0.8288
No log	5.6	252	0.6805	0.4568	0.6805	0.8249
No log	5.6444	254	0.7013	0.4056	0.7013	0.8375
No log	5.6889	256	0.6817	0.3188	0.6817	0.8257
No log	5.7333	258	0.8617	0.3231	0.8617	0.9283
No log	5.7778	260	0.9119	0.3231	0.9119	0.9549
No log	5.8222	262	0.9703	0.2409	0.9703	0.9850
No log	5.8667	264	0.8622	0.3255	0.8622	0.9285
No log	5.9111	266	0.6741	0.2920	0.6741	0.8211
No log	5.9556	268	0.5940	0.3469	0.5940	0.7707
No log	6.0	270	0.6295	0.3927	0.6295	0.7934
No log	6.0444	272	0.5858	0.3200	0.5858	0.7654
No log	6.0889	274	0.6143	0.3153	0.6143	0.7838
No log	6.1333	276	0.6696	0.3898	0.6696	0.8183
No log	6.1778	278	0.6137	0.3818	0.6137	0.7834
No log	6.2222	280	0.6170	0.3028	0.6170	0.7855
No log	6.2667	282	0.7180	0.4008	0.7180	0.8473
No log	6.3111	284	0.6590	0.3818	0.6590	0.8118
No log	6.3556	286	0.6129	0.3498	0.6129	0.7829
No log	6.4	288	0.7701	0.3716	0.7701	0.8776
No log	6.4444	290	0.8935	0.2797	0.8935	0.9453
No log	6.4889	292	0.8949	0.2727	0.8949	0.9460
No log	6.5333	294	0.7200	0.4380	0.7200	0.8485
No log	6.5778	296	0.6407	0.3761	0.6407	0.8004
No log	6.6222	298	0.6345	0.3077	0.6345	0.7966
No log	6.6667	300	0.6440	0.3103	0.6440	0.8025
No log	6.7111	302	0.6355	0.3427	0.6355	0.7972
No log	6.7556	304	0.6918	0.3702	0.6918	0.8317
No log	6.8	306	0.7403	0.3719	0.7403	0.8604
No log	6.8444	308	0.8113	0.3488	0.8113	0.9007
No log	6.8889	310	0.8317	0.3882	0.8317	0.9120
No log	6.9333	312	0.7305	0.3306	0.7305	0.8547
No log	6.9778	314	0.6811	0.3648	0.6811	0.8253
No log	7.0222	316	0.6848	0.2941	0.6848	0.8275
No log	7.0667	318	0.6988	0.2830	0.6988	0.8359
No log	7.1111	320	0.7094	0.3333	0.7094	0.8423
No log	7.1556	322	0.7833	0.2727	0.7833	0.8850
No log	7.2	324	0.8943	0.3134	0.8943	0.9457
No log	7.2444	326	0.8807	0.3383	0.8807	0.9385
No log	7.2889	328	0.8077	0.3103	0.8077	0.8987
No log	7.3333	330	0.7124	0.2821	0.7124	0.8440
No log	7.3778	332	0.6906	0.3305	0.6906	0.8310
No log	7.4222	334	0.7162	0.3504	0.7162	0.8463
No log	7.4667	336	0.7907	0.3410	0.7907	0.8892
No log	7.5111	338	0.9022	0.3208	0.9022	0.9498
No log	7.5556	340	0.8775	0.3208	0.8775	0.9367
No log	7.6	342	0.8107	0.3255	0.8107	0.9004
No log	7.6444	344	0.7586	0.3613	0.7586	0.8710
No log	7.6889	346	0.6508	0.3448	0.6508	0.8067
No log	7.7333	348	0.6096	0.3607	0.6096	0.7808
No log	7.7778	350	0.6117	0.3514	0.6117	0.7821
No log	7.8222	352	0.6540	0.3214	0.6540	0.8087
No log	7.8667	354	0.8106	0.3633	0.8106	0.9004
No log	7.9111	356	1.0004	0.2177	1.0004	1.0002
No log	7.9556	358	1.0842	0.1367	1.0842	1.0412
No log	8.0	360	1.0118	0.2177	1.0118	1.0059
No log	8.0444	362	0.8932	0.3208	0.8932	0.9451
No log	8.0889	364	0.8014	0.3909	0.8014	0.8952
No log	8.1333	366	0.7066	0.3593	0.7066	0.8406
No log	8.1778	368	0.6999	0.3418	0.6999	0.8366
No log	8.2222	370	0.6725	0.3702	0.6725	0.8201
No log	8.2667	372	0.6585	0.3702	0.6585	0.8115
No log	8.3111	374	0.6763	0.3702	0.6763	0.8224
No log	8.3556	376	0.7269	0.4050	0.7269	0.8526
No log	8.4	378	0.7916	0.4146	0.7916	0.8897
No log	8.4444	380	0.8147	0.4146	0.8147	0.9026
No log	8.4889	382	0.8370	0.375	0.8370	0.9149
No log	8.5333	384	0.8181	0.4146	0.8181	0.9045
No log	8.5778	386	0.7502	0.3735	0.7502	0.8661
No log	8.6222	388	0.7049	0.3719	0.7049	0.8396
No log	8.6667	390	0.6981	0.3418	0.6981	0.8355
No log	8.7111	392	0.7309	0.3859	0.7309	0.8549
No log	8.7556	394	0.7677	0.4104	0.7677	0.8762
No log	8.8	396	0.7558	0.4104	0.7558	0.8694
No log	8.8444	398	0.7053	0.3859	0.7053	0.8398
No log	8.8889	400	0.6425	0.3242	0.6425	0.8016
No log	8.9333	402	0.5967	0.3365	0.5967	0.7724
No log	8.9778	404	0.5839	0.3271	0.5839	0.7641
No log	9.0222	406	0.5776	0.3271	0.5776	0.7600
No log	9.0667	408	0.5726	0.2963	0.5726	0.7567
No log	9.1111	410	0.5732	0.3052	0.5732	0.7571
No log	9.1556	412	0.5937	0.3739	0.5937	0.7705
No log	9.2	414	0.6189	0.4027	0.6189	0.7867
No log	9.2444	416	0.6433	0.4336	0.6433	0.8021
No log	9.2889	418	0.6526	0.4336	0.6526	0.8078
No log	9.3333	420	0.6538	0.4336	0.6538	0.8086
No log	9.3778	422	0.6542	0.4336	0.6542	0.8088
No log	9.4222	424	0.6421	0.4336	0.6421	0.8013
No log	9.4667	426	0.6203	0.4336	0.6203	0.7876
No log	9.5111	428	0.6011	0.3739	0.6011	0.7753
No log	9.5556	430	0.5873	0.3739	0.5873	0.7663
No log	9.6	432	0.5878	0.3739	0.5878	0.7667
No log	9.6444	434	0.5843	0.3739	0.5843	0.7644
No log	9.6889	436	0.5825	0.3739	0.5825	0.7632
No log	9.7333	438	0.5850	0.3739	0.5850	0.7649
No log	9.7778	440	0.5910	0.3739	0.5910	0.7688
No log	9.8222	442	0.5965	0.3739	0.5965	0.7723
No log	9.8667	444	0.5994	0.3739	0.5994	0.7742
No log	9.9111	446	0.6038	0.3739	0.6038	0.7770
No log	9.9556	448	0.6067	0.3739	0.6067	0.7789
No log	10.0	450	0.6078	0.3739	0.6078	0.7796

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024