ArabicNewSplits_FineTuningAraBERT_AugV5_k10_task1_organization_fold0

MayBashendy/ArabicNewSplits_FineTuningAraBERT_AugV5_k10_task1_organization_fold0

ArabicNewSplits_FineTuningAraBERT_AugV5_k10_task1_organization_fold0 is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

51% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Nov 26, 2024
Updated: Nov 26, 2024
SHA: 645286c1

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits_FineTuningAraBERT_AugV5_k10_task1_organization_fold0

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 1.6461
Qwk: 0.2930
Mse: 1.6461
Rmse: 1.2830

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0392	2	4.6913	-0.0222	4.6913	2.1659
No log	0.0784	4	2.6493	0.1510	2.6493	1.6277
No log	0.1176	6	1.9918	0.0520	1.9918	1.4113
No log	0.1569	8	1.5229	0.0403	1.5229	1.2341
No log	0.1961	10	1.1285	0.0337	1.1285	1.0623
No log	0.2353	12	1.1284	0.0337	1.1284	1.0623
No log	0.2745	14	1.2669	0.0337	1.2669	1.1256
No log	0.3137	16	1.2509	0.0337	1.2509	1.1184
No log	0.3529	18	1.1815	0.0337	1.1815	1.0870
No log	0.3922	20	1.1319	0.0337	1.1319	1.0639
No log	0.4314	22	1.0886	0.0825	1.0886	1.0433
No log	0.4706	24	1.0941	0.0952	1.0941	1.0460
No log	0.5098	26	1.0589	0.1393	1.0589	1.0290
No log	0.5490	28	1.0502	0.1929	1.0502	1.0248
No log	0.5882	30	1.0615	0.2576	1.0615	1.0303
No log	0.6275	32	1.0739	0.2130	1.0739	1.0363
No log	0.6667	34	1.1118	0.0393	1.1118	1.0544
No log	0.7059	36	1.1727	0.0131	1.1727	1.0829
No log	0.7451	38	1.2063	0.0	1.2063	1.0983
No log	0.7843	40	1.2094	0.0	1.2094	1.0997
No log	0.8235	42	1.1553	0.1104	1.1553	1.0749
No log	0.8627	44	1.0922	0.1126	1.0922	1.0451
No log	0.9020	46	1.0181	0.3680	1.0181	1.0090
No log	0.9412	48	0.9960	0.3864	0.9960	0.9980
No log	0.9804	50	1.0128	0.3951	1.0128	1.0064
No log	1.0196	52	1.0492	0.2860	1.0492	1.0243
No log	1.0588	54	0.9747	0.3738	0.9747	0.9873
No log	1.0980	56	0.8749	0.4533	0.8749	0.9353
No log	1.1373	58	0.8940	0.4149	0.8940	0.9455
No log	1.1765	60	0.9695	0.3540	0.9695	0.9846
No log	1.2157	62	1.0173	0.1363	1.0173	1.0086
No log	1.2549	64	0.9894	0.3673	0.9894	0.9947
No log	1.2941	66	0.9081	0.4282	0.9081	0.9529
No log	1.3333	68	0.8504	0.4520	0.8504	0.9222
No log	1.3725	70	0.8724	0.3944	0.8725	0.9341
No log	1.4118	72	0.9556	0.3229	0.9556	0.9775
No log	1.4510	74	1.1542	0.1767	1.1542	1.0743
No log	1.4902	76	1.3015	0.1226	1.3015	1.1408
No log	1.5294	78	1.2311	0.0937	1.2311	1.1095
No log	1.5686	80	1.1485	0.1573	1.1485	1.0717
No log	1.6078	82	0.9931	0.3448	0.9931	0.9965
No log	1.6471	84	0.8343	0.4381	0.8343	0.9134
No log	1.6863	86	0.7123	0.4232	0.7123	0.8440
No log	1.7255	88	0.7317	0.4707	0.7317	0.8554
No log	1.7647	90	0.7732	0.5498	0.7732	0.8793
No log	1.8039	92	0.8262	0.5983	0.8262	0.9089
No log	1.8431	94	0.9498	0.4987	0.9498	0.9746
No log	1.8824	96	1.1538	0.4598	1.1538	1.0742
No log	1.9216	98	1.3456	0.3722	1.3456	1.1600
No log	1.9608	100	1.5162	0.3078	1.5162	1.2313
No log	2.0	102	1.5638	0.3241	1.5638	1.2505
No log	2.0392	104	1.3661	0.3334	1.3661	1.1688
No log	2.0784	106	1.1074	0.3420	1.1074	1.0523
No log	2.1176	108	1.0089	0.2233	1.0089	1.0044
No log	2.1569	110	0.9250	0.3506	0.9250	0.9618
No log	2.1961	112	0.8878	0.4875	0.8878	0.9422
No log	2.2353	114	1.1811	0.5026	1.1811	1.0868
No log	2.2745	116	1.4928	0.3594	1.4928	1.2218
No log	2.3137	118	1.6063	0.3363	1.6063	1.2674
No log	2.3529	120	1.6752	0.3138	1.6752	1.2943
No log	2.3922	122	1.6040	0.3787	1.6040	1.2665
No log	2.4314	124	1.4525	0.3948	1.4525	1.2052
No log	2.4706	126	1.5540	0.3818	1.5540	1.2466
No log	2.5098	128	1.6046	0.3589	1.6046	1.2667
No log	2.5490	130	1.6988	0.2904	1.6988	1.3034
No log	2.5882	132	1.5454	0.3337	1.5454	1.2431
No log	2.6275	134	1.4115	0.3317	1.4115	1.1881
No log	2.6667	136	1.4431	0.3346	1.4431	1.2013
No log	2.7059	138	1.7129	0.3479	1.7129	1.3088
No log	2.7451	140	1.7357	0.3479	1.7357	1.3175
No log	2.7843	142	1.6476	0.3564	1.6476	1.2836
No log	2.8235	144	1.7295	0.3587	1.7295	1.3151
No log	2.8627	146	1.6486	0.3777	1.6486	1.2840
No log	2.9020	148	1.5491	0.4135	1.5491	1.2446
No log	2.9412	150	1.3940	0.4070	1.3940	1.1807
No log	2.9804	152	1.2264	0.4246	1.2264	1.1074
No log	3.0196	154	1.2075	0.4246	1.2075	1.0989
No log	3.0588	156	1.3224	0.3986	1.3224	1.1500
No log	3.0980	158	1.2725	0.4267	1.2725	1.1281
No log	3.1373	160	1.2228	0.4267	1.2228	1.1058
No log	3.1765	162	1.3682	0.4225	1.3682	1.1697
No log	3.2157	164	1.6262	0.3669	1.6262	1.2752
No log	3.2549	166	1.7314	0.3136	1.7314	1.3158
No log	3.2941	168	1.6920	0.3337	1.6920	1.3008
No log	3.3333	170	1.5276	0.3284	1.5276	1.2360
No log	3.3725	172	1.2493	0.4066	1.2493	1.1177
No log	3.4118	174	1.0830	0.4642	1.0830	1.0407
No log	3.4510	176	1.0084	0.5766	1.0084	1.0042
No log	3.4902	178	1.0676	0.5095	1.0676	1.0333
No log	3.5294	180	1.2301	0.4066	1.2301	1.1091
No log	3.5686	182	1.5169	0.3428	1.5170	1.2316
No log	3.6078	184	1.7026	0.2988	1.7026	1.3048
No log	3.6471	186	1.8172	0.3018	1.8172	1.3480
No log	3.6863	188	1.8389	0.3018	1.8389	1.3561
No log	3.7255	190	1.8137	0.3018	1.8137	1.3467
No log	3.7647	192	1.6917	0.3479	1.6917	1.3006
No log	3.8039	194	1.6329	0.3454	1.6329	1.2778
No log	3.8431	196	1.6671	0.3256	1.6671	1.2912
No log	3.8824	198	1.7354	0.2799	1.7354	1.3173
No log	3.9216	200	1.7418	0.2700	1.7418	1.3198
No log	3.9608	202	1.7851	0.2700	1.7851	1.3361
No log	4.0	204	1.8025	0.2956	1.8025	1.3426
No log	4.0392	206	1.8041	0.3151	1.8041	1.3432
No log	4.0784	208	1.9386	0.2640	1.9386	1.3923
No log	4.1176	210	2.0152	0.2420	2.0152	1.4196
No log	4.1569	212	1.9043	0.2604	1.9043	1.3800
No log	4.1961	214	1.7915	0.2894	1.7915	1.3385
No log	4.2353	216	1.7138	0.2894	1.7138	1.3091
No log	4.2745	218	1.7776	0.2894	1.7776	1.3333
No log	4.3137	220	1.8684	0.2894	1.8684	1.3669
No log	4.3529	222	1.9418	0.2796	1.9418	1.3935
No log	4.3922	224	2.0648	0.2246	2.0648	1.4369
No log	4.4314	226	2.1287	0.2256	2.1287	1.4590
No log	4.4706	228	2.1288	0.2313	2.1288	1.4590
No log	4.5098	230	2.0963	0.2303	2.0963	1.4479
No log	4.5490	232	1.8911	0.2796	1.8911	1.3752
No log	4.5882	234	1.7468	0.2861	1.7468	1.3217
No log	4.6275	236	1.7176	0.2861	1.7176	1.3106
No log	4.6667	238	1.7667	0.2861	1.7667	1.3292
No log	4.7059	240	1.6913	0.2792	1.6913	1.3005
No log	4.7451	242	1.6818	0.2963	1.6818	1.2968
No log	4.7843	244	1.5711	0.2755	1.5711	1.2534
No log	4.8235	246	1.4328	0.3071	1.4328	1.1970
No log	4.8627	248	1.3559	0.3424	1.3559	1.1644
No log	4.9020	250	1.4241	0.3307	1.4241	1.1934
No log	4.9412	252	1.6927	0.2963	1.6927	1.3011
No log	4.9804	254	1.9992	0.2420	1.9992	1.4139
No log	5.0196	256	2.0784	0.2246	2.0784	1.4417
No log	5.0588	258	1.9891	0.2206	1.9891	1.4103
No log	5.0980	260	1.9321	0.2607	1.9321	1.3900
No log	5.1373	262	1.7301	0.3058	1.7301	1.3153
No log	5.1765	264	1.5307	0.3412	1.5307	1.2372
No log	5.2157	266	1.4830	0.3675	1.4830	1.2178
No log	5.2549	268	1.6004	0.3337	1.6004	1.2651
No log	5.2941	270	1.7406	0.2996	1.7406	1.3193
No log	5.3333	272	1.7816	0.2927	1.7816	1.3348
No log	5.3725	274	1.6858	0.3058	1.6858	1.2984
No log	5.4118	276	1.6335	0.3133	1.6335	1.2781
No log	5.4510	278	1.6387	0.3037	1.6387	1.2801
No log	5.4902	280	1.6723	0.3133	1.6723	1.2932
No log	5.5294	282	1.6661	0.3133	1.6661	1.2908
No log	5.5686	284	1.6978	0.3193	1.6978	1.3030
No log	5.6078	286	1.7621	0.2894	1.7621	1.3274
No log	5.6471	288	1.8023	0.2996	1.8023	1.3425
No log	5.6863	290	1.8632	0.2904	1.8632	1.3650
No log	5.7255	292	1.8794	0.2904	1.8794	1.3709
No log	5.7647	294	1.8031	0.2894	1.8031	1.3428
No log	5.8039	296	1.6113	0.3243	1.6113	1.2694
No log	5.8431	298	1.4181	0.3582	1.4181	1.1908
No log	5.8824	300	1.3170	0.3846	1.3170	1.1476
No log	5.9216	302	1.3492	0.3626	1.3492	1.1615
No log	5.9608	304	1.4928	0.3249	1.4928	1.2218
No log	6.0	306	1.7259	0.2900	1.7259	1.3137
No log	6.0392	308	1.8483	0.2445	1.8483	1.3595
No log	6.0784	310	1.8345	0.2674	1.8345	1.3544
No log	6.1176	312	1.6918	0.2963	1.6918	1.3007
No log	6.1569	314	1.4753	0.3249	1.4753	1.2146
No log	6.1961	316	1.3881	0.3336	1.3881	1.1782
No log	6.2353	318	1.3943	0.3336	1.3943	1.1808
No log	6.2745	320	1.4764	0.3444	1.4764	1.2151
No log	6.3137	322	1.6399	0.2930	1.6399	1.2806
No log	6.3529	324	1.7479	0.2764	1.7479	1.3221
No log	6.3922	326	1.7975	0.2764	1.7975	1.3407
No log	6.4314	328	1.7842	0.2963	1.7842	1.3357
No log	6.4706	330	1.8409	0.2963	1.8409	1.3568
No log	6.5098	332	2.0387	0.2332	2.0387	1.4278
No log	6.5490	334	2.2313	0.2332	2.2313	1.4938
No log	6.5882	336	2.3421	0.1977	2.3421	1.5304
No log	6.6275	338	2.3400	0.2017	2.3400	1.5297
No log	6.6667	340	2.2965	0.2040	2.2965	1.5154
No log	6.7059	342	2.3107	0.2001	2.3107	1.5201
No log	6.7451	344	2.2460	0.1960	2.2460	1.4987
No log	6.7843	346	2.1095	0.2332	2.1095	1.4524
No log	6.8235	348	1.9306	0.2829	1.9306	1.3895
No log	6.8627	350	1.7332	0.3027	1.7332	1.3165
No log	6.9020	352	1.5316	0.3540	1.5316	1.2376
No log	6.9412	354	1.3829	0.3957	1.3829	1.1759
No log	6.9804	356	1.3226	0.3789	1.3226	1.1500
No log	7.0196	358	1.3517	0.3434	1.3517	1.1626
No log	7.0588	360	1.4731	0.2969	1.4731	1.2137
No log	7.0980	362	1.5604	0.3146	1.5604	1.2492
No log	7.1373	364	1.6399	0.3037	1.6399	1.2806
No log	7.1765	366	1.6510	0.2930	1.6510	1.2849
No log	7.2157	368	1.5784	0.3037	1.5784	1.2563
No log	7.2549	370	1.4765	0.3243	1.4765	1.2151
No log	7.2941	372	1.4109	0.3788	1.4109	1.1878
No log	7.3333	374	1.4156	0.4061	1.4156	1.1898
No log	7.3725	376	1.4889	0.3735	1.4889	1.2202
No log	7.4118	378	1.5744	0.3492	1.5744	1.2548
No log	7.4510	380	1.6892	0.3193	1.6892	1.2997
No log	7.4902	382	1.8447	0.2829	1.8447	1.3582
No log	7.5294	384	1.9692	0.2458	1.9692	1.4033
No log	7.5686	386	2.0522	0.2458	2.0522	1.4325
No log	7.6078	388	2.0282	0.2400	2.0282	1.4242
No log	7.6471	390	1.9246	0.2458	1.9246	1.3873
No log	7.6863	392	1.7801	0.2996	1.7801	1.3342
No log	7.7255	394	1.6247	0.3164	1.6247	1.2746
No log	7.7647	396	1.5084	0.3308	1.5084	1.2282
No log	7.8039	398	1.4302	0.3909	1.4302	1.1959
No log	7.8431	400	1.4135	0.3743	1.4135	1.1889
No log	7.8824	402	1.4338	0.3743	1.4338	1.1974
No log	7.9216	404	1.4936	0.3182	1.4936	1.2221
No log	7.9608	406	1.5402	0.3182	1.5402	1.2410
No log	8.0	408	1.5800	0.3356	1.5800	1.2570
No log	8.0392	410	1.5620	0.3182	1.5620	1.2498
No log	8.0784	412	1.5681	0.3182	1.5681	1.2523
No log	8.1176	414	1.6396	0.3027	1.6396	1.2805
No log	8.1569	416	1.6826	0.3058	1.6826	1.2972
No log	8.1961	418	1.6524	0.3058	1.6524	1.2855
No log	8.2353	420	1.5812	0.3133	1.5812	1.2575
No log	8.2745	422	1.5062	0.3598	1.5062	1.2273
No log	8.3137	424	1.4666	0.3598	1.4666	1.2110
No log	8.3529	426	1.4720	0.3479	1.4720	1.2133
No log	8.3922	428	1.5235	0.3531	1.5235	1.2343
No log	8.4314	430	1.6112	0.3262	1.6112	1.2693
No log	8.4706	432	1.7217	0.2963	1.7217	1.3121
No log	8.5098	434	1.8236	0.2894	1.8236	1.3504
No log	8.5490	436	1.8625	0.2604	1.8625	1.3647
No log	8.5882	438	1.8357	0.2604	1.8357	1.3549
No log	8.6275	440	1.7847	0.2833	1.7847	1.3359
No log	8.6667	442	1.7280	0.2861	1.7280	1.3146
No log	8.7059	444	1.6472	0.2930	1.6472	1.2834
No log	8.7451	446	1.5908	0.2930	1.5908	1.2613
No log	8.7843	448	1.5532	0.3146	1.5532	1.2463
No log	8.8235	450	1.5531	0.3146	1.5531	1.2462
No log	8.8627	452	1.5603	0.3146	1.5603	1.2491
No log	8.9020	454	1.5868	0.2930	1.5868	1.2597
No log	8.9412	456	1.6112	0.2930	1.6112	1.2693
No log	8.9804	458	1.6338	0.2930	1.6338	1.2782
No log	9.0196	460	1.6723	0.2930	1.6723	1.2932
No log	9.0588	462	1.6824	0.2930	1.6824	1.2971
No log	9.0980	464	1.6682	0.2930	1.6682	1.2916
No log	9.1373	466	1.6478	0.2930	1.6478	1.2837
No log	9.1765	468	1.6126	0.2930	1.6126	1.2699
No log	9.2157	470	1.6040	0.2930	1.6040	1.2665
No log	9.2549	472	1.6171	0.2930	1.6171	1.2716
No log	9.2941	474	1.6316	0.2930	1.6316	1.2773
No log	9.3333	476	1.6362	0.2930	1.6362	1.2791
No log	9.3725	478	1.6225	0.2930	1.6225	1.2738
No log	9.4118	480	1.6104	0.2930	1.6104	1.2690
No log	9.4510	482	1.5988	0.2930	1.5988	1.2644
No log	9.4902	484	1.5932	0.2930	1.5932	1.2622
No log	9.5294	486	1.5901	0.2930	1.5901	1.2610
No log	9.5686	488	1.5995	0.2930	1.5995	1.2647
No log	9.6078	490	1.6175	0.2930	1.6175	1.2718
No log	9.6471	492	1.6329	0.2930	1.6329	1.2778
No log	9.6863	494	1.6404	0.2930	1.6404	1.2808
No log	9.7255	496	1.6401	0.2930	1.6401	1.2807
No log	9.7647	498	1.6420	0.2930	1.6420	1.2814
0.3785	9.8039	500	1.6401	0.2930	1.6401	1.2807
0.3785	9.8431	502	1.6386	0.2930	1.6386	1.2801
0.3785	9.8824	504	1.6415	0.2930	1.6415	1.2812
0.3785	9.9216	506	1.6433	0.2930	1.6433	1.2819
0.3785	9.9608	508	1.6450	0.2930	1.6450	1.2826
0.3785	10.0	510	1.6461	0.2930	1.6461	1.2830

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Nov 26, 2024
Updated: Nov 26, 2024