ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k15_task3_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k15_task3_organization

ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k15_task3_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

51% of all-time downloads

All-time downloads

Public

Parameters

135M

1.1 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: 99f72ee2

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k15_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.5805
Qwk: 0.3829
Mse: 0.5805
Rmse: 0.7619

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0333	2	3.1575	-0.0041	3.1575	1.7769
No log	0.0667	4	1.5257	-0.0070	1.5257	1.2352
No log	0.1	6	1.1326	0.0632	1.1326	1.0642
No log	0.1333	8	1.4657	0.0632	1.4657	1.2107
No log	0.1667	10	0.8367	0.0769	0.8367	0.9147
No log	0.2	12	0.6363	0.2418	0.6363	0.7977
No log	0.2333	14	0.5489	0.0569	0.5489	0.7409
No log	0.2667	16	0.6122	0.2778	0.6122	0.7824
No log	0.3	18	0.6585	0.3684	0.6585	0.8115
No log	0.3333	20	0.6552	0.3898	0.6552	0.8095
No log	0.3667	22	0.8354	0.1333	0.8354	0.9140
No log	0.4	24	1.1567	0.0698	1.1567	1.0755
No log	0.4333	26	1.0029	0.0431	1.0029	1.0015
No log	0.4667	28	0.8010	0.1925	0.8010	0.8950
No log	0.5	30	0.6002	-0.0081	0.6002	0.7747
No log	0.5333	32	0.5633	0.0	0.5633	0.7505
No log	0.5667	34	0.5580	0.0	0.5580	0.7470
No log	0.6	36	0.5594	0.0	0.5594	0.7480
No log	0.6333	38	0.5727	0.1746	0.5727	0.7568
No log	0.6667	40	0.5615	0.0	0.5615	0.7493
No log	0.7	42	0.5790	0.1746	0.5790	0.7609
No log	0.7333	44	0.8647	0.0667	0.8647	0.9299
No log	0.7667	46	1.1607	0.0345	1.1607	1.0774
No log	0.8	48	0.8161	0.0476	0.8161	0.9034
No log	0.8333	50	0.5624	0.0	0.5624	0.7499
No log	0.8667	52	0.5857	0.0	0.5857	0.7653
No log	0.9	54	0.5880	0.0	0.5880	0.7668
No log	0.9333	56	0.5768	0.0	0.5768	0.7595
No log	0.9667	58	0.5704	0.0	0.5704	0.7552
No log	1.0	60	0.6095	0.1773	0.6095	0.7807
No log	1.0333	62	0.6006	0.1407	0.6006	0.7750
No log	1.0667	64	0.6057	0.0815	0.6057	0.7783
No log	1.1	66	0.5643	0.0	0.5643	0.7512
No log	1.1333	68	0.5855	0.0	0.5855	0.7652
No log	1.1667	70	0.5687	0.0	0.5687	0.7541
No log	1.2	72	0.5826	0.1304	0.5826	0.7633
No log	1.2333	74	0.8767	0.1111	0.8767	0.9363
No log	1.2667	76	1.1151	0.0388	1.1151	1.0560
No log	1.3	78	1.1595	0.0388	1.1595	1.0768
No log	1.3333	80	0.9383	0.0947	0.9383	0.9686
No log	1.3667	82	0.6448	0.0692	0.6448	0.8030
No log	1.4	84	0.6501	0.0080	0.6501	0.8063
No log	1.4333	86	0.6625	0.0815	0.6625	0.8139
No log	1.4667	88	0.8243	-0.0753	0.8243	0.9079
No log	1.5	90	1.1998	-0.0233	1.1998	1.0953
No log	1.5333	92	1.6148	-0.0350	1.6148	1.2707
No log	1.5667	94	1.2408	0.0388	1.2408	1.1139
No log	1.6	96	0.7343	0.0123	0.7343	0.8569
No log	1.6333	98	0.7265	0.1688	0.7265	0.8524
No log	1.6667	100	0.7451	0.0769	0.7451	0.8632
No log	1.7	102	0.7599	0.1429	0.7599	0.8717
No log	1.7333	104	0.7662	0.0805	0.7662	0.8753
No log	1.7667	106	0.7364	-0.0864	0.7364	0.8581
No log	1.8	108	0.7116	0.0380	0.7116	0.8436
No log	1.8333	110	0.7018	0.1351	0.7018	0.8377
No log	1.8667	112	0.7978	0.1340	0.7978	0.8932
No log	1.9	114	0.9322	0.1373	0.9322	0.9655
No log	1.9333	116	0.6915	0.1220	0.6915	0.8316
No log	1.9667	118	0.8338	0.2000	0.8338	0.9131
No log	2.0	120	0.9567	0.1333	0.9567	0.9781
No log	2.0333	122	0.8004	0.1068	0.8004	0.8947
No log	2.0667	124	0.7208	0.0061	0.7208	0.8490
No log	2.1	126	0.7484	0.0899	0.7484	0.8651
No log	2.1333	128	0.8384	0.1855	0.8384	0.9157
No log	2.1667	130	0.8385	0.1028	0.8385	0.9157
No log	2.2	132	0.8428	0.0531	0.8428	0.9181
No log	2.2333	134	0.8010	0.1753	0.8010	0.8950
No log	2.2667	136	0.8009	0.1304	0.8009	0.8949
No log	2.3	138	0.7878	0.1220	0.7878	0.8876
No log	2.3333	140	1.0248	0.0791	1.0248	1.0123
No log	2.3667	142	0.7586	0.1855	0.7586	0.8710
No log	2.4	144	0.6692	0.3161	0.6692	0.8180
No log	2.4333	146	0.8561	0.1481	0.8561	0.9253
No log	2.4667	148	0.6169	0.3407	0.6169	0.7854
No log	2.5	150	0.5555	0.2418	0.5555	0.7453
No log	2.5333	152	0.6409	0.2865	0.6409	0.8006
No log	2.5667	154	0.6305	0.2340	0.6305	0.7941
No log	2.6	156	0.5926	0.1053	0.5926	0.7698
No log	2.6333	158	0.6270	0.1638	0.6270	0.7918
No log	2.6667	160	0.6121	0.3253	0.6121	0.7824
No log	2.7	162	1.0257	0.0690	1.0257	1.0128
No log	2.7333	164	1.0694	0.1496	1.0694	1.0341
No log	2.7667	166	0.6951	0.2083	0.6951	0.8337
No log	2.8	168	0.7845	0.2423	0.7845	0.8857
No log	2.8333	170	0.9089	0.1318	0.9089	0.9533
No log	2.8667	172	0.7887	0.1549	0.7887	0.8881
No log	2.9	174	0.6321	0.2683	0.6321	0.7951
No log	2.9333	176	0.7487	0.1456	0.7487	0.8653
No log	2.9667	178	0.7476	0.1921	0.7476	0.8646
No log	3.0	180	0.6001	0.2941	0.6001	0.7747
No log	3.0333	182	0.6254	0.1529	0.6254	0.7908
No log	3.0667	184	0.6749	0.2083	0.6749	0.8215
No log	3.1	186	0.5868	0.1807	0.5868	0.7660
No log	3.1333	188	0.6351	0.3149	0.6351	0.7970
No log	3.1667	190	0.5926	0.3371	0.5926	0.7698
No log	3.2	192	0.6100	0.2000	0.6100	0.7810
No log	3.2333	194	0.6579	0.24	0.6579	0.8111
No log	3.2667	196	0.6305	0.2000	0.6305	0.7941
No log	3.3	198	0.6804	0.2000	0.6804	0.8249
No log	3.3333	200	0.6431	0.2184	0.6431	0.8019
No log	3.3667	202	0.6729	0.1325	0.6729	0.8203
No log	3.4	204	0.7344	0.2513	0.7344	0.8570
No log	3.4333	206	0.6510	0.2575	0.6510	0.8068
No log	3.4667	208	0.7153	0.2381	0.7153	0.8458
No log	3.5	210	0.8454	0.2579	0.8454	0.9195
No log	3.5333	212	0.7389	0.2074	0.7389	0.8596
No log	3.5667	214	0.6488	0.1411	0.6488	0.8055
No log	3.6	216	0.8337	0.1045	0.8337	0.9131
No log	3.6333	218	0.7752	0.2000	0.7752	0.8805
No log	3.6667	220	0.6023	0.2393	0.6023	0.7761
No log	3.7	222	0.5899	0.2393	0.5899	0.7681
No log	3.7333	224	0.5912	0.2289	0.5912	0.7689
No log	3.7667	226	0.6111	0.1086	0.6111	0.7818
No log	3.8	228	0.6032	0.2471	0.6032	0.7767
No log	3.8333	230	0.6192	0.3846	0.6192	0.7869
No log	3.8667	232	0.6054	0.2281	0.6054	0.7781
No log	3.9	234	0.7252	0.2146	0.7252	0.8516
No log	3.9333	236	0.7839	0.2920	0.7839	0.8854
No log	3.9667	238	0.6183	0.2000	0.6183	0.7863
No log	4.0	240	0.5927	0.2000	0.5927	0.7699
No log	4.0333	242	0.5907	0.2000	0.5907	0.7686
No log	4.0667	244	0.6856	0.2464	0.6856	0.8280
No log	4.1	246	0.7763	0.2897	0.7763	0.8811
No log	4.1333	248	0.7072	0.2536	0.7072	0.8410
No log	4.1667	250	0.6351	0.3089	0.6351	0.7969
No log	4.2	252	0.6177	0.2179	0.6177	0.7860
No log	4.2333	254	0.6836	0.3116	0.6836	0.8268
No log	4.2667	256	0.8239	0.3195	0.8239	0.9077
No log	4.3	258	0.7376	0.3274	0.7376	0.8588
No log	4.3333	260	0.5409	0.2626	0.5409	0.7354
No log	4.3667	262	0.5685	0.3478	0.5685	0.7540
No log	4.4	264	0.5469	0.3258	0.5469	0.7395
No log	4.4333	266	0.5451	0.2350	0.5451	0.7383
No log	4.4667	268	0.5911	0.2941	0.5911	0.7688
No log	4.5	270	0.5258	0.2179	0.5258	0.7251
No log	4.5333	272	0.5314	0.2179	0.5314	0.7290
No log	4.5667	274	0.5381	0.2644	0.5381	0.7335
No log	4.6	276	0.5676	0.2258	0.5676	0.7534
No log	4.6333	278	0.5653	0.2967	0.5653	0.7518
No log	4.6667	280	0.6174	0.2245	0.6174	0.7858
No log	4.7	282	0.6818	0.2727	0.6818	0.8257
No log	4.7333	284	0.8366	0.2593	0.8366	0.9147
No log	4.7667	286	0.8094	0.2632	0.8094	0.8997
No log	4.8	288	0.6656	0.3524	0.6656	0.8158
No log	4.8333	290	0.5840	0.3023	0.5840	0.7642
No log	4.8667	292	0.5981	0.2000	0.5981	0.7734
No log	4.9	294	0.5824	0.2471	0.5824	0.7631
No log	4.9333	296	0.5948	0.3073	0.5948	0.7712
No log	4.9667	298	0.7520	0.2963	0.7520	0.8672
No log	5.0	300	1.0968	0.1724	1.0968	1.0473
No log	5.0333	302	1.3237	0.1000	1.3237	1.1505
No log	5.0667	304	1.2133	0.0968	1.2133	1.1015
No log	5.1	306	0.8978	0.2000	0.8978	0.9475
No log	5.1333	308	0.5645	0.2889	0.5645	0.7514
No log	5.1667	310	0.5464	0.3829	0.5464	0.7392
No log	5.2	312	0.5584	0.3829	0.5584	0.7473
No log	5.2333	314	0.5217	0.2704	0.5217	0.7223
No log	5.2667	316	0.5880	0.2941	0.5880	0.7668
No log	5.3	318	0.6810	0.2727	0.6810	0.8252
No log	5.3333	320	0.7134	0.3077	0.7134	0.8446
No log	5.3667	322	0.6097	0.2917	0.6097	0.7808
No log	5.4	324	0.5534	0.2795	0.5534	0.7439
No log	5.4333	326	0.5676	0.2099	0.5676	0.7534
No log	5.4667	328	0.5728	0.2575	0.5728	0.7568
No log	5.5	330	0.5870	0.1823	0.5870	0.7662
No log	5.5333	332	0.6446	0.2390	0.6446	0.8029
No log	5.5667	334	0.6708	0.2000	0.6708	0.8190
No log	5.6	336	0.6032	0.1908	0.6032	0.7766
No log	5.6333	338	0.5807	0.3182	0.5807	0.7621
No log	5.6667	340	0.5878	0.3730	0.5878	0.7667
No log	5.7	342	0.5515	0.3757	0.5515	0.7427
No log	5.7333	344	0.5617	0.2000	0.5617	0.7494
No log	5.7667	346	0.6342	0.2475	0.6342	0.7963
No log	5.8	348	0.6061	0.2527	0.6061	0.7785
No log	5.8333	350	0.5502	0.3054	0.5502	0.7418
No log	5.8667	352	0.5727	0.2771	0.5727	0.7568
No log	5.9	354	0.5776	0.2883	0.5776	0.7600
No log	5.9333	356	0.5718	0.2201	0.5718	0.7562
No log	5.9667	358	0.6118	0.2360	0.6118	0.7822
No log	6.0	360	0.6036	0.2360	0.6036	0.7769
No log	6.0333	362	0.5785	0.2201	0.5785	0.7606
No log	6.0667	364	0.6017	0.3136	0.6017	0.7757
No log	6.1	366	0.5944	0.1902	0.5944	0.7710
No log	6.1333	368	0.5885	0.2201	0.5885	0.7671
No log	6.1667	370	0.5953	0.1304	0.5953	0.7716
No log	6.2	372	0.6101	0.1556	0.6101	0.7811
No log	6.2333	374	0.5980	0.1500	0.5980	0.7733
No log	6.2667	376	0.6137	0.1556	0.6137	0.7834
No log	6.3	378	0.6169	0.1556	0.6169	0.7854
No log	6.3333	380	0.6038	0.1813	0.6038	0.7770
No log	6.3667	382	0.6061	0.1813	0.6061	0.7786
No log	6.4	384	0.6176	0.1813	0.6176	0.7859
No log	6.4333	386	0.6406	0.1543	0.6406	0.8004
No log	6.4667	388	0.6365	0.1529	0.6365	0.7978
No log	6.5	390	0.6218	0.1429	0.6218	0.7885
No log	6.5333	392	0.6048	0.2289	0.6048	0.7777
No log	6.5667	394	0.5979	0.1529	0.5979	0.7732
No log	6.6	396	0.6436	0.3371	0.6436	0.8022
No log	6.6333	398	0.6543	0.3591	0.6543	0.8089
No log	6.6667	400	0.6174	0.3488	0.6174	0.7857
No log	6.7	402	0.5674	0.2771	0.5674	0.7533
No log	6.7333	404	0.5551	0.1707	0.5551	0.7451
No log	6.7667	406	0.5604	0.2189	0.5604	0.7486
No log	6.8	408	0.5773	0.2000	0.5773	0.7598
No log	6.8333	410	0.5863	0.2000	0.5863	0.7657
No log	6.8667	412	0.5582	0.2189	0.5582	0.7471
No log	6.9	414	0.5568	0.2000	0.5568	0.7462
No log	6.9333	416	0.5588	0.2000	0.5588	0.7475
No log	6.9667	418	0.5682	0.2393	0.5682	0.7538
No log	7.0	420	0.5857	0.1905	0.5857	0.7653
No log	7.0333	422	0.6193	0.2390	0.6193	0.7870
No log	7.0667	424	0.6486	0.3128	0.6486	0.8054
No log	7.1	426	0.6150	0.28	0.6150	0.7842
No log	7.1333	428	0.5620	0.2189	0.5620	0.7497
No log	7.1667	430	0.5626	0.1908	0.5626	0.7501
No log	7.2	432	0.5851	0.3898	0.5851	0.7649
No log	7.2333	434	0.5726	0.2381	0.5726	0.7567
No log	7.2667	436	0.5542	0.2093	0.5542	0.7444
No log	7.3	438	0.5731	0.2281	0.5731	0.7571
No log	7.3333	440	0.5875	0.1445	0.5875	0.7665
No log	7.3667	442	0.5893	0.1529	0.5893	0.7677
No log	7.4	444	0.5746	0.2281	0.5746	0.7580
No log	7.4333	446	0.5513	0.2189	0.5513	0.7425
No log	7.4667	448	0.5473	0.2485	0.5473	0.7398
No log	7.5	450	0.5494	0.2485	0.5494	0.7412
No log	7.5333	452	0.5471	0.2189	0.5471	0.7397
No log	7.5667	454	0.5537	0.2189	0.5537	0.7441
No log	7.6	456	0.5543	0.2189	0.5543	0.7445
No log	7.6333	458	0.5607	0.2189	0.5607	0.7488
No log	7.6667	460	0.5679	0.2189	0.5679	0.7536
No log	7.7	462	0.5844	0.2289	0.5844	0.7645
No log	7.7333	464	0.5882	0.2189	0.5882	0.7669
No log	7.7667	466	0.5768	0.2189	0.5768	0.7595
No log	7.8	468	0.5730	0.2189	0.5730	0.7570
No log	7.8333	470	0.5727	0.2093	0.5727	0.7568
No log	7.8667	472	0.5768	0.2457	0.5768	0.7595
No log	7.9	474	0.5813	0.2189	0.5813	0.7624
No log	7.9333	476	0.6030	0.2273	0.6030	0.7765
No log	7.9667	478	0.6347	0.2709	0.6347	0.7967
No log	8.0	480	0.6853	0.3548	0.6853	0.8278
No log	8.0333	482	0.6990	0.2986	0.6990	0.8361
No log	8.0667	484	0.6505	0.3091	0.6505	0.8066
No log	8.1	486	0.5933	0.2381	0.5933	0.7703
No log	8.1333	488	0.5697	0.2644	0.5697	0.7548
No log	8.1667	490	0.5560	0.3054	0.5560	0.7456
No log	8.2	492	0.5519	0.2485	0.5519	0.7429
No log	8.2333	494	0.5492	0.2593	0.5492	0.7410
No log	8.2667	496	0.5526	0.2683	0.5526	0.7434
No log	8.3	498	0.5552	0.3136	0.5552	0.7451
0.4442	8.3333	500	0.5601	0.2644	0.5601	0.7484
0.4442	8.3667	502	0.5707	0.2381	0.5707	0.7555
0.4442	8.4	504	0.5740	0.2381	0.5740	0.7576
0.4442	8.4333	506	0.5643	0.2749	0.5643	0.7512
0.4442	8.4667	508	0.5546	0.3136	0.5546	0.7447
0.4442	8.5	510	0.5454	0.2683	0.5454	0.7385
0.4442	8.5333	512	0.5449	0.2485	0.5449	0.7382
0.4442	8.5667	514	0.5539	0.2000	0.5539	0.7442
0.4442	8.6	516	0.5511	0.2000	0.5511	0.7423
0.4442	8.6333	518	0.5438	0.2485	0.5438	0.7374
0.4442	8.6667	520	0.5475	0.2558	0.5475	0.7399
0.4442	8.7	522	0.5608	0.2644	0.5608	0.7488
0.4442	8.7333	524	0.5825	0.3258	0.5825	0.7632
0.4442	8.7667	526	0.5900	0.3258	0.5900	0.7681
0.4442	8.8	528	0.5836	0.3258	0.5836	0.7640
0.4442	8.8333	530	0.5762	0.2644	0.5762	0.7591
0.4442	8.8667	532	0.5647	0.2189	0.5647	0.7515
0.4442	8.9	534	0.5579	0.2558	0.5579	0.7469
0.4442	8.9333	536	0.5569	0.2558	0.5569	0.7462
0.4442	8.9667	538	0.5577	0.2558	0.5577	0.7468
0.4442	9.0	540	0.5598	0.2558	0.5598	0.7482
0.4442	9.0333	542	0.5627	0.2558	0.5627	0.7502
0.4442	9.0667	544	0.5675	0.2189	0.5675	0.7533
0.4442	9.1	546	0.5702	0.2644	0.5702	0.7551
0.4442	9.1333	548	0.5707	0.2644	0.5707	0.7555
0.4442	9.1667	550	0.5723	0.2281	0.5723	0.7565
0.4442	9.2	552	0.5743	0.2281	0.5743	0.7578
0.4442	9.2333	554	0.5725	0.2281	0.5725	0.7567
0.4442	9.2667	556	0.5700	0.2281	0.5700	0.7550
0.4442	9.3	558	0.5649	0.2644	0.5649	0.7516
0.4442	9.3333	560	0.5648	0.2644	0.5648	0.7516
0.4442	9.3667	562	0.5663	0.2644	0.5663	0.7525
0.4442	9.4	564	0.5634	0.2644	0.5634	0.7506
0.4442	9.4333	566	0.5572	0.2644	0.5572	0.7464
0.4442	9.4667	568	0.5521	0.2189	0.5521	0.7431
0.4442	9.5	570	0.5511	0.2189	0.5511	0.7423
0.4442	9.5333	572	0.5493	0.2189	0.5493	0.7411
0.4442	9.5667	574	0.5479	0.2189	0.5479	0.7402
0.4442	9.6	576	0.5476	0.2189	0.5476	0.7400
0.4442	9.6333	578	0.5486	0.2189	0.5486	0.7407
0.4442	9.6667	580	0.5514	0.2644	0.5514	0.7425
0.4442	9.7	582	0.5551	0.2644	0.5551	0.7451
0.4442	9.7333	584	0.5597	0.2749	0.5597	0.7481
0.4442	9.7667	586	0.5629	0.2381	0.5629	0.7502
0.4442	9.8	588	0.5685	0.2381	0.5685	0.7540
0.4442	9.8333	590	0.5749	0.2832	0.5749	0.7582
0.4442	9.8667	592	0.5793	0.3258	0.5793	0.7611
0.4442	9.9	594	0.5813	0.3829	0.5813	0.7624
0.4442	9.9333	596	0.5813	0.3829	0.5813	0.7625
0.4442	9.9667	598	0.5808	0.3829	0.5808	0.7621
0.4442	10.0	600	0.5805	0.3829	0.5805	0.7619

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024