ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k8_task3_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k8_task3_organization

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k8_task3_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

13% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: a3a1dd81

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k8_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.5574
Qwk: 0.4146
Mse: 0.5574
Rmse: 0.7466

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0606	2	3.3696	0.0013	3.3696	1.8357
No log	0.1212	4	1.8050	-0.0070	1.8050	1.3435
No log	0.1818	6	1.1987	0.0588	1.1987	1.0948
No log	0.2424	8	0.9307	0.1000	0.9307	0.9648
No log	0.3030	10	0.9840	0.0159	0.9840	0.9920
No log	0.3636	12	0.5806	-0.0081	0.5806	0.7620
No log	0.4242	14	0.6124	0.0	0.6124	0.7826
No log	0.4848	16	0.5818	0.0	0.5818	0.7628
No log	0.5455	18	0.6662	0.3067	0.6662	0.8162
No log	0.6061	20	0.8105	-0.0563	0.8105	0.9003
No log	0.6667	22	0.7695	0.0476	0.7695	0.8772
No log	0.7273	24	0.7775	0.0980	0.7775	0.8818
No log	0.7879	26	0.7351	0.1667	0.7351	0.8574
No log	0.8485	28	0.8367	0.1050	0.8367	0.9147
No log	0.9091	30	0.7084	0.1323	0.7084	0.8417
No log	0.9697	32	0.5881	-0.0159	0.5881	0.7669
No log	1.0303	34	0.6101	-0.0233	0.6101	0.7811
No log	1.0909	36	0.7458	0.125	0.7458	0.8636
No log	1.1515	38	0.7530	0.2157	0.7530	0.8677
No log	1.2121	40	0.6133	-0.0435	0.6133	0.7831
No log	1.2727	42	0.6173	0.1565	0.6173	0.7857
No log	1.3333	44	0.6184	0.2000	0.6184	0.7864
No log	1.3939	46	0.6793	0.1186	0.6793	0.8242
No log	1.4545	48	0.6676	0.1186	0.6676	0.8171
No log	1.5152	50	0.5922	-0.0159	0.5922	0.7695
No log	1.5758	52	0.5894	0.0476	0.5894	0.7677
No log	1.6364	54	0.5968	0.2340	0.5968	0.7725
No log	1.6970	56	0.5901	0.0534	0.5901	0.7682
No log	1.7576	58	0.6321	0.0071	0.6321	0.7950
No log	1.8182	60	0.6275	0.0476	0.6275	0.7922
No log	1.8788	62	0.7124	0.1364	0.7124	0.8440
No log	1.9394	64	0.6349	0.1011	0.6349	0.7968
No log	2.0	66	0.8241	0.2203	0.8241	0.9078
No log	2.0606	68	0.9460	0.1882	0.9460	0.9726
No log	2.1212	70	0.6151	0.3016	0.6151	0.7843
No log	2.1818	72	0.9837	0.1276	0.9837	0.9918
No log	2.2424	74	0.7995	0.2081	0.7995	0.8942
No log	2.3030	76	0.7194	0.2081	0.7194	0.8482
No log	2.3636	78	0.9115	0.2208	0.9115	0.9547
No log	2.4242	80	0.7323	0.2086	0.7323	0.8558
No log	2.4848	82	0.7163	0.0629	0.7163	0.8463
No log	2.5455	84	0.7052	0.0769	0.7052	0.8398
No log	2.6061	86	0.7064	0.2707	0.7064	0.8405
No log	2.6667	88	0.8450	0.2070	0.8450	0.9192
No log	2.7273	90	0.7008	0.2850	0.7008	0.8371
No log	2.7879	92	0.7061	0.2157	0.7061	0.8403
No log	2.8485	94	0.8271	0.2390	0.8271	0.9095
No log	2.9091	96	0.6995	0.1675	0.6995	0.8364
No log	2.9697	98	0.6765	0.3917	0.6765	0.8225
No log	3.0303	100	0.6708	0.3973	0.6708	0.8190
No log	3.0909	102	0.6094	0.2990	0.6094	0.7807
No log	3.1515	104	0.5981	0.3089	0.5981	0.7734
No log	3.2121	106	0.5830	0.3469	0.5830	0.7635
No log	3.2727	108	0.6023	0.2332	0.6023	0.7761
No log	3.3333	110	0.5948	0.3706	0.5948	0.7712
No log	3.3939	112	0.7178	0.2681	0.7178	0.8472
No log	3.4545	114	0.5930	0.3623	0.5930	0.7701
No log	3.5152	116	0.5570	0.3617	0.5570	0.7463
No log	3.5758	118	0.5760	0.3131	0.5760	0.7590
No log	3.6364	120	0.6874	0.3846	0.6874	0.8291
No log	3.6970	122	0.7081	0.3846	0.7081	0.8415
No log	3.7576	124	0.5489	0.2542	0.5489	0.7409
No log	3.8182	126	0.5516	0.2000	0.5516	0.7427
No log	3.8788	128	0.6564	0.1667	0.6564	0.8102
No log	3.9394	130	0.6951	0.2077	0.6951	0.8338
No log	4.0	132	0.6708	0.1179	0.6708	0.8190
No log	4.0606	134	0.8065	0.3247	0.8065	0.8981
No log	4.1212	136	1.0504	0.1940	1.0504	1.0249
No log	4.1818	138	0.8774	0.2510	0.8774	0.9367
No log	4.2424	140	0.6384	0.2083	0.6384	0.7990
No log	4.3030	142	0.5643	0.3224	0.5643	0.7512
No log	4.3636	144	0.5627	0.4225	0.5627	0.7501
No log	4.4242	146	0.5949	0.3224	0.5949	0.7713
No log	4.4848	148	0.6848	0.2146	0.6848	0.8275
No log	4.5455	150	0.6021	0.3231	0.6021	0.7759
No log	4.6061	152	0.5710	0.2914	0.5710	0.7557
No log	4.6667	154	0.6453	0.2766	0.6453	0.8033
No log	4.7273	156	0.5551	0.3488	0.5551	0.7450
No log	4.7879	158	0.5587	0.3591	0.5587	0.7474
No log	4.8485	160	0.6307	0.2475	0.6307	0.7942
No log	4.9091	162	0.5572	0.3591	0.5572	0.7465
No log	4.9697	164	0.5574	0.4083	0.5574	0.7466
No log	5.0303	166	0.6070	0.2832	0.6070	0.7791
No log	5.0909	168	0.5749	0.3563	0.5749	0.7582
No log	5.1515	170	0.5936	0.3520	0.5936	0.7704
No log	5.2121	172	0.6406	0.2766	0.6406	0.8004
No log	5.2727	174	0.6002	0.2889	0.6002	0.7747
No log	5.3333	176	0.6301	0.3023	0.6301	0.7938
No log	5.3939	178	0.6230	0.3023	0.6230	0.7893
No log	5.4545	180	0.6219	0.3216	0.6219	0.7886
No log	5.5152	182	0.7504	0.2414	0.7504	0.8662
No log	5.5758	184	0.7165	0.2000	0.7165	0.8465
No log	5.6364	186	0.6319	0.2432	0.6319	0.7949
No log	5.6970	188	0.6283	0.3182	0.6283	0.7926
No log	5.7576	190	0.7221	0.2513	0.7221	0.8497
No log	5.8182	192	0.7765	0.1927	0.7765	0.8812
No log	5.8788	194	0.6436	0.3043	0.6436	0.8022
No log	5.9394	196	0.5501	0.3882	0.5501	0.7417
No log	6.0	198	0.5558	0.3789	0.5558	0.7455
No log	6.0606	200	0.5398	0.4146	0.5398	0.7347
No log	6.1212	202	0.5340	0.4146	0.5340	0.7307
No log	6.1818	204	0.5342	0.2795	0.5342	0.7309
No log	6.2424	206	0.5275	0.3032	0.5275	0.7263
No log	6.3030	208	0.5435	0.2795	0.5435	0.7372
No log	6.3636	210	0.5709	0.2000	0.5709	0.7556
No log	6.4242	212	0.5772	0.2000	0.5772	0.7597
No log	6.4848	214	0.5492	0.4491	0.5492	0.7411
No log	6.5455	216	0.5567	0.3563	0.5567	0.7461
No log	6.6061	218	0.5525	0.3609	0.5525	0.7433
No log	6.6667	220	0.5519	0.4353	0.5519	0.7429
No log	6.7273	222	0.5552	0.3333	0.5552	0.7451
No log	6.7879	224	0.5480	0.3333	0.5480	0.7403
No log	6.8485	226	0.5442	0.3711	0.5442	0.7377
No log	6.9091	228	0.5415	0.3711	0.5415	0.7359
No log	6.9697	230	0.5315	0.3939	0.5315	0.7290
No log	7.0303	232	0.5607	0.2298	0.5607	0.7488
No log	7.0909	234	0.5601	0.2683	0.5601	0.7484
No log	7.1515	236	0.5680	0.2683	0.5680	0.7537
No log	7.2121	238	0.5514	0.2771	0.5514	0.7425
No log	7.2727	240	0.5328	0.3939	0.5328	0.7300
No log	7.3333	242	0.5285	0.3939	0.5285	0.7270
No log	7.3939	244	0.5252	0.3939	0.5252	0.7247
No log	7.4545	246	0.5256	0.3580	0.5256	0.7250
No log	7.5152	248	0.5308	0.35	0.5308	0.7285
No log	7.5758	250	0.5328	0.3374	0.5328	0.7300
No log	7.6364	252	0.5258	0.35	0.5258	0.7251
No log	7.6970	254	0.5299	0.3711	0.5299	0.7279
No log	7.7576	256	0.5466	0.4146	0.5466	0.7393
No log	7.8182	258	0.5485	0.3609	0.5485	0.7406
No log	7.8788	260	0.5681	0.3563	0.5681	0.7537
No log	7.9394	262	0.5837	0.3118	0.5837	0.7640
No log	8.0	264	0.5587	0.4146	0.5587	0.7475
No log	8.0606	266	0.5458	0.4012	0.5458	0.7388
No log	8.1212	268	0.5586	0.2393	0.5586	0.7474
No log	8.1818	270	0.5612	0.2289	0.5612	0.7491
No log	8.2424	272	0.5497	0.3580	0.5497	0.7414
No log	8.3030	274	0.5513	0.4146	0.5513	0.7425
No log	8.3636	276	0.5612	0.3789	0.5612	0.7492
No log	8.4242	278	0.5713	0.3735	0.5713	0.7558
No log	8.4848	280	0.5715	0.2883	0.5715	0.7560
No log	8.5455	282	0.5603	0.3789	0.5603	0.7486
No log	8.6061	284	0.5475	0.3789	0.5475	0.7399
No log	8.6667	286	0.5456	0.3789	0.5456	0.7386
No log	8.7273	288	0.5392	0.4146	0.5392	0.7343
No log	8.7879	290	0.5402	0.4146	0.5402	0.7350
No log	8.8485	292	0.5509	0.3789	0.5509	0.7422
No log	8.9091	294	0.5596	0.2883	0.5596	0.7480
No log	8.9697	296	0.5722	0.2832	0.5722	0.7564
No log	9.0303	298	0.5740	0.2832	0.5740	0.7576
No log	9.0909	300	0.5675	0.2883	0.5675	0.7533
No log	9.1515	302	0.5601	0.3789	0.5601	0.7484
No log	9.2121	304	0.5525	0.4146	0.5525	0.7433
No log	9.2727	306	0.5522	0.4012	0.5522	0.7431
No log	9.3333	308	0.5542	0.3580	0.5542	0.7444
No log	9.3939	310	0.5547	0.4012	0.5547	0.7448
No log	9.4545	312	0.5548	0.4012	0.5548	0.7448
No log	9.5152	314	0.5563	0.4146	0.5563	0.7458
No log	9.5758	316	0.5586	0.4146	0.5586	0.7474
No log	9.6364	318	0.5586	0.4146	0.5586	0.7474
No log	9.6970	320	0.5579	0.4146	0.5579	0.7469
No log	9.7576	322	0.5572	0.4146	0.5572	0.7464
No log	9.8182	324	0.5574	0.4146	0.5574	0.7466
No log	9.8788	326	0.5576	0.4146	0.5576	0.7468
No log	9.9394	328	0.5574	0.4146	0.5574	0.7466
No log	10.0	330	0.5574	0.4146	0.5574	0.7466

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024