ArabicNewSplits2_FineTuningAraBERT_run4_AugV5_k10_task1_organization

MayBashendy/ArabicNewSplits2_FineTuningAraBERT_run4_AugV5_k10_task1_organization

ArabicNewSplits2_FineTuningAraBERT_run4_AugV5_k10_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

10% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 3, 2024
Updated: Dec 3, 2024
SHA: 8361600c

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits2_FineTuningAraBERT_run4_AugV5_k10_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.5937
Qwk: 0.7269
Mse: 0.5937
Rmse: 0.7705

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0455	2	4.9227	-0.0531	4.9227	2.2187
No log	0.0909	4	2.9025	0.0207	2.9025	1.7037
No log	0.1364	6	1.8813	0.1383	1.8813	1.3716
No log	0.1818	8	1.4656	0.0	1.4656	1.2106
No log	0.2273	10	1.2460	0.1572	1.2460	1.1163
No log	0.2727	12	1.1264	0.3192	1.1264	1.0613
No log	0.3182	14	1.1431	0.2721	1.1431	1.0692
No log	0.3636	16	1.4197	0.1572	1.4197	1.1915
No log	0.4091	18	1.9246	0.1239	1.9246	1.3873
No log	0.4545	20	1.8034	0.1383	1.8034	1.3429
No log	0.5	22	1.3907	0.0436	1.3907	1.1793
No log	0.5455	24	1.0961	0.4332	1.0961	1.0470
No log	0.5909	26	1.0224	0.3547	1.0224	1.0112
No log	0.6364	28	0.9658	0.3848	0.9658	0.9828
No log	0.6818	30	0.9135	0.3895	0.9135	0.9558
No log	0.7273	32	0.9222	0.3667	0.9222	0.9603
No log	0.7727	34	0.8877	0.3810	0.8877	0.9422
No log	0.8182	36	0.9963	0.4912	0.9963	0.9982
No log	0.8636	38	1.2624	0.3846	1.2624	1.1236
No log	0.9091	40	1.0604	0.5569	1.0604	1.0298
No log	0.9545	42	0.8252	0.4555	0.8252	0.9084
No log	1.0	44	1.1060	0.2586	1.1060	1.0517
No log	1.0455	46	1.1500	0.1274	1.1500	1.0724
No log	1.0909	48	0.8778	0.4775	0.8778	0.9369
No log	1.1364	50	0.8898	0.5271	0.8898	0.9433
No log	1.1818	52	1.0626	0.5362	1.0626	1.0308
No log	1.2273	54	1.1760	0.5061	1.1760	1.0844
No log	1.2727	56	0.9167	0.5593	0.9167	0.9574
No log	1.3182	58	0.7365	0.5972	0.7365	0.8582
No log	1.3636	60	0.6087	0.5804	0.6087	0.7802
No log	1.4091	62	0.5893	0.6757	0.5893	0.7676
No log	1.4545	64	0.5779	0.7026	0.5779	0.7602
No log	1.5	66	0.5896	0.7273	0.5896	0.7679
No log	1.5455	68	0.6050	0.7210	0.6050	0.7778
No log	1.5909	70	0.6010	0.6725	0.6010	0.7752
No log	1.6364	72	0.6149	0.6730	0.6149	0.7841
No log	1.6818	74	0.8354	0.4953	0.8354	0.9140
No log	1.7273	76	1.0164	0.4600	1.0164	1.0082
No log	1.7727	78	0.8829	0.525	0.8829	0.9396
No log	1.8182	80	0.6633	0.6593	0.6633	0.8144
No log	1.8636	82	0.6249	0.6855	0.6249	0.7905
No log	1.9091	84	0.5667	0.7150	0.5667	0.7528
No log	1.9545	86	0.5681	0.7033	0.5681	0.7537
No log	2.0	88	0.5175	0.7171	0.5175	0.7194
No log	2.0455	90	0.5165	0.7028	0.5165	0.7187
No log	2.0909	92	0.5608	0.6827	0.5608	0.7489
No log	2.1364	94	0.4797	0.6503	0.4797	0.6926
No log	2.1818	96	0.4632	0.6887	0.4632	0.6806
No log	2.2273	98	0.4679	0.7429	0.4679	0.6841
No log	2.2727	100	0.4585	0.7612	0.4585	0.6771
No log	2.3182	102	0.4398	0.7568	0.4398	0.6631
No log	2.3636	104	0.4572	0.7545	0.4572	0.6762
No log	2.4091	106	0.4718	0.7655	0.4718	0.6868
No log	2.4545	108	0.5239	0.7075	0.5239	0.7238
No log	2.5	110	0.6594	0.6585	0.6594	0.8120
No log	2.5455	112	0.6732	0.6777	0.6732	0.8205
No log	2.5909	114	0.5483	0.7537	0.5483	0.7405
No log	2.6364	116	0.5338	0.7276	0.5338	0.7306
No log	2.6818	118	0.5486	0.7150	0.5486	0.7407
No log	2.7273	120	0.5870	0.7360	0.5870	0.7661
No log	2.7727	122	0.5673	0.7188	0.5673	0.7532
No log	2.8182	124	0.5427	0.6173	0.5427	0.7367
No log	2.8636	126	0.5790	0.6179	0.5790	0.7609
No log	2.9091	128	0.5576	0.6262	0.5576	0.7467
No log	2.9545	130	0.5793	0.6305	0.5793	0.7611
No log	3.0	132	0.7597	0.6961	0.7597	0.8716
No log	3.0455	134	0.8028	0.6602	0.8028	0.8960
No log	3.0909	136	0.6347	0.6769	0.6347	0.7967
No log	3.1364	138	0.5939	0.6909	0.5939	0.7706
No log	3.1818	140	0.6032	0.6909	0.6032	0.7766
No log	3.2273	142	0.6246	0.6909	0.6246	0.7903
No log	3.2727	144	0.6572	0.6463	0.6572	0.8106
No log	3.3182	146	0.6632	0.6786	0.6632	0.8144
No log	3.3636	148	0.6386	0.6710	0.6386	0.7991
No log	3.4091	150	0.6369	0.6877	0.6369	0.7980
No log	3.4545	152	0.6748	0.7476	0.6748	0.8215
No log	3.5	154	0.7468	0.7139	0.7468	0.8642
No log	3.5455	156	0.7951	0.6840	0.7951	0.8917
No log	3.5909	158	0.6873	0.7372	0.6873	0.8290
No log	3.6364	160	0.6695	0.7114	0.6695	0.8182
No log	3.6818	162	0.7305	0.7086	0.7305	0.8547
No log	3.7273	164	0.8054	0.6450	0.8054	0.8975
No log	3.7727	166	0.7894	0.6450	0.7894	0.8885
No log	3.8182	168	0.7821	0.6327	0.7821	0.8844
No log	3.8636	170	0.7727	0.6327	0.7727	0.8790
No log	3.9091	172	0.7468	0.6649	0.7468	0.8642
No log	3.9545	174	0.5857	0.7419	0.5857	0.7653
No log	4.0	176	0.5371	0.7085	0.5371	0.7329
No log	4.0455	178	0.6121	0.6747	0.6121	0.7824
No log	4.0909	180	0.5577	0.6499	0.5577	0.7468
No log	4.1364	182	0.5076	0.7291	0.5076	0.7125
No log	4.1818	184	0.5514	0.7891	0.5514	0.7425
No log	4.2273	186	0.5745	0.7714	0.5745	0.7580
No log	4.2727	188	0.5067	0.7291	0.5067	0.7119
No log	4.3182	190	0.5283	0.6884	0.5283	0.7269
No log	4.3636	192	0.5324	0.675	0.5324	0.7296
No log	4.4091	194	0.4948	0.7180	0.4948	0.7034
No log	4.4545	196	0.5080	0.7626	0.5080	0.7128
No log	4.5	198	0.6029	0.7761	0.6029	0.7764
No log	4.5455	200	0.6513	0.7468	0.6513	0.8071
No log	4.5909	202	0.5947	0.7761	0.5947	0.7712
No log	4.6364	204	0.5666	0.7878	0.5666	0.7527
No log	4.6818	206	0.5264	0.7519	0.5264	0.7255
No log	4.7273	208	0.5319	0.7429	0.5319	0.7293
No log	4.7727	210	0.5256	0.7429	0.5256	0.7250
No log	4.8182	212	0.5163	0.7519	0.5163	0.7185
No log	4.8636	214	0.5756	0.7710	0.5756	0.7587
No log	4.9091	216	0.6257	0.7158	0.6257	0.7910
No log	4.9545	218	0.5899	0.7422	0.5899	0.7681
No log	5.0	220	0.5792	0.7487	0.5792	0.7611
No log	5.0455	222	0.5435	0.7791	0.5435	0.7372
No log	5.0909	224	0.5416	0.7791	0.5416	0.7359
No log	5.1364	226	0.5453	0.7791	0.5453	0.7385
No log	5.1818	228	0.5431	0.7791	0.5431	0.7370
No log	5.2273	230	0.5759	0.7422	0.5759	0.7589
No log	5.2727	232	0.5993	0.7063	0.5993	0.7742
No log	5.3182	234	0.5645	0.7668	0.5645	0.7513
No log	5.3636	236	0.5545	0.75	0.5545	0.7446
No log	5.4091	238	0.5569	0.7324	0.5569	0.7463
No log	5.4545	240	0.5423	0.7273	0.5423	0.7364
No log	5.5	242	0.5329	0.7453	0.5329	0.7300
No log	5.5455	244	0.5269	0.7791	0.5269	0.7259
No log	5.5909	246	0.5452	0.7761	0.5452	0.7383
No log	5.6364	248	0.5133	0.7722	0.5133	0.7165
No log	5.6818	250	0.5055	0.7722	0.5055	0.7110
No log	5.7273	252	0.4882	0.7571	0.4882	0.6987
No log	5.7727	254	0.4915	0.7595	0.4915	0.7010
No log	5.8182	256	0.4981	0.7519	0.4981	0.7057
No log	5.8636	258	0.5109	0.7614	0.5109	0.7148
No log	5.9091	260	0.5346	0.7602	0.5346	0.7311
No log	5.9545	262	0.6073	0.7406	0.6073	0.7793
No log	6.0	264	0.6669	0.7286	0.6669	0.8166
No log	6.0455	266	0.6467	0.7286	0.6467	0.8042
No log	6.0909	268	0.5910	0.7130	0.5910	0.7688
No log	6.1364	270	0.5598	0.7312	0.5598	0.7482
No log	6.1818	272	0.5505	0.7312	0.5505	0.7420
No log	6.2273	274	0.5487	0.7202	0.5487	0.7408
No log	6.2727	276	0.5663	0.7312	0.5663	0.7525
No log	6.3182	278	0.5872	0.7188	0.5872	0.7663
No log	6.3636	280	0.5825	0.7188	0.5825	0.7632
No log	6.4091	282	0.5725	0.7312	0.5725	0.7566
No log	6.4545	284	0.5756	0.7312	0.5756	0.7587
No log	6.5	286	0.5893	0.7312	0.5893	0.7677
No log	6.5455	288	0.5763	0.7312	0.5763	0.7592
No log	6.5909	290	0.5729	0.7312	0.5729	0.7569
No log	6.6364	292	0.5663	0.7668	0.5663	0.7526
No log	6.6818	294	0.5555	0.7668	0.5555	0.7453
No log	6.7273	296	0.5482	0.7680	0.5482	0.7404
No log	6.7727	298	0.5448	0.7680	0.5448	0.7381
No log	6.8182	300	0.5500	0.7668	0.5500	0.7416
No log	6.8636	302	0.5570	0.7602	0.5570	0.7463
No log	6.9091	304	0.5790	0.7130	0.5790	0.7609
No log	6.9545	306	0.5932	0.7130	0.5932	0.7702
No log	7.0	308	0.6163	0.7143	0.6163	0.7851
No log	7.0455	310	0.6178	0.7143	0.6178	0.7860
No log	7.0909	312	0.5752	0.7252	0.5752	0.7584
No log	7.1364	314	0.5378	0.7203	0.5378	0.7334
No log	7.1818	316	0.5239	0.7085	0.5239	0.7238
No log	7.2273	318	0.5252	0.7558	0.5252	0.7247
No log	7.2727	320	0.5428	0.7602	0.5428	0.7368
No log	7.3182	322	0.5733	0.7761	0.5733	0.7571
No log	7.3636	324	0.6249	0.7269	0.6249	0.7905
No log	7.4091	326	0.6631	0.7143	0.6631	0.8143
No log	7.4545	328	0.6618	0.7143	0.6618	0.8135
No log	7.5	330	0.6774	0.6959	0.6774	0.8230
No log	7.5455	332	0.6745	0.6959	0.6745	0.8213
No log	7.5909	334	0.6541	0.7149	0.6541	0.8087
No log	7.6364	336	0.6343	0.6958	0.6343	0.7965
No log	7.6818	338	0.6154	0.7093	0.6154	0.7845
No log	7.7273	340	0.6067	0.7093	0.6067	0.7789
No log	7.7727	342	0.5807	0.7135	0.5807	0.7620
No log	7.8182	344	0.5760	0.7135	0.5760	0.7590
No log	7.8636	346	0.5912	0.7422	0.5912	0.7689
No log	7.9091	348	0.6281	0.7089	0.6281	0.7925
No log	7.9545	350	0.6726	0.7143	0.6726	0.8201
No log	8.0	352	0.6806	0.7143	0.6806	0.8250
No log	8.0455	354	0.6843	0.7143	0.6843	0.8272
No log	8.0909	356	0.6778	0.7143	0.6778	0.8233
No log	8.1364	358	0.6563	0.7143	0.6563	0.8101
No log	8.1818	360	0.6419	0.7143	0.6419	0.8012
No log	8.2273	362	0.6318	0.7101	0.6318	0.7948
No log	8.2727	364	0.6162	0.7173	0.6162	0.7850
No log	8.3182	366	0.5976	0.7360	0.5976	0.7731
No log	8.3636	368	0.5943	0.7360	0.5943	0.7709
No log	8.4091	370	0.5839	0.7360	0.5839	0.7642
No log	8.4545	372	0.5765	0.7360	0.5765	0.7593
No log	8.5	374	0.5705	0.7710	0.5705	0.7553
No log	8.5455	376	0.5778	0.7360	0.5778	0.7601
No log	8.5909	378	0.6015	0.7218	0.6015	0.7755
No log	8.6364	380	0.6279	0.6959	0.6279	0.7924
No log	8.6818	382	0.6393	0.6959	0.6393	0.7995
No log	8.7273	384	0.6377	0.6959	0.6377	0.7986
No log	8.7727	386	0.6261	0.6959	0.6261	0.7913
No log	8.8182	388	0.6279	0.6959	0.6279	0.7924
No log	8.8636	390	0.6212	0.7089	0.6212	0.7881
No log	8.9091	392	0.6214	0.7089	0.6214	0.7883
No log	8.9545	394	0.6249	0.7089	0.6249	0.7905
No log	9.0	396	0.6178	0.7089	0.6178	0.7860
No log	9.0455	398	0.5986	0.7089	0.5986	0.7737
No log	9.0909	400	0.5900	0.7173	0.5900	0.7681
No log	9.1364	402	0.5804	0.7173	0.5804	0.7619
No log	9.1818	404	0.5802	0.7173	0.5802	0.7617
No log	9.2273	406	0.5885	0.7047	0.5885	0.7672
No log	9.2727	408	0.6003	0.7089	0.6003	0.7748
No log	9.3182	410	0.6055	0.7269	0.6055	0.7782
No log	9.3636	412	0.6076	0.7269	0.6076	0.7795
No log	9.4091	414	0.6118	0.7269	0.6118	0.7822
No log	9.4545	416	0.6184	0.7269	0.6184	0.7864
No log	9.5	418	0.6209	0.7269	0.6209	0.7880
No log	9.5455	420	0.6170	0.7269	0.6170	0.7855
No log	9.5909	422	0.6175	0.7269	0.6175	0.7858
No log	9.6364	424	0.6163	0.7269	0.6163	0.7851
No log	9.6818	426	0.6146	0.7269	0.6146	0.7840
No log	9.7273	428	0.6102	0.7269	0.6102	0.7812
No log	9.7727	430	0.6084	0.7269	0.6084	0.7800
No log	9.8182	432	0.6046	0.7269	0.6047	0.7776
No log	9.8636	434	0.6001	0.7269	0.6001	0.7747
No log	9.9091	436	0.5971	0.7269	0.5971	0.7727
No log	9.9545	438	0.5947	0.7269	0.5947	0.7712
No log	10.0	440	0.5937	0.7269	0.5937	0.7705

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 3, 2024
Updated: Dec 3, 2024