ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k6_task1_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k6_task1_organization

ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k6_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

48% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 8, 2024
Updated: Dec 8, 2024
SHA: 5055b9cc

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k6_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.6092
Qwk: 0.7216
Mse: 0.6092
Rmse: 0.7805

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0667	2	5.0814	0.0088	5.0814	2.2542
No log	0.1333	4	3.4032	0.0730	3.4032	1.8448
No log	0.2	6	1.8985	0.1162	1.8985	1.3778
No log	0.2667	8	1.4513	0.1574	1.4513	1.2047
No log	0.3333	10	1.2029	0.2661	1.2029	1.0968
No log	0.4	12	1.1158	0.3438	1.1158	1.0563
No log	0.4667	14	1.1417	0.2985	1.1417	1.0685
No log	0.5333	16	1.1268	0.2762	1.1268	1.0615
No log	0.6	18	1.0738	0.2485	1.0738	1.0362
No log	0.6667	20	1.0727	0.2486	1.0727	1.0357
No log	0.7333	22	1.1347	0.3009	1.1347	1.0652
No log	0.8	24	1.1899	0.2661	1.1899	1.0908
No log	0.8667	26	1.0531	0.3655	1.0531	1.0262
No log	0.9333	28	0.8929	0.3683	0.8929	0.9449
No log	1.0	30	0.8581	0.5030	0.8581	0.9263
No log	1.0667	32	0.8203	0.4870	0.8203	0.9057
No log	1.1333	34	0.7634	0.5430	0.7634	0.8737
No log	1.2	36	0.7820	0.5519	0.7820	0.8843
No log	1.2667	38	0.7589	0.5473	0.7589	0.8711
No log	1.3333	40	0.8401	0.5194	0.8401	0.9165
No log	1.4	42	1.0389	0.5218	1.0389	1.0193
No log	1.4667	44	0.9405	0.5278	0.9405	0.9698
No log	1.5333	46	0.7727	0.5470	0.7727	0.8790
No log	1.6	48	0.7905	0.5366	0.7905	0.8891
No log	1.6667	50	0.7943	0.5657	0.7943	0.8913
No log	1.7333	52	0.7923	0.5466	0.7923	0.8901
No log	1.8	54	0.7483	0.5419	0.7483	0.8651
No log	1.8667	56	0.6590	0.6293	0.6590	0.8118
No log	1.9333	58	0.6634	0.6502	0.6634	0.8145
No log	2.0	60	0.6375	0.6270	0.6375	0.7984
No log	2.0667	62	0.6695	0.6326	0.6695	0.8182
No log	2.1333	64	0.6106	0.6645	0.6106	0.7814
No log	2.2	66	0.6262	0.6715	0.6262	0.7913
No log	2.2667	68	0.7044	0.6980	0.7044	0.8393
No log	2.3333	70	0.7197	0.6947	0.7197	0.8484
No log	2.4	72	0.8115	0.6535	0.8115	0.9008
No log	2.4667	74	0.9369	0.5705	0.9369	0.9679
No log	2.5333	76	0.7772	0.6587	0.7772	0.8816
No log	2.6	78	0.6758	0.7342	0.6758	0.8221
No log	2.6667	80	0.7050	0.7169	0.7050	0.8397
No log	2.7333	82	0.8564	0.6300	0.8564	0.9254
No log	2.8	84	0.8125	0.6449	0.8125	0.9014
No log	2.8667	86	0.6793	0.7249	0.6793	0.8242
No log	2.9333	88	0.6018	0.7259	0.6018	0.7757
No log	3.0	90	0.5730	0.7362	0.5730	0.7570
No log	3.0667	92	0.5738	0.7432	0.5738	0.7575
No log	3.1333	94	0.5814	0.7374	0.5814	0.7625
No log	3.2	96	0.5842	0.7371	0.5842	0.7643
No log	3.2667	98	0.6117	0.7497	0.6117	0.7821
No log	3.3333	100	0.6719	0.7409	0.6719	0.8197
No log	3.4	102	0.6457	0.7274	0.6457	0.8035
No log	3.4667	104	0.6538	0.7213	0.6538	0.8086
No log	3.5333	106	0.6516	0.7320	0.6516	0.8072
No log	3.6	108	0.6474	0.7309	0.6474	0.8046
No log	3.6667	110	0.7305	0.7210	0.7305	0.8547
No log	3.7333	112	0.7242	0.7066	0.7242	0.8510
No log	3.8	114	0.6297	0.7183	0.6297	0.7936
No log	3.8667	116	0.6314	0.7357	0.6314	0.7946
No log	3.9333	118	0.6506	0.7558	0.6506	0.8066
No log	4.0	120	0.6147	0.7266	0.6147	0.7840
No log	4.0667	122	0.6853	0.7261	0.6853	0.8278
No log	4.1333	124	0.6702	0.7101	0.6702	0.8187
No log	4.2	126	0.6038	0.7361	0.6038	0.7771
No log	4.2667	128	0.6106	0.7352	0.6106	0.7814
No log	4.3333	130	0.5977	0.7330	0.5977	0.7731
No log	4.4	132	0.6236	0.7342	0.6236	0.7897
No log	4.4667	134	0.7204	0.7262	0.7204	0.8488
No log	4.5333	136	0.7168	0.7227	0.7168	0.8466
No log	4.6	138	0.6479	0.7179	0.6479	0.8049
No log	4.6667	140	0.6157	0.7454	0.6157	0.7847
No log	4.7333	142	0.6293	0.7477	0.6293	0.7933
No log	4.8	144	0.7793	0.6718	0.7793	0.8828
No log	4.8667	146	0.8806	0.6011	0.8806	0.9384
No log	4.9333	148	0.7346	0.6800	0.7346	0.8571
No log	5.0	150	0.6266	0.7403	0.6266	0.7916
No log	5.0667	152	0.6333	0.7406	0.6333	0.7958
No log	5.1333	154	0.6310	0.7375	0.6310	0.7944
No log	5.2	156	0.6410	0.7280	0.6410	0.8006
No log	5.2667	158	0.7482	0.7204	0.7482	0.8650
No log	5.3333	160	0.7037	0.7219	0.7037	0.8389
No log	5.4	162	0.6034	0.7332	0.6034	0.7768
No log	5.4667	164	0.6294	0.7311	0.6294	0.7934
No log	5.5333	166	0.6523	0.7330	0.6523	0.8076
No log	5.6	168	0.6423	0.7362	0.6423	0.8014
No log	5.6667	170	0.6169	0.7404	0.6169	0.7854
No log	5.7333	172	0.5829	0.7333	0.5829	0.7635
No log	5.8	174	0.5825	0.7254	0.5825	0.7632
No log	5.8667	176	0.5987	0.7041	0.5987	0.7738
No log	5.9333	178	0.6585	0.7097	0.6585	0.8115
No log	6.0	180	0.6799	0.7017	0.6799	0.8246
No log	6.0667	182	0.6468	0.7097	0.6468	0.8042
No log	6.1333	184	0.6102	0.7199	0.6102	0.7812
No log	6.2	186	0.5971	0.7170	0.5971	0.7727
No log	6.2667	188	0.5973	0.7192	0.5973	0.7728
No log	6.3333	190	0.6020	0.7200	0.6020	0.7759
No log	6.4	192	0.5959	0.7208	0.5959	0.7719
No log	6.4667	194	0.6075	0.7312	0.6075	0.7794
No log	6.5333	196	0.6117	0.7238	0.6117	0.7821
No log	6.6	198	0.6150	0.7229	0.6150	0.7842
No log	6.6667	200	0.6262	0.7307	0.6262	0.7913
No log	6.7333	202	0.6358	0.7322	0.6358	0.7974
No log	6.8	204	0.6286	0.7270	0.6286	0.7929
No log	6.8667	206	0.6231	0.7275	0.6231	0.7893
No log	6.9333	208	0.6218	0.7232	0.6218	0.7886
No log	7.0	210	0.6222	0.7259	0.6222	0.7888
No log	7.0667	212	0.6165	0.7189	0.6165	0.7852
No log	7.1333	214	0.6460	0.7352	0.6460	0.8038
No log	7.2	216	0.6763	0.7266	0.6763	0.8224
No log	7.2667	218	0.6522	0.7352	0.6522	0.8076
No log	7.3333	220	0.6210	0.7267	0.6210	0.7880
No log	7.4	222	0.6158	0.7158	0.6158	0.7847
No log	7.4667	224	0.6152	0.7231	0.6152	0.7843
No log	7.5333	226	0.6153	0.7231	0.6153	0.7844
No log	7.6	228	0.6122	0.7246	0.6122	0.7824
No log	7.6667	230	0.6118	0.7211	0.6118	0.7822
No log	7.7333	232	0.6158	0.7189	0.6158	0.7847
No log	7.8	234	0.6230	0.7177	0.6230	0.7893
No log	7.8667	236	0.6137	0.7177	0.6137	0.7834
No log	7.9333	238	0.6068	0.7149	0.6068	0.7790
No log	8.0	240	0.6132	0.7204	0.6132	0.7831
No log	8.0667	242	0.6331	0.7231	0.6331	0.7957
No log	8.1333	244	0.6420	0.7276	0.6420	0.8013
No log	8.2	246	0.6350	0.7292	0.6350	0.7969
No log	8.2667	248	0.6292	0.7270	0.6292	0.7932
No log	8.3333	250	0.6276	0.7222	0.6276	0.7922
No log	8.4	252	0.6291	0.7330	0.6291	0.7931
No log	8.4667	254	0.6243	0.7243	0.6243	0.7902
No log	8.5333	256	0.6211	0.7243	0.6211	0.7881
No log	8.6	258	0.6144	0.7238	0.6144	0.7838
No log	8.6667	260	0.6129	0.7195	0.6129	0.7829
No log	8.7333	262	0.6122	0.7195	0.6122	0.7824
No log	8.8	264	0.6128	0.7285	0.6128	0.7828
No log	8.8667	266	0.6137	0.7220	0.6137	0.7834
No log	8.9333	268	0.6125	0.7241	0.6125	0.7826
No log	9.0	270	0.6108	0.7241	0.6108	0.7816
No log	9.0667	272	0.6102	0.7256	0.6102	0.7811
No log	9.1333	274	0.6102	0.7235	0.6102	0.7811
No log	9.2	276	0.6090	0.7241	0.6090	0.7804
No log	9.2667	278	0.6094	0.7285	0.6094	0.7806
No log	9.3333	280	0.6102	0.7269	0.6102	0.7812
No log	9.4	282	0.6105	0.7232	0.6105	0.7813
No log	9.4667	284	0.6106	0.7195	0.6106	0.7814
No log	9.5333	286	0.6106	0.7259	0.6106	0.7814
No log	9.6	288	0.6105	0.7281	0.6105	0.7814
No log	9.6667	290	0.6100	0.7281	0.6100	0.7810
No log	9.7333	292	0.6096	0.7281	0.6096	0.7808
No log	9.8	294	0.6093	0.7259	0.6093	0.7806
No log	9.8667	296	0.6091	0.7259	0.6091	0.7804
No log	9.9333	298	0.6091	0.7216	0.6091	0.7805
No log	10.0	300	0.6092	0.7216	0.6092	0.7805

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 8, 2024
Updated: Dec 8, 2024