ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k7_task3_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k7_task3_organization

ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k7_task3_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

13% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: d1d61fd6

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k7_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.5670
Qwk: 0.3708
Mse: 0.5670
Rmse: 0.7530

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0667	2	3.3703	0.0026	3.3703	1.8358
No log	0.1333	4	1.7605	-0.0370	1.7605	1.3268
No log	0.2	6	1.0744	0.0769	1.0744	1.0365
No log	0.2667	8	1.7055	0.1277	1.7055	1.3059
No log	0.3333	10	1.3014	0.0476	1.3014	1.1408
No log	0.4	12	0.6472	0.1304	0.6472	0.8045
No log	0.4667	14	0.6152	0.0569	0.6152	0.7843
No log	0.5333	16	0.6887	-0.0963	0.6887	0.8299
No log	0.6	18	0.9023	0.0333	0.9023	0.9499
No log	0.6667	20	0.9457	-0.0196	0.9457	0.9725
No log	0.7333	22	0.9303	-0.0159	0.9303	0.9645
No log	0.8	24	0.9164	-0.0081	0.9164	0.9573
No log	0.8667	26	0.7917	-0.0818	0.7917	0.8898
No log	0.9333	28	0.6401	-0.0732	0.6401	0.8001
No log	1.0	30	0.5984	0.0569	0.5984	0.7736
No log	1.0667	32	0.5828	0.0388	0.5828	0.7634
No log	1.1333	34	0.6472	0.0145	0.6472	0.8045
No log	1.2	36	0.6808	0.0769	0.6808	0.8251
No log	1.2667	38	0.5878	0.0569	0.5878	0.7667
No log	1.3333	40	0.5759	0.0	0.5759	0.7589
No log	1.4	42	0.6339	0.1773	0.6339	0.7962
No log	1.4667	44	0.7114	-0.0169	0.7114	0.8434
No log	1.5333	46	0.6500	0.0769	0.6500	0.8062
No log	1.6	48	0.5909	-0.0159	0.5909	0.7687
No log	1.6667	50	0.5879	-0.0159	0.5879	0.7667
No log	1.7333	52	0.6091	0.0071	0.6091	0.7804
No log	1.8	54	0.6349	0.0769	0.6349	0.7968
No log	1.8667	56	0.8665	0.1289	0.8665	0.9309
No log	1.9333	58	0.9241	0.1730	0.9241	0.9613
No log	2.0	60	0.6706	0.1638	0.6706	0.8189
No log	2.0667	62	0.6404	0.1724	0.6404	0.8002
No log	2.1333	64	0.6095	0.1515	0.6095	0.7807
No log	2.2	66	0.5938	0.1605	0.5938	0.7706
No log	2.2667	68	0.5855	0.0850	0.5855	0.7652
No log	2.3333	70	0.7457	0.2323	0.7457	0.8635
No log	2.4	72	0.9016	0.2340	0.9016	0.9495
No log	2.4667	74	0.7447	0.1746	0.7447	0.8629
No log	2.5333	76	0.6186	0.1579	0.6186	0.7865
No log	2.6	78	0.6368	0.2704	0.6368	0.7980
No log	2.6667	80	0.5831	0.3446	0.5831	0.7636
No log	2.7333	82	0.9287	0.2432	0.9287	0.9637
No log	2.8	84	0.9161	0.2432	0.9161	0.9571
No log	2.8667	86	0.5646	0.2195	0.5646	0.7514
No log	2.9333	88	0.7629	0.1828	0.7629	0.8735
No log	3.0	90	1.0657	0.0	1.0657	1.0323
No log	3.0667	92	1.0813	-0.0246	1.0813	1.0399
No log	3.1333	94	0.8745	0.1220	0.8745	0.9351
No log	3.2	96	0.5743	0.0986	0.5743	0.7578
No log	3.2667	98	0.8256	0.2281	0.8256	0.9086
No log	3.3333	100	1.3715	0.0204	1.3715	1.1711
No log	3.4	102	1.4175	0.0168	1.4175	1.1906
No log	3.4667	104	1.0499	0.0388	1.0499	1.0246
No log	3.5333	106	0.6867	0.25	0.6867	0.8287
No log	3.6	108	0.5546	0.0071	0.5546	0.7447
No log	3.6667	110	0.6101	0.1565	0.6101	0.7811
No log	3.7333	112	0.7601	0.1392	0.7601	0.8718
No log	3.8	114	0.7933	0.1475	0.7933	0.8907
No log	3.8667	116	0.6573	0.2201	0.6573	0.8108
No log	3.9333	118	0.5878	0.2857	0.5878	0.7667
No log	4.0	120	0.7801	0.2146	0.7801	0.8832
No log	4.0667	122	0.9699	0.1506	0.9699	0.9848
No log	4.1333	124	0.8743	0.2129	0.8743	0.9350
No log	4.2	126	0.7218	0.1443	0.7218	0.8496
No log	4.2667	128	0.6517	0.3023	0.6517	0.8073
No log	4.3333	130	0.7127	0.2727	0.7127	0.8442
No log	4.4	132	0.7272	0.2727	0.7272	0.8528
No log	4.4667	134	0.6801	0.2941	0.6801	0.8247
No log	4.5333	136	0.7331	0.2381	0.7331	0.8562
No log	4.6	138	0.8154	0.1276	0.8154	0.9030
No log	4.6667	140	0.7146	0.2381	0.7146	0.8453
No log	4.7333	142	0.7077	0.3623	0.7077	0.8413
No log	4.8	144	0.7554	0.3052	0.7554	0.8691
No log	4.8667	146	0.6577	0.3200	0.6577	0.8110
No log	4.9333	148	0.6414	0.2709	0.6414	0.8009
No log	5.0	150	0.6279	0.2577	0.6279	0.7924
No log	5.0667	152	0.6968	0.3892	0.6968	0.8348
No log	5.1333	154	0.7024	0.3892	0.7024	0.8381
No log	5.2	156	0.6182	0.3052	0.6182	0.7862
No log	5.2667	158	0.5940	0.3010	0.5940	0.7707
No log	5.3333	160	0.6145	0.3398	0.6145	0.7839
No log	5.4	162	0.6123	0.4175	0.6123	0.7825
No log	5.4667	164	0.6390	0.3846	0.6390	0.7994
No log	5.5333	166	0.6276	0.3645	0.6276	0.7922
No log	5.6	168	0.6033	0.3367	0.6033	0.7767
No log	5.6667	170	0.6072	0.3103	0.6072	0.7792
No log	5.7333	172	0.6393	0.3684	0.6393	0.7996
No log	5.8	174	0.6706	0.3892	0.6706	0.8189
No log	5.8667	176	0.7047	0.3427	0.7047	0.8394
No log	5.9333	178	0.7421	0.3488	0.7421	0.8615
No log	6.0	180	0.6909	0.3786	0.6909	0.8312
No log	6.0667	182	0.6358	0.3623	0.6358	0.7973
No log	6.1333	184	0.6278	0.3623	0.6278	0.7923
No log	6.2	186	0.6071	0.3010	0.6071	0.7792
No log	6.2667	188	0.6255	0.3469	0.6255	0.7909
No log	6.3333	190	0.6222	0.3469	0.6222	0.7888
No log	6.4	192	0.6030	0.3814	0.6030	0.7765
No log	6.4667	194	0.5978	0.3814	0.5978	0.7732
No log	6.5333	196	0.6178	0.3831	0.6178	0.7860
No log	6.6	198	0.6579	0.4051	0.6579	0.8111
No log	6.6667	200	0.6850	0.36	0.6850	0.8276
No log	6.7333	202	0.6192	0.3878	0.6192	0.7869
No log	6.8	204	0.6028	0.4	0.6028	0.7764
No log	6.8667	206	0.6045	0.3939	0.6045	0.7775
No log	6.9333	208	0.6517	0.3498	0.6517	0.8073
No log	7.0	210	0.6835	0.36	0.6835	0.8267
No log	7.0667	212	0.6676	0.36	0.6676	0.8170
No log	7.1333	214	0.6120	0.3769	0.6120	0.7823
No log	7.2	216	0.5842	0.3267	0.5842	0.7643
No log	7.2667	218	0.5984	0.3684	0.5984	0.7736
No log	7.3333	220	0.6565	0.3116	0.6565	0.8103
No log	7.4	222	0.6558	0.3951	0.6558	0.8098
No log	7.4667	224	0.5937	0.3684	0.5937	0.7705
No log	7.5333	226	0.5528	0.3263	0.5528	0.7435
No log	7.6	228	0.5458	0.2626	0.5458	0.7388
No log	7.6667	230	0.5513	0.2889	0.5513	0.7425
No log	7.7333	232	0.5424	0.2644	0.5424	0.7365
No log	7.8	234	0.5487	0.2370	0.5487	0.7408
No log	7.8667	236	0.6016	0.3684	0.6016	0.7757
No log	7.9333	238	0.6202	0.3641	0.6202	0.7876
No log	8.0	240	0.6210	0.3641	0.6210	0.7880
No log	8.0667	242	0.5952	0.3684	0.5952	0.7715
No log	8.1333	244	0.5519	0.3043	0.5519	0.7429
No log	8.2	246	0.5455	0.2990	0.5455	0.7386
No log	8.2667	248	0.5452	0.2990	0.5452	0.7384
No log	8.3333	250	0.5399	0.2766	0.5399	0.7348
No log	8.4	252	0.5518	0.2809	0.5518	0.7428
No log	8.4667	254	0.5485	0.3258	0.5485	0.7406
No log	8.5333	256	0.5356	0.3263	0.5356	0.7318
No log	8.6	258	0.5359	0.3263	0.5359	0.7321
No log	8.6667	260	0.5471	0.3591	0.5471	0.7397
No log	8.7333	262	0.5762	0.3684	0.5762	0.7591
No log	8.8	264	0.6007	0.4051	0.6007	0.7751
No log	8.8667	266	0.6261	0.4	0.6261	0.7913
No log	8.9333	268	0.6298	0.4	0.6298	0.7936
No log	9.0	270	0.6230	0.4	0.6230	0.7893
No log	9.0667	272	0.6251	0.4	0.6251	0.7907
No log	9.1333	274	0.6166	0.4051	0.6166	0.7852
No log	9.2	276	0.6076	0.4051	0.6076	0.7795
No log	9.2667	278	0.5844	0.3990	0.5844	0.7644
No log	9.3333	280	0.5715	0.3927	0.5715	0.7560
No log	9.4	282	0.5636	0.3478	0.5636	0.7507
No log	9.4667	284	0.5589	0.3797	0.5589	0.7476
No log	9.5333	286	0.5581	0.3797	0.5581	0.7471
No log	9.6	288	0.5581	0.3797	0.5581	0.7471
No log	9.6667	290	0.5584	0.3797	0.5584	0.7473
No log	9.7333	292	0.5599	0.3478	0.5599	0.7483
No log	9.8	294	0.5618	0.3478	0.5618	0.7495
No log	9.8667	296	0.5643	0.3478	0.5643	0.7512
No log	9.9333	298	0.5663	0.3708	0.5663	0.7525
No log	10.0	300	0.5670	0.3708	0.5670	0.7530

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024