ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k7_task3_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k7_task3_organization

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k7_task3_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

11% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: 63055da2

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k7_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.5633
Qwk: 0.3708
Mse: 0.5633
Rmse: 0.7505

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0667	2	3.3703	0.0026	3.3703	1.8358
No log	0.1333	4	1.7605	-0.0370	1.7605	1.3268
No log	0.2	6	1.0744	0.0769	1.0744	1.0365
No log	0.2667	8	1.7055	0.1277	1.7055	1.3059
No log	0.3333	10	1.3014	0.0476	1.3014	1.1408
No log	0.4	12	0.6472	0.1304	0.6472	0.8045
No log	0.4667	14	0.6152	0.0569	0.6152	0.7843
No log	0.5333	16	0.6887	-0.0963	0.6887	0.8299
No log	0.6	18	0.9022	0.0333	0.9022	0.9499
No log	0.6667	20	0.9457	-0.0196	0.9457	0.9725
No log	0.7333	22	0.9303	-0.0159	0.9303	0.9645
No log	0.8	24	0.9164	-0.0081	0.9164	0.9573
No log	0.8667	26	0.7917	-0.0818	0.7917	0.8898
No log	0.9333	28	0.6401	-0.0732	0.6401	0.8001
No log	1.0	30	0.5984	0.0569	0.5984	0.7736
No log	1.0667	32	0.5828	0.0388	0.5828	0.7634
No log	1.1333	34	0.6473	0.0145	0.6473	0.8045
No log	1.2	36	0.6808	0.0769	0.6808	0.8251
No log	1.2667	38	0.5878	0.0569	0.5878	0.7667
No log	1.3333	40	0.5759	0.0	0.5759	0.7589
No log	1.4	42	0.6337	0.1773	0.6337	0.7960
No log	1.4667	44	0.7111	-0.0169	0.7111	0.8433
No log	1.5333	46	0.6502	0.0769	0.6502	0.8064
No log	1.6	48	0.5910	-0.0159	0.5910	0.7688
No log	1.6667	50	0.5879	-0.0159	0.5879	0.7668
No log	1.7333	52	0.6091	0.0071	0.6091	0.7805
No log	1.8	54	0.6348	0.0769	0.6348	0.7968
No log	1.8667	56	0.8664	0.1289	0.8664	0.9308
No log	1.9333	58	0.9241	0.1730	0.9241	0.9613
No log	2.0	60	0.6708	0.1638	0.6708	0.8190
No log	2.0667	62	0.6406	0.1724	0.6406	0.8003
No log	2.1333	64	0.6095	0.1515	0.6095	0.7807
No log	2.2	66	0.5938	0.1605	0.5938	0.7706
No log	2.2667	68	0.5855	0.0850	0.5855	0.7652
No log	2.3333	70	0.7453	0.2323	0.7453	0.8633
No log	2.4	72	0.9014	0.2340	0.9014	0.9494
No log	2.4667	74	0.7450	0.1746	0.7450	0.8631
No log	2.5333	76	0.6183	0.1579	0.6183	0.7863
No log	2.6	78	0.6370	0.2704	0.6370	0.7981
No log	2.6667	80	0.5828	0.3446	0.5828	0.7634
No log	2.7333	82	0.9281	0.2432	0.9281	0.9634
No log	2.8	84	0.9183	0.2432	0.9183	0.9583
No log	2.8667	86	0.5660	0.2096	0.5660	0.7523
No log	2.9333	88	0.7611	0.1828	0.7611	0.8724
No log	3.0	90	1.0655	-0.0036	1.0655	1.0322
No log	3.0667	92	1.0818	-0.0246	1.0818	1.0401
No log	3.1333	94	0.8762	0.1220	0.8762	0.9361
No log	3.2	96	0.5756	0.0986	0.5756	0.7587
No log	3.2667	98	0.8153	0.1644	0.8153	0.9029
No log	3.3333	100	1.3547	0.0204	1.3547	1.1639
No log	3.4	102	1.4062	0.0168	1.4062	1.1858
No log	3.4667	104	1.0462	0.0388	1.0462	1.0228
No log	3.5333	106	0.6864	0.25	0.6864	0.8285
No log	3.6	108	0.5543	0.0725	0.5543	0.7445
No log	3.6667	110	0.6058	0.1565	0.6058	0.7784
No log	3.7333	112	0.7544	0.1392	0.7544	0.8686
No log	3.8	114	0.7908	0.1475	0.7908	0.8893
No log	3.8667	116	0.6577	0.2201	0.6577	0.8110
No log	3.9333	118	0.5865	0.2485	0.5865	0.7658
No log	4.0	120	0.7832	0.2146	0.7832	0.8850
No log	4.0667	122	0.9796	0.1760	0.9796	0.9898
No log	4.1333	124	0.8749	0.2129	0.8749	0.9354
No log	4.2	126	0.7158	0.1443	0.7158	0.8460
No log	4.2667	128	0.6493	0.3136	0.6493	0.8058
No log	4.3333	130	0.7126	0.2727	0.7126	0.8442
No log	4.4	132	0.7241	0.2727	0.7241	0.8509
No log	4.4667	134	0.6737	0.2941	0.6737	0.8208
No log	4.5333	136	0.7299	0.2381	0.7299	0.8544
No log	4.6	138	0.7983	0.1276	0.7983	0.8935
No log	4.6667	140	0.6989	0.2941	0.6989	0.8360
No log	4.7333	142	0.7256	0.3131	0.7256	0.8518
No log	4.8	144	0.7777	0.3052	0.7777	0.8819
No log	4.8667	146	0.6615	0.3706	0.6615	0.8133
No log	4.9333	148	0.6393	0.2709	0.6393	0.7996
No log	5.0	150	0.6260	0.2577	0.6260	0.7912
No log	5.0667	152	0.6804	0.3892	0.6804	0.8248
No log	5.1333	154	0.7085	0.3892	0.7085	0.8417
No log	5.2	156	0.6372	0.3892	0.6372	0.7983
No log	5.2667	158	0.6136	0.3301	0.6136	0.7833
No log	5.3333	160	0.6178	0.3398	0.6178	0.7860
No log	5.4	162	0.5986	0.3725	0.5986	0.7737
No log	5.4667	164	0.6279	0.3846	0.6279	0.7924
No log	5.5333	166	0.6338	0.3846	0.6338	0.7961
No log	5.6	168	0.6121	0.4175	0.6121	0.7823
No log	5.6667	170	0.5996	0.3704	0.5996	0.7743
No log	5.7333	172	0.6250	0.4175	0.6250	0.7906
No log	5.8	174	0.6643	0.3427	0.6643	0.8151
No log	5.8667	176	0.7089	0.3394	0.7089	0.8420
No log	5.9333	178	0.7561	0.3488	0.7561	0.8696
No log	6.0	180	0.7014	0.3846	0.7014	0.8375
No log	6.0667	182	0.6303	0.3585	0.6303	0.7939
No log	6.1333	184	0.6211	0.3585	0.6211	0.7881
No log	6.2	186	0.6071	0.36	0.6071	0.7792
No log	6.2667	188	0.6463	0.3786	0.6463	0.8039
No log	6.3333	190	0.6364	0.3786	0.6364	0.7978
No log	6.4	192	0.6027	0.4171	0.6027	0.7763
No log	6.4667	194	0.5950	0.4171	0.5950	0.7714
No log	6.5333	196	0.6246	0.3831	0.6246	0.7903
No log	6.6	198	0.6748	0.4	0.6748	0.8214
No log	6.6667	200	0.7052	0.3561	0.7052	0.8397
No log	6.7333	202	0.6227	0.4229	0.6227	0.7891
No log	6.8	204	0.6011	0.3892	0.6011	0.7753
No log	6.8667	206	0.6026	0.3892	0.6026	0.7763
No log	6.9333	208	0.6572	0.3498	0.6572	0.8107
No log	7.0	210	0.6920	0.3561	0.6920	0.8318
No log	7.0667	212	0.6678	0.3561	0.6678	0.8172
No log	7.1333	214	0.6071	0.3469	0.6071	0.7792
No log	7.2	216	0.5766	0.3846	0.5766	0.7594
No log	7.2667	218	0.5893	0.3684	0.5893	0.7677
No log	7.3333	220	0.6518	0.3561	0.6518	0.8073
No log	7.4	222	0.6510	0.3951	0.6510	0.8068
No log	7.4667	224	0.5863	0.3684	0.5863	0.7657
No log	7.5333	226	0.5455	0.3333	0.5455	0.7386
No log	7.6	228	0.5349	0.2967	0.5349	0.7314
No log	7.6667	230	0.5388	0.2994	0.5388	0.7341
No log	7.7333	232	0.5320	0.2626	0.5320	0.7294
No log	7.8	234	0.5442	0.3371	0.5442	0.7377
No log	7.8667	236	0.5953	0.3684	0.5953	0.7716
No log	7.9333	238	0.6050	0.3684	0.6050	0.7778
No log	8.0	240	0.5989	0.3684	0.5989	0.7739
No log	8.0667	242	0.5730	0.3730	0.5730	0.7570
No log	8.1333	244	0.5404	0.2865	0.5404	0.7351
No log	8.2	246	0.5413	0.2990	0.5413	0.7357
No log	8.2667	248	0.5395	0.2990	0.5395	0.7345
No log	8.3333	250	0.5356	0.2865	0.5356	0.7319
No log	8.4	252	0.5507	0.3661	0.5507	0.7421
No log	8.4667	254	0.5464	0.3708	0.5464	0.7392
No log	8.5333	256	0.5312	0.3263	0.5312	0.7288
No log	8.6	258	0.5309	0.3575	0.5309	0.7286
No log	8.6667	260	0.5413	0.3043	0.5413	0.7357
No log	8.7333	262	0.5698	0.3990	0.5698	0.7548
No log	8.8	264	0.5943	0.4	0.5943	0.7709
No log	8.8667	266	0.6236	0.4	0.6236	0.7897
No log	8.9333	268	0.6316	0.4	0.6316	0.7947
No log	9.0	270	0.6265	0.4	0.6265	0.7915
No log	9.0667	272	0.6294	0.4	0.6294	0.7934
No log	9.1333	274	0.6207	0.4	0.6207	0.7878
No log	9.2	276	0.6111	0.4	0.6111	0.7818
No log	9.2667	278	0.5856	0.3990	0.5856	0.7653
No log	9.3333	280	0.5709	0.4043	0.5709	0.7556
No log	9.4	282	0.5602	0.3478	0.5602	0.7484
No log	9.4667	284	0.5546	0.3575	0.5546	0.7447
No log	9.5333	286	0.5534	0.3575	0.5534	0.7439
No log	9.6	288	0.5531	0.3575	0.5531	0.7437
No log	9.6667	290	0.5532	0.3263	0.5532	0.7438
No log	9.7333	292	0.5548	0.3478	0.5548	0.7448
No log	9.8	294	0.5570	0.3478	0.5570	0.7463
No log	9.8667	296	0.5599	0.3591	0.5599	0.7483
No log	9.9333	298	0.5623	0.3708	0.5623	0.7499
No log	10.0	300	0.5633	0.3708	0.5633	0.7505

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024