ArabicNewSplits6_FineTuningAraBERTFreeze_run3_AugV5_k8_task1_organization

MayBashendy/ArabicNewSplits6_FineTuningAraBERTFreeze_run3_AugV5_k8_task1_organization

ArabicNewSplits6_FineTuningAraBERTFreeze_run3_AugV5_k8_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

55% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 23, 2024
Updated: Dec 23, 2024
SHA: f9670e80

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits6_FineTuningAraBERTFreeze_run3_AugV5_k8_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.7042
Qwk: 0.6645
Mse: 0.7042
Rmse: 0.8392

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 16
eval_batch_size: 16
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0952	2	7.8654	-0.0386	7.8654	2.8045
No log	0.1905	4	5.5781	-0.0349	5.5781	2.3618
No log	0.2857	6	3.8957	0.0360	3.8957	1.9738
No log	0.3810	8	2.8521	0.1141	2.8521	1.6888
No log	0.4762	10	2.0801	0.1737	2.0801	1.4423
No log	0.5714	12	1.5931	0.1805	1.5931	1.2622
No log	0.6667	14	1.3228	0.2704	1.3228	1.1501
No log	0.7619	16	1.1991	0.2567	1.1991	1.0950
No log	0.8571	18	1.0858	0.3741	1.0858	1.0420
No log	0.9524	20	1.0221	0.4479	1.0221	1.0110
No log	1.0476	22	0.9883	0.4860	0.9883	0.9941
No log	1.1429	24	0.9283	0.4796	0.9283	0.9635
No log	1.2381	26	0.9133	0.4994	0.9133	0.9557
No log	1.3333	28	0.9829	0.4782	0.9829	0.9914
No log	1.4286	30	0.9784	0.4562	0.9784	0.9891
No log	1.5238	32	0.9821	0.4503	0.9821	0.9910
No log	1.6190	34	0.8756	0.5196	0.8756	0.9358
No log	1.7143	36	0.8193	0.5662	0.8193	0.9051
No log	1.8095	38	0.8158	0.5272	0.8158	0.9032
No log	1.9048	40	0.8022	0.5286	0.8022	0.8957
No log	2.0	42	0.8179	0.5826	0.8179	0.9044
No log	2.0952	44	0.9239	0.5297	0.9239	0.9612
No log	2.1905	46	0.9961	0.5059	0.9961	0.9981
No log	2.2857	48	1.0488	0.5118	1.0488	1.0241
No log	2.3810	50	1.0186	0.5221	1.0186	1.0093
No log	2.4762	52	0.9069	0.5201	0.9069	0.9523
No log	2.5714	54	0.7792	0.5789	0.7792	0.8827
No log	2.6667	56	0.7521	0.5710	0.7521	0.8672
No log	2.7619	58	0.7484	0.6011	0.7484	0.8651
No log	2.8571	60	0.8127	0.6142	0.8127	0.9015
No log	2.9524	62	0.8513	0.5962	0.8513	0.9227
No log	3.0476	64	0.9107	0.5985	0.9107	0.9543
No log	3.1429	66	0.8958	0.5985	0.8958	0.9465
No log	3.2381	68	0.8202	0.6351	0.8202	0.9057
No log	3.3333	70	0.8184	0.6114	0.8184	0.9046
No log	3.4286	72	0.9100	0.6077	0.9100	0.9539
No log	3.5238	74	1.0921	0.5385	1.0921	1.0450
No log	3.6190	76	1.1577	0.5088	1.1577	1.0760
No log	3.7143	78	1.0946	0.5423	1.0946	1.0462
No log	3.8095	80	0.9147	0.6053	0.9147	0.9564
No log	3.9048	82	0.7884	0.6531	0.7884	0.8879
No log	4.0	84	0.7169	0.6787	0.7169	0.8467
No log	4.0952	86	0.7692	0.6740	0.7692	0.8770
No log	4.1905	88	0.8280	0.6447	0.8280	0.9099
No log	4.2857	90	0.9678	0.5941	0.9678	0.9838
No log	4.3810	92	0.9136	0.6083	0.9136	0.9558
No log	4.4762	94	0.8605	0.6162	0.8605	0.9276
No log	4.5714	96	0.7695	0.6485	0.7695	0.8772
No log	4.6667	98	0.6669	0.7080	0.6669	0.8167
No log	4.7619	100	0.6133	0.7208	0.6133	0.7832
No log	4.8571	102	0.6199	0.7105	0.6199	0.7873
No log	4.9524	104	0.7215	0.6980	0.7215	0.8494
No log	5.0476	106	0.9379	0.6097	0.9379	0.9685
No log	5.1429	108	0.9661	0.5984	0.9661	0.9829
No log	5.2381	110	0.8124	0.6458	0.8124	0.9013
No log	5.3333	112	0.7373	0.6954	0.7373	0.8587
No log	5.4286	114	0.6872	0.7047	0.6872	0.8290
No log	5.5238	116	0.7528	0.6802	0.7528	0.8677
No log	5.6190	118	0.8084	0.6728	0.8084	0.8991
No log	5.7143	120	0.8617	0.6697	0.8617	0.9283
No log	5.8095	122	0.8250	0.6635	0.8250	0.9083
No log	5.9048	124	0.7717	0.6732	0.7717	0.8785
No log	6.0	126	0.7453	0.7034	0.7453	0.8633
No log	6.0952	128	0.8452	0.6394	0.8452	0.9193
No log	6.1905	130	0.8794	0.6394	0.8794	0.9378
No log	6.2857	132	0.8692	0.6484	0.8692	0.9323
No log	6.3810	134	0.7550	0.6770	0.7550	0.8689
No log	6.4762	136	0.7004	0.6969	0.7004	0.8369
No log	6.5714	138	0.6648	0.7093	0.6648	0.8153
No log	6.6667	140	0.6971	0.6930	0.6971	0.8349
No log	6.7619	142	0.7100	0.7069	0.7100	0.8426
No log	6.8571	144	0.6817	0.7124	0.6817	0.8257
No log	6.9524	146	0.6704	0.7117	0.6704	0.8187
No log	7.0476	148	0.7190	0.6752	0.7190	0.8479
No log	7.1429	150	0.8535	0.6371	0.8535	0.9238
No log	7.2381	152	0.8286	0.6370	0.8286	0.9103
No log	7.3333	154	0.7306	0.6728	0.7306	0.8547
No log	7.4286	156	0.7444	0.6778	0.7444	0.8628
No log	7.5238	158	0.8117	0.6506	0.8117	0.9009
No log	7.6190	160	0.8340	0.6462	0.8340	0.9132
No log	7.7143	162	0.7744	0.6626	0.7744	0.8800
No log	7.8095	164	0.7339	0.6714	0.7339	0.8567
No log	7.9048	166	0.7301	0.6867	0.7301	0.8544
No log	8.0	168	0.7330	0.6687	0.7330	0.8561
No log	8.0952	170	0.7724	0.6856	0.7724	0.8789
No log	8.1905	172	0.9954	0.5860	0.9954	0.9977
No log	8.2857	174	1.1560	0.4989	1.1560	1.0752
No log	8.3810	176	1.0541	0.5309	1.0541	1.0267
No log	8.4762	178	0.8211	0.6540	0.8211	0.9062
No log	8.5714	180	0.6881	0.6863	0.6881	0.8295
No log	8.6667	182	0.6569	0.6945	0.6569	0.8105
No log	8.7619	184	0.6723	0.6826	0.6723	0.8200
No log	8.8571	186	0.8295	0.6882	0.8295	0.9108
No log	8.9524	188	1.1274	0.4932	1.1274	1.0618
No log	9.0476	190	1.1611	0.5000	1.1611	1.0776
No log	9.1429	192	0.9423	0.5839	0.9423	0.9707
No log	9.2381	194	0.7170	0.6899	0.7170	0.8467
No log	9.3333	196	0.6600	0.6889	0.6600	0.8124
No log	9.4286	198	0.6942	0.6923	0.6942	0.8332
No log	9.5238	200	0.8104	0.6913	0.8104	0.9002
No log	9.6190	202	0.8779	0.6413	0.8779	0.9370
No log	9.7143	204	0.7748	0.6900	0.7748	0.8802
No log	9.8095	206	0.6764	0.6795	0.6764	0.8225
No log	9.9048	208	0.6829	0.7204	0.6829	0.8264
No log	10.0	210	0.6958	0.7119	0.6958	0.8341
No log	10.0952	212	0.6958	0.6888	0.6958	0.8341
No log	10.1905	214	0.7308	0.6453	0.7308	0.8549
No log	10.2857	216	0.7366	0.6518	0.7366	0.8583
No log	10.3810	218	0.7190	0.6560	0.7190	0.8479
No log	10.4762	220	0.7185	0.6661	0.7185	0.8476
No log	10.5714	222	0.7171	0.6998	0.7171	0.8468
No log	10.6667	224	0.7332	0.6527	0.7332	0.8563
No log	10.7619	226	0.7632	0.6513	0.7632	0.8736
No log	10.8571	228	0.7492	0.6736	0.7492	0.8656
No log	10.9524	230	0.7494	0.6926	0.7494	0.8657
No log	11.0476	232	0.7501	0.6694	0.7501	0.8661
No log	11.1429	234	0.7909	0.6462	0.7909	0.8893
No log	11.2381	236	0.8072	0.6445	0.8072	0.8985
No log	11.3333	238	0.7503	0.6625	0.7503	0.8662
No log	11.4286	240	0.7529	0.7187	0.7529	0.8677
No log	11.5238	242	0.8032	0.6669	0.8032	0.8962
No log	11.6190	244	0.7606	0.7020	0.7606	0.8721
No log	11.7143	246	0.7313	0.7187	0.7313	0.8552
No log	11.8095	248	0.6873	0.6948	0.6873	0.8290
No log	11.9048	250	0.7249	0.6733	0.7249	0.8514
No log	12.0	252	0.7518	0.6745	0.7518	0.8671
No log	12.0952	254	0.7096	0.6952	0.7096	0.8424
No log	12.1905	256	0.7043	0.7253	0.7043	0.8392
No log	12.2857	258	0.7469	0.6852	0.7469	0.8642
No log	12.3810	260	0.7142	0.7126	0.7142	0.8451
No log	12.4762	262	0.7003	0.6822	0.7003	0.8368
No log	12.5714	264	0.8159	0.6467	0.8159	0.9033
No log	12.6667	266	0.9011	0.6357	0.9011	0.9493
No log	12.7619	268	0.8378	0.6698	0.8378	0.9153
No log	12.8571	270	0.7327	0.6829	0.7327	0.8560
No log	12.9524	272	0.7872	0.6652	0.7872	0.8873
No log	13.0476	274	0.8569	0.6791	0.8569	0.9257
No log	13.1429	276	0.8027	0.6645	0.8027	0.8959
No log	13.2381	278	0.7335	0.6668	0.7335	0.8565
No log	13.3333	280	0.9013	0.6528	0.9013	0.9494
No log	13.4286	282	1.0719	0.5391	1.0719	1.0353
No log	13.5238	284	1.0049	0.5637	1.0049	1.0024
No log	13.6190	286	0.8080	0.6648	0.8080	0.8989
No log	13.7143	288	0.7451	0.6603	0.7451	0.8632
No log	13.8095	290	0.8179	0.6628	0.8179	0.9044
No log	13.9048	292	0.8103	0.6619	0.8103	0.9002
No log	14.0	294	0.7535	0.6707	0.7535	0.8680
No log	14.0952	296	0.8297	0.6735	0.8297	0.9109
No log	14.1905	298	0.9338	0.6335	0.9338	0.9663
No log	14.2857	300	0.8638	0.6331	0.8638	0.9294
No log	14.3810	302	0.7391	0.6777	0.7391	0.8597
No log	14.4762	304	0.7134	0.6498	0.7134	0.8447
No log	14.5714	306	0.7181	0.6666	0.7181	0.8474
No log	14.6667	308	0.7702	0.6699	0.7702	0.8776
No log	14.7619	310	0.7908	0.6497	0.7908	0.8893
No log	14.8571	312	0.7521	0.6854	0.7521	0.8672
No log	14.9524	314	0.7257	0.6851	0.7257	0.8519
No log	15.0476	316	0.7243	0.6806	0.7243	0.8510
No log	15.1429	318	0.7322	0.6955	0.7322	0.8557
No log	15.2381	320	0.7738	0.6466	0.7738	0.8797
No log	15.3333	322	0.8068	0.6235	0.8068	0.8982
No log	15.4286	324	0.7938	0.6372	0.7938	0.8909
No log	15.5238	326	0.7386	0.6725	0.7386	0.8594
No log	15.6190	328	0.7256	0.6944	0.7256	0.8518
No log	15.7143	330	0.7289	0.6944	0.7289	0.8538
No log	15.8095	332	0.7513	0.6606	0.7513	0.8668
No log	15.9048	334	0.7628	0.6649	0.7628	0.8734
No log	16.0	336	0.7351	0.6968	0.7351	0.8574
No log	16.0952	338	0.7424	0.6927	0.7424	0.8616
No log	16.1905	340	0.7413	0.6927	0.7413	0.8610
No log	16.2857	342	0.7282	0.7024	0.7282	0.8534
No log	16.3810	344	0.7564	0.6836	0.7564	0.8697
No log	16.4762	346	0.7494	0.7030	0.7494	0.8657
No log	16.5714	348	0.7406	0.6991	0.7406	0.8606
No log	16.6667	350	0.7453	0.6909	0.7453	0.8633
No log	16.7619	352	0.7552	0.7024	0.7552	0.8690
No log	16.8571	354	0.7621	0.6964	0.7621	0.8730
No log	16.9524	356	0.7561	0.6911	0.7561	0.8696
No log	17.0476	358	0.7821	0.6860	0.7821	0.8844
No log	17.1429	360	0.7827	0.6793	0.7827	0.8847
No log	17.2381	362	0.7853	0.6627	0.7853	0.8862
No log	17.3333	364	0.7920	0.6461	0.7920	0.8900
No log	17.4286	366	0.7836	0.6623	0.7836	0.8852
No log	17.5238	368	0.7750	0.6744	0.7750	0.8803
No log	17.6190	370	0.7966	0.6767	0.7966	0.8925
No log	17.7143	372	0.8190	0.6606	0.8190	0.9050
No log	17.8095	374	0.7638	0.6645	0.7638	0.8740
No log	17.9048	376	0.7220	0.6936	0.7220	0.8497
No log	18.0	378	0.7469	0.6313	0.7469	0.8642
No log	18.0952	380	0.7313	0.6885	0.7313	0.8552
No log	18.1905	382	0.7349	0.6830	0.7349	0.8572
No log	18.2857	384	0.7624	0.6824	0.7624	0.8731
No log	18.3810	386	0.7628	0.6838	0.7628	0.8734
No log	18.4762	388	0.7628	0.6845	0.7628	0.8734
No log	18.5714	390	0.7537	0.6832	0.7537	0.8682
No log	18.6667	392	0.7589	0.6961	0.7589	0.8711
No log	18.7619	394	0.7666	0.6897	0.7666	0.8755
No log	18.8571	396	0.7713	0.6777	0.7713	0.8782
No log	18.9524	398	0.7844	0.6797	0.7844	0.8857
No log	19.0476	400	0.7930	0.6804	0.7930	0.8905
No log	19.1429	402	0.8000	0.6947	0.8000	0.8944
No log	19.2381	404	0.8196	0.6849	0.8196	0.9053
No log	19.3333	406	0.8296	0.6873	0.8296	0.9108
No log	19.4286	408	0.8317	0.6881	0.8317	0.9120
No log	19.5238	410	0.8351	0.6742	0.8351	0.9138
No log	19.6190	412	0.8773	0.6784	0.8773	0.9366
No log	19.7143	414	0.8732	0.6784	0.8732	0.9344
No log	19.8095	416	0.8339	0.6833	0.8339	0.9132
No log	19.9048	418	0.8203	0.6842	0.8203	0.9057
No log	20.0	420	0.8247	0.6565	0.8247	0.9081
No log	20.0952	422	0.7980	0.6726	0.7980	0.8933
No log	20.1905	424	0.8029	0.6643	0.8029	0.8960
No log	20.2857	426	0.8117	0.6544	0.8117	0.9009
No log	20.3810	428	0.7781	0.6756	0.7781	0.8821
No log	20.4762	430	0.7745	0.6671	0.7745	0.8800
No log	20.5714	432	0.7934	0.6704	0.7934	0.8907
No log	20.6667	434	0.7790	0.6629	0.7790	0.8826
No log	20.7619	436	0.7679	0.6745	0.7679	0.8763
No log	20.8571	438	0.8113	0.6654	0.8113	0.9007
No log	20.9524	440	0.8232	0.6711	0.8232	0.9073
No log	21.0476	442	0.7810	0.6624	0.7810	0.8838
No log	21.1429	444	0.7718	0.6794	0.7718	0.8785
No log	21.2381	446	0.8082	0.6277	0.8082	0.8990
No log	21.3333	448	0.8143	0.6580	0.8143	0.9024
No log	21.4286	450	0.8153	0.6592	0.8153	0.9030
No log	21.5238	452	0.8666	0.6751	0.8666	0.9309
No log	21.6190	454	0.8676	0.6589	0.8676	0.9315
No log	21.7143	456	0.8354	0.6680	0.8354	0.9140
No log	21.8095	458	0.8248	0.6580	0.8248	0.9082
No log	21.9048	460	0.8227	0.6375	0.8227	0.9070
No log	22.0	462	0.7896	0.6525	0.7896	0.8886
No log	22.0952	464	0.7646	0.6714	0.7646	0.8744
No log	22.1905	466	0.7852	0.6763	0.7852	0.8861
No log	22.2857	468	0.7795	0.6763	0.7795	0.8829
No log	22.3810	470	0.7469	0.6849	0.7469	0.8642
No log	22.4762	472	0.7487	0.6742	0.7487	0.8653
No log	22.5714	474	0.7673	0.6842	0.7673	0.8759
No log	22.6667	476	0.7822	0.6923	0.7822	0.8844
No log	22.7619	478	0.8088	0.6754	0.8088	0.8993
No log	22.8571	480	0.8567	0.6642	0.8567	0.9256
No log	22.9524	482	0.8629	0.6712	0.8629	0.9289
No log	23.0476	484	0.8405	0.6730	0.8405	0.9168
No log	23.1429	486	0.8431	0.6649	0.8431	0.9182
No log	23.2381	488	0.8538	0.6515	0.8538	0.9240
No log	23.3333	490	0.8171	0.6710	0.8171	0.9039
No log	23.4286	492	0.8103	0.6754	0.8103	0.9002
No log	23.5238	494	0.8882	0.6556	0.8882	0.9424
No log	23.6190	496	0.9006	0.6381	0.9006	0.9490
No log	23.7143	498	0.8154	0.6741	0.8154	0.9030
0.5471	23.8095	500	0.7246	0.7024	0.7246	0.8512
0.5471	23.9048	502	0.7613	0.6611	0.7613	0.8725
0.5471	24.0	504	0.8737	0.5835	0.8737	0.9347
0.5471	24.0952	506	0.8639	0.5907	0.8639	0.9295
0.5471	24.1905	508	0.7691	0.6330	0.7691	0.8770
0.5471	24.2857	510	0.7042	0.6645	0.7042	0.8392

Framework versions

Transformers 4.44.2
Pytorch 2.4.1+cu121
Datasets 3.2.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 23, 2024
Updated: Dec 23, 2024