ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k10_task3_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k10_task3_organization

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k10_task3_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

16% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: 1f83b6ff

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k10_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.5685
Qwk: 0.3730
Mse: 0.5685
Rmse: 0.7540

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0488	2	3.0938	-0.0332	3.0938	1.7589
No log	0.0976	4	1.4729	-0.0101	1.4729	1.2136
No log	0.1463	6	1.4349	0.0247	1.4349	1.1979
No log	0.1951	8	0.9215	0.1245	0.9215	0.9600
No log	0.2439	10	0.5645	0.0388	0.5645	0.7514
No log	0.2927	12	0.5523	0.0569	0.5523	0.7431
No log	0.3415	14	0.5513	0.0569	0.5513	0.7425
No log	0.3902	16	0.5535	0.0569	0.5535	0.7439
No log	0.4390	18	0.5606	0.0569	0.5606	0.7487
No log	0.4878	20	0.5371	0.0222	0.5371	0.7329
No log	0.5366	22	0.6124	0.2000	0.6124	0.7826
No log	0.5854	24	0.6428	0.1515	0.6428	0.8017
No log	0.6341	26	0.6246	0.1605	0.6246	0.7903
No log	0.6829	28	0.6460	0.2967	0.6460	0.8037
No log	0.7317	30	0.5632	0.0909	0.5632	0.7505
No log	0.7805	32	0.5842	0.2533	0.5842	0.7644
No log	0.8293	34	0.5751	0.2000	0.5751	0.7583
No log	0.8780	36	0.5996	0.0	0.5996	0.7743
No log	0.9268	38	0.6431	0.0	0.6431	0.8019
No log	0.9756	40	0.6668	-0.0732	0.6668	0.8166
No log	1.0244	42	0.6750	-0.0732	0.6750	0.8216
No log	1.0732	44	0.6390	0.1667	0.6390	0.7994
No log	1.1220	46	0.8016	0.0476	0.8016	0.8953
No log	1.1707	48	0.9203	0.0261	0.9203	0.9593
No log	1.2195	50	0.7430	0.1038	0.7430	0.8619
No log	1.2683	52	0.6965	-0.0159	0.6965	0.8346
No log	1.3171	54	0.7226	0.0476	0.7226	0.8500
No log	1.3659	56	0.7238	0.0123	0.7238	0.8507
No log	1.4146	58	1.0600	0.1130	1.0600	1.0295
No log	1.4634	60	1.1314	0.136	1.1314	1.0637
No log	1.5122	62	0.8130	0.0270	0.8130	0.9017
No log	1.5610	64	0.7668	0.0123	0.7668	0.8757
No log	1.6098	66	0.7457	-0.0314	0.7457	0.8635
No log	1.6585	68	0.7230	0.1884	0.7230	0.8503
No log	1.7073	70	0.6947	0.0815	0.6947	0.8335
No log	1.7561	72	0.6470	0.1467	0.6470	0.8043
No log	1.8049	74	0.6971	0.125	0.6971	0.8349
No log	1.8537	76	0.7285	0.1385	0.7285	0.8535
No log	1.9024	78	0.6811	0.1278	0.6811	0.8253
No log	1.9512	80	0.6355	0.2393	0.6355	0.7972
No log	2.0	82	0.6622	0.0520	0.6622	0.8137
No log	2.0488	84	0.6766	0.2393	0.6766	0.8226
No log	2.0976	86	1.0459	0.0149	1.0459	1.0227
No log	2.1463	88	1.1724	0.0604	1.1724	1.0828
No log	2.1951	90	1.0645	0.0530	1.0645	1.0317
No log	2.2439	92	0.6778	0.2941	0.6778	0.8233
No log	2.2927	94	0.6979	0.1038	0.6979	0.8354
No log	2.3415	96	0.8170	0.2165	0.8170	0.9039
No log	2.3902	98	1.3857	0.0222	1.3857	1.1772
No log	2.4390	100	1.2902	0.0689	1.2902	1.1359
No log	2.4878	102	0.6958	0.2340	0.6958	0.8342
No log	2.5366	104	0.7257	0.0612	0.7257	0.8519
No log	2.5854	106	0.6773	0.1910	0.6773	0.8230
No log	2.6341	108	0.8953	0.0244	0.8953	0.9462
No log	2.6829	110	1.1403	0.0222	1.1403	1.0678
No log	2.7317	112	0.8707	0.1441	0.8707	0.9331
No log	2.7805	114	0.7180	0.3016	0.7180	0.8473
No log	2.8293	116	0.8124	0.2075	0.8124	0.9013
No log	2.8780	118	0.8322	0.1781	0.8322	0.9122
No log	2.9268	120	0.7186	0.1919	0.7186	0.8477
No log	2.9756	122	0.8067	0.1705	0.8067	0.8982
No log	3.0244	124	0.7963	0.1321	0.7963	0.8924
No log	3.0732	126	0.7851	0.1321	0.7851	0.8861
No log	3.1220	128	0.6557	0.1739	0.6557	0.8098
No log	3.1707	130	0.6412	0.3023	0.6412	0.8008
No log	3.2195	132	0.7228	0.1357	0.7228	0.8502
No log	3.2683	134	0.8608	0.1256	0.8608	0.9278
No log	3.3171	136	0.7261	0.2245	0.7261	0.8521
No log	3.3659	138	0.6458	0.1429	0.6458	0.8036
No log	3.4146	140	0.7701	0.1064	0.7701	0.8776
No log	3.4634	142	0.6749	0.2265	0.6749	0.8215
No log	3.5122	144	0.8547	0.1131	0.8547	0.9245
No log	3.5610	146	1.1108	0.0316	1.1108	1.0539
No log	3.6098	148	0.9782	0.0462	0.9782	0.9890
No log	3.6585	150	0.6836	0.1475	0.6836	0.8268
No log	3.7073	152	0.6490	0.2644	0.6490	0.8056
No log	3.7561	154	0.7724	0.2239	0.7724	0.8789
No log	3.8049	156	0.7905	0.1590	0.7905	0.8891
No log	3.8537	158	0.6017	0.2663	0.6017	0.7757
No log	3.9024	160	0.7590	0.1179	0.7590	0.8712
No log	3.9512	162	0.7311	0.1600	0.7311	0.8551
No log	4.0	164	0.5881	0.2663	0.5881	0.7669
No log	4.0488	166	0.7894	0.1923	0.7894	0.8885
No log	4.0976	168	0.9846	0.1698	0.9846	0.9923
No log	4.1463	170	0.7735	0.2227	0.7735	0.8795
No log	4.1951	172	0.6258	0.2994	0.6258	0.7911
No log	4.2439	174	0.7928	0.2077	0.7928	0.8904
No log	4.2927	176	0.7025	0.1675	0.7025	0.8382
No log	4.3415	178	0.6947	0.3010	0.6947	0.8335
No log	4.3902	180	1.0286	0.1143	1.0286	1.0142
No log	4.4390	182	1.0151	0.1143	1.0151	1.0075
No log	4.4878	184	0.7305	0.2165	0.7305	0.8547
No log	4.5366	186	0.6668	0.2914	0.6668	0.8166
No log	4.5854	188	0.6518	0.3478	0.6518	0.8074
No log	4.6341	190	0.6491	0.3478	0.6491	0.8057
No log	4.6829	192	0.7415	0.1351	0.7415	0.8611
No log	4.7317	194	0.9656	0.1367	0.9656	0.9826
No log	4.7805	196	1.0842	0.1172	1.0842	1.0412
No log	4.8293	198	0.9305	0.1939	0.9305	0.9646
No log	4.8780	200	0.6358	0.25	0.6358	0.7974
No log	4.9268	202	0.5593	0.4033	0.5593	0.7479
No log	4.9756	204	0.6161	0.3171	0.6161	0.7849
No log	5.0244	206	0.5459	0.4033	0.5459	0.7388
No log	5.0732	208	0.5620	0.3371	0.5620	0.7497
No log	5.1220	210	0.6924	0.2315	0.6924	0.8321
No log	5.1707	212	0.7071	0.2676	0.7071	0.8409
No log	5.2195	214	0.5691	0.3292	0.5691	0.7544
No log	5.2683	216	0.5254	0.3829	0.5254	0.7248
No log	5.3171	218	0.5342	0.3953	0.5342	0.7309
No log	5.3659	220	0.5863	0.2766	0.5863	0.7657
No log	5.4146	222	0.5726	0.2990	0.5726	0.7567
No log	5.4634	224	0.5310	0.4350	0.5310	0.7287
No log	5.5122	226	0.6268	0.3939	0.6268	0.7917
No log	5.5610	228	0.6587	0.3524	0.6587	0.8116
No log	5.6098	230	0.5257	0.3684	0.5257	0.7251
No log	5.6585	232	0.5762	0.2809	0.5762	0.7591
No log	5.7073	234	0.7566	0.2762	0.7566	0.8698
No log	5.7561	236	0.7216	0.2390	0.7216	0.8495
No log	5.8049	238	0.5478	0.3735	0.5478	0.7401
No log	5.8537	240	0.5190	0.3253	0.5190	0.7204
No log	5.9024	242	0.6402	0.2527	0.6402	0.8002
No log	5.9512	244	0.5992	0.2707	0.5992	0.7741
No log	6.0	246	0.5142	0.3882	0.5142	0.7171
No log	6.0488	248	0.5561	0.3073	0.5561	0.7457
No log	6.0976	250	0.6543	0.2421	0.6543	0.8089
No log	6.1463	252	0.8886	0.2000	0.8886	0.9426
No log	6.1951	254	0.9600	0.1709	0.9600	0.9798
No log	6.2439	256	0.8168	0.2000	0.8168	0.9038
No log	6.2927	258	0.5991	0.3333	0.5991	0.7740
No log	6.3415	260	0.5096	0.4222	0.5096	0.7139
No log	6.3902	262	0.5522	0.3778	0.5522	0.7431
No log	6.4390	264	0.6002	0.2000	0.6002	0.7747
No log	6.4878	266	0.5224	0.3371	0.5224	0.7228
No log	6.5366	268	0.4698	0.4220	0.4698	0.6854
No log	6.5854	270	0.5075	0.4634	0.5075	0.7124
No log	6.6341	272	0.5612	0.3295	0.5612	0.7491
No log	6.6829	274	0.5209	0.3735	0.5209	0.7218
No log	6.7317	276	0.4937	0.4419	0.4937	0.7026
No log	6.7805	278	0.4670	0.4682	0.4670	0.6834
No log	6.8293	280	0.4658	0.5	0.4658	0.6825
No log	6.8780	282	0.4772	0.4682	0.4772	0.6908
No log	6.9268	284	0.4895	0.4157	0.4895	0.6997
No log	6.9756	286	0.5665	0.3402	0.5665	0.7527
No log	7.0244	288	0.6434	0.3365	0.6434	0.8021
No log	7.0732	290	0.6096	0.3398	0.6096	0.7808
No log	7.1220	292	0.5625	0.3333	0.5625	0.7500
No log	7.1707	294	0.5920	0.3035	0.5920	0.7694
No log	7.2195	296	0.6124	0.2727	0.6124	0.7825
No log	7.2683	298	0.5481	0.3297	0.5481	0.7403
No log	7.3171	300	0.4895	0.3898	0.4895	0.6997
No log	7.3659	302	0.4912	0.4475	0.4912	0.7009
No log	7.4146	304	0.4872	0.4667	0.4872	0.6980
No log	7.4634	306	0.5205	0.3412	0.5205	0.7214
No log	7.5122	308	0.6401	0.2727	0.6401	0.8000
No log	7.5610	310	0.7111	0.2364	0.7111	0.8433
No log	7.6098	312	0.6757	0.2300	0.6757	0.8220
No log	7.6585	314	0.5717	0.3333	0.5717	0.7561
No log	7.7073	316	0.5057	0.4286	0.5057	0.7111
No log	7.7561	318	0.5018	0.3371	0.5018	0.7084
No log	7.8049	320	0.5016	0.3488	0.5016	0.7083
No log	7.8537	322	0.5032	0.3563	0.5032	0.7094
No log	7.9024	324	0.5146	0.4286	0.5146	0.7174
No log	7.9512	326	0.5562	0.3829	0.5562	0.7458
No log	8.0	328	0.6242	0.2893	0.6242	0.7901
No log	8.0488	330	0.6445	0.2549	0.6445	0.8028
No log	8.0976	332	0.6116	0.3231	0.6116	0.7820
No log	8.1463	334	0.5724	0.3297	0.5724	0.7566
No log	8.1951	336	0.5466	0.4682	0.5466	0.7393
No log	8.2439	338	0.5264	0.3898	0.5264	0.7255
No log	8.2927	340	0.5312	0.3757	0.5312	0.7289
No log	8.3415	342	0.5280	0.3757	0.5280	0.7267
No log	8.3902	344	0.5209	0.3563	0.5209	0.7217
No log	8.4390	346	0.5511	0.4098	0.5511	0.7424
No log	8.4878	348	0.6255	0.3171	0.6255	0.7909
No log	8.5366	350	0.6803	0.1841	0.6803	0.8248
No log	8.5854	352	0.6746	0.1841	0.6746	0.8214
No log	8.6341	354	0.6443	0.2549	0.6443	0.8027
No log	8.6829	356	0.6395	0.2549	0.6395	0.7997
No log	8.7317	358	0.6091	0.2871	0.6091	0.7804
No log	8.7805	360	0.5837	0.3231	0.5837	0.7640
No log	8.8293	362	0.5696	0.3263	0.5696	0.7547
No log	8.8780	364	0.5417	0.4157	0.5417	0.7360
No log	8.9268	366	0.5183	0.4682	0.5183	0.7200
No log	8.9756	368	0.5158	0.4682	0.5158	0.7182
No log	9.0244	370	0.5175	0.4682	0.5175	0.7193
No log	9.0732	372	0.5186	0.4682	0.5186	0.7201
No log	9.1220	374	0.5194	0.4682	0.5194	0.7207
No log	9.1707	376	0.5215	0.4682	0.5215	0.7221
No log	9.2195	378	0.5327	0.4157	0.5327	0.7299
No log	9.2683	380	0.5555	0.4043	0.5555	0.7453
No log	9.3171	382	0.5890	0.3200	0.5890	0.7674
No log	9.3659	384	0.6043	0.2893	0.6043	0.7774
No log	9.4146	386	0.5972	0.2893	0.5972	0.7728
No log	9.4634	388	0.5851	0.3231	0.5851	0.7649
No log	9.5122	390	0.5706	0.3263	0.5706	0.7554
No log	9.5610	392	0.5595	0.3730	0.5595	0.7480
No log	9.6098	394	0.5573	0.4043	0.5573	0.7465
No log	9.6585	396	0.5571	0.4043	0.5571	0.7464
No log	9.7073	398	0.5567	0.4043	0.5567	0.7461
No log	9.7561	400	0.5547	0.4043	0.5547	0.7448
No log	9.8049	402	0.5557	0.4043	0.5557	0.7454
No log	9.8537	404	0.5593	0.4043	0.5593	0.7478
No log	9.9024	406	0.5638	0.3730	0.5638	0.7509
No log	9.9512	408	0.5671	0.3730	0.5671	0.7530
No log	10.0	410	0.5685	0.3730	0.5685	0.7540

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024