ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k14_task3_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k14_task3_organization

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k14_task3_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

25% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: 283b72a5

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k14_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.7632
Qwk: 0.1675
Mse: 0.7632
Rmse: 0.8736

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0357	2	3.5317	-0.0066	3.5317	1.8793
No log	0.0714	4	2.0296	-0.0390	2.0296	1.4247
No log	0.1071	6	1.1918	0.0255	1.1918	1.0917
No log	0.1429	8	0.8041	0.0823	0.8041	0.8967
No log	0.1786	10	0.7694	0.0647	0.7694	0.8771
No log	0.2143	12	0.7437	-0.1200	0.7437	0.8624
No log	0.25	14	0.8116	-0.0945	0.8116	0.9009
No log	0.2857	16	0.8989	0.0569	0.8989	0.9481
No log	0.3214	18	0.9873	0.0078	0.9873	0.9936
No log	0.3571	20	0.8649	-0.0333	0.8649	0.9300
No log	0.3929	22	0.6660	0.0638	0.6660	0.8161
No log	0.4286	24	0.6432	0.1407	0.6432	0.8020
No log	0.4643	26	0.6302	0.1206	0.6302	0.7939
No log	0.5	28	0.6194	0.1667	0.6194	0.7870
No log	0.5357	30	0.6390	0.0	0.6390	0.7994
No log	0.5714	32	0.6491	0.0303	0.6491	0.8057
No log	0.6071	34	0.7073	0.1020	0.7073	0.8410
No log	0.6429	36	0.7368	0.0692	0.7368	0.8584
No log	0.6786	38	0.6913	0.0692	0.6913	0.8315
No log	0.7143	40	0.6175	0.0303	0.6175	0.7858
No log	0.75	42	0.5912	0.0388	0.5912	0.7689
No log	0.7857	44	0.5769	0.1111	0.5769	0.7595
No log	0.8214	46	0.5790	0.0569	0.5790	0.7609
No log	0.8571	48	0.7112	0.0	0.7112	0.8433
No log	0.8929	50	0.6433	0.0	0.6433	0.8021
No log	0.9286	52	0.6023	0.1111	0.6023	0.7761
No log	0.9643	54	0.6402	0.1373	0.6402	0.8001
No log	1.0	56	0.6284	0.1667	0.6284	0.7927
No log	1.0357	58	0.6263	0.0725	0.6263	0.7914
No log	1.0714	60	0.6345	0.0	0.6345	0.7966
No log	1.1071	62	0.6146	0.1008	0.6146	0.7840
No log	1.1429	64	0.7007	0.1398	0.7007	0.8371
No log	1.1786	66	0.7231	0.2258	0.7231	0.8504
No log	1.2143	68	0.6249	0.1233	0.6249	0.7905
No log	1.25	70	0.8514	0.1053	0.8514	0.9227
No log	1.2857	72	0.8594	0.0476	0.8594	0.9271
No log	1.3214	74	0.6549	0.0588	0.6549	0.8092
No log	1.3571	76	0.5816	0.1795	0.5816	0.7626
No log	1.3929	78	0.6067	0.2189	0.6067	0.7789
No log	1.4286	80	0.6521	0.1698	0.6521	0.8075
No log	1.4643	82	0.7460	0.1351	0.7460	0.8637
No log	1.5	84	0.7538	0.1111	0.7538	0.8682
No log	1.5357	86	0.7030	0.0210	0.7030	0.8384
No log	1.5714	88	0.7371	0.1020	0.7371	0.8585
No log	1.6071	90	0.7596	0.1617	0.7596	0.8715
No log	1.6429	92	0.8298	0.1832	0.8298	0.9109
No log	1.6786	94	0.8780	0.2239	0.8780	0.9370
No log	1.7143	96	0.8739	0.0435	0.8739	0.9348
No log	1.75	98	0.8604	0.0270	0.8604	0.9276
No log	1.7857	100	0.8876	0.0103	0.8876	0.9421
No log	1.8214	102	0.9591	-0.0467	0.9591	0.9793
No log	1.8571	104	0.9779	-0.0046	0.9779	0.9889
No log	1.8929	106	0.9508	-0.0046	0.9508	0.9751
No log	1.9286	108	0.8337	0.0707	0.8337	0.9131
No log	1.9643	110	0.8522	-0.0653	0.8522	0.9231
No log	2.0	112	0.8531	0.0654	0.8531	0.9236
No log	2.0357	114	0.8319	0.1373	0.8319	0.9121
No log	2.0714	116	0.8281	0.1373	0.8281	0.9100
No log	2.1071	118	0.7256	0.1083	0.7256	0.8518
No log	2.1429	120	0.7106	0.0617	0.7106	0.8430
No log	2.1786	122	0.8194	0.1133	0.8194	0.9052
No log	2.2143	124	0.8463	0.0400	0.8463	0.9200
No log	2.25	126	0.8357	0.0	0.8357	0.9142
No log	2.2857	128	0.8002	0.0196	0.8002	0.8945
No log	2.3214	130	0.9638	0.0130	0.9638	0.9817
No log	2.3571	132	1.1347	0.0621	1.1347	1.0652
No log	2.3929	134	1.0604	0.125	1.0604	1.0298
No log	2.4286	136	0.7965	0.1489	0.7965	0.8925
No log	2.4643	138	0.7956	0.1600	0.7956	0.8920
No log	2.5	140	0.7704	0.1414	0.7704	0.8777
No log	2.5357	142	1.1110	0.1111	1.1110	1.0540
No log	2.5714	144	1.2042	0.0915	1.2042	1.0974
No log	2.6071	146	0.9557	0.1020	0.9557	0.9776
No log	2.6429	148	0.6989	0.1746	0.6989	0.8360
No log	2.6786	150	0.6783	0.1828	0.6783	0.8236
No log	2.7143	152	0.8345	0.2381	0.8345	0.9135
No log	2.75	154	1.0419	0.0745	1.0419	1.0208
No log	2.7857	156	0.9801	0.1644	0.9801	0.9900
No log	2.8214	158	0.7295	0.1086	0.7295	0.8541
No log	2.8571	160	0.6700	0.2251	0.6700	0.8185
No log	2.8929	162	0.7702	0.1256	0.7702	0.8776
No log	2.9286	164	0.6437	0.2195	0.6437	0.8023
No log	2.9643	166	0.6538	0.1138	0.6538	0.8086
No log	3.0	168	0.7001	0.1264	0.7001	0.8367
No log	3.0357	170	0.6895	0.0769	0.6895	0.8303
No log	3.0714	172	0.7123	0.0391	0.7123	0.8440
No log	3.1071	174	0.7085	0.0870	0.7085	0.8417
No log	3.1429	176	0.8652	0.2000	0.8652	0.9301
No log	3.1786	178	0.8837	0.1256	0.8837	0.9401
No log	3.2143	180	0.7718	0.1919	0.7718	0.8785
No log	3.25	182	0.6039	0.0920	0.6039	0.7771
No log	3.2857	184	0.6085	0.2663	0.6085	0.7801
No log	3.3214	186	0.5939	0.1373	0.5939	0.7707
No log	3.3571	188	0.7330	0.1515	0.7330	0.8562
No log	3.3929	190	0.9187	0.2000	0.9187	0.9585
No log	3.4286	192	0.8816	0.2000	0.8816	0.9390
No log	3.4643	194	0.7152	0.1233	0.7152	0.8457
No log	3.5	196	0.6117	0.1392	0.6117	0.7821
No log	3.5357	198	0.6922	0.0983	0.6922	0.8320
No log	3.5714	200	0.6377	0.1500	0.6377	0.7985
No log	3.6071	202	0.7099	0.2179	0.7099	0.8426
No log	3.6429	204	0.8326	0.1456	0.8326	0.9125
No log	3.6786	206	0.9454	0.1000	0.9454	0.9723
No log	3.7143	208	0.9228	0.1864	0.9228	0.9606
No log	3.75	210	0.7509	0.0457	0.7509	0.8666
No log	3.7857	212	0.6918	0.1828	0.6918	0.8317
No log	3.8214	214	0.7081	0.1158	0.7081	0.8415
No log	3.8571	216	0.8276	0.1402	0.8276	0.9097
No log	3.8929	218	0.9175	0.1852	0.9175	0.9579
No log	3.9286	220	0.9368	0.1781	0.9368	0.9679
No log	3.9643	222	0.8273	0.1179	0.8273	0.9096
No log	4.0	224	0.8276	0.1111	0.8276	0.9097
No log	4.0357	226	0.9316	0.1538	0.9316	0.9652
No log	4.0714	228	1.2877	0.0173	1.2877	1.1347
No log	4.1071	230	1.5725	-0.0265	1.5725	1.2540
No log	4.1429	232	1.5110	0.0596	1.5110	1.2292
No log	4.1786	234	1.1620	0.0909	1.1620	1.0779
No log	4.2143	236	0.8839	0.1245	0.8839	0.9402
No log	4.25	238	0.8498	0.0769	0.8498	0.9219
No log	4.2857	240	0.8167	0.2000	0.8167	0.9037
No log	4.3214	242	0.9185	0.1429	0.9185	0.9584
No log	4.3571	244	1.0549	0.1562	1.0549	1.0271
No log	4.3929	246	0.9862	0.1545	0.9862	0.9931
No log	4.4286	248	0.7384	0.1658	0.7384	0.8593
No log	4.4643	250	0.6921	0.1163	0.6921	0.8319
No log	4.5	252	0.7182	0.1461	0.7182	0.8474
No log	4.5357	254	0.6621	0.1243	0.6621	0.8137
No log	4.5714	256	0.7309	0.1739	0.7309	0.8549
No log	4.6071	258	0.8366	0.1848	0.8366	0.9147
No log	4.6429	260	0.8631	0.1855	0.8631	0.9290
No log	4.6786	262	0.7615	0.1340	0.7615	0.8726
No log	4.7143	264	0.7019	0.1323	0.7019	0.8378
No log	4.75	266	0.7163	0.1323	0.7163	0.8464
No log	4.7857	268	0.8337	0.2442	0.8337	0.9131
No log	4.8214	270	1.0329	0.1545	1.0329	1.0163
No log	4.8571	272	1.0465	0.1554	1.0465	1.0230
No log	4.8929	274	0.8456	0.2143	0.8456	0.9195
No log	4.9286	276	0.6652	0.2340	0.6652	0.8156
No log	4.9643	278	0.6369	0.2410	0.6369	0.7981
No log	5.0	280	0.6312	0.25	0.6312	0.7945
No log	5.0357	282	0.7191	0.2161	0.7191	0.8480
No log	5.0714	284	0.8646	0.1848	0.8646	0.9298
No log	5.1071	286	0.8830	0.1852	0.8830	0.9397
No log	5.1429	288	0.7372	0.1841	0.7372	0.8586
No log	5.1786	290	0.6101	0.3161	0.6101	0.7811
No log	5.2143	292	0.6113	0.3161	0.6113	0.7819
No log	5.25	294	0.7179	0.2161	0.7179	0.8473
No log	5.2857	296	0.7995	0.2153	0.7995	0.8942
No log	5.3214	298	0.8282	0.2153	0.8282	0.9101
No log	5.3571	300	0.8217	0.2153	0.8217	0.9065
No log	5.3929	302	0.8252	0.2153	0.8252	0.9084
No log	5.4286	304	0.7775	0.2079	0.7775	0.8818
No log	5.4643	306	0.7440	0.2079	0.7440	0.8625
No log	5.5	308	0.7605	0.2464	0.7605	0.8720
No log	5.5357	310	0.8135	0.2442	0.8135	0.9019
No log	5.5714	312	0.9159	0.2389	0.9159	0.9570
No log	5.6071	314	0.9608	0.1803	0.9608	0.9802
No log	5.6429	316	1.0219	0.0977	1.0219	1.0109
No log	5.6786	318	1.0025	0.1496	1.0025	1.0013
No log	5.7143	320	0.9798	0.1475	0.9798	0.9899
No log	5.75	322	0.8948	0.2140	0.8948	0.9459
No log	5.7857	324	0.8887	0.2140	0.8887	0.9427
No log	5.8214	326	0.9689	0.1475	0.9689	0.9843
No log	5.8571	328	1.0351	0.125	1.0351	1.0174
No log	5.8929	330	1.0597	0.1264	1.0597	1.0294
No log	5.9286	332	1.0376	0.1165	1.0376	1.0186
No log	5.9643	334	0.9401	0.1475	0.9401	0.9696
No log	6.0	336	0.8706	0.2146	0.8706	0.9331
No log	6.0357	338	0.8191	0.2075	0.8191	0.9050
No log	6.0714	340	0.7393	0.1600	0.7393	0.8598
No log	6.1071	342	0.7486	0.1220	0.7486	0.8652
No log	6.1429	344	0.8672	0.2070	0.8672	0.9313
No log	6.1786	346	1.0942	0.1880	1.0942	1.0460
No log	6.2143	348	1.1666	0.1615	1.1666	1.0801
No log	6.25	350	1.0474	0.1880	1.0474	1.0234
No log	6.2857	352	0.8612	0.2066	0.8612	0.9280
No log	6.3214	354	0.7450	0.2676	0.7450	0.8632
No log	6.3571	356	0.6891	0.2637	0.6891	0.8301
No log	6.3929	358	0.6893	0.3077	0.6893	0.8302
No log	6.4286	360	0.7226	0.3237	0.7226	0.8501
No log	6.4643	362	0.7215	0.2871	0.7215	0.8494
No log	6.5	364	0.7182	0.2871	0.7182	0.8475
No log	6.5357	366	0.6459	0.3010	0.6459	0.8037
No log	6.5714	368	0.6399	0.3508	0.6399	0.7999
No log	6.6071	370	0.6974	0.2871	0.6974	0.8351
No log	6.6429	372	0.8239	0.2217	0.8239	0.9077
No log	6.6786	374	0.8780	0.2217	0.8780	0.9370
No log	6.7143	376	0.7839	0.2233	0.7839	0.8854
No log	6.75	378	0.7361	0.2549	0.7361	0.8579
No log	6.7857	380	0.7064	0.2549	0.7064	0.8405
No log	6.8214	382	0.6727	0.2000	0.6727	0.8202
No log	6.8571	384	0.6975	0.3237	0.6975	0.8352
No log	6.8929	386	0.7554	0.2233	0.7554	0.8692
No log	6.9286	388	0.8747	0.2217	0.8747	0.9353
No log	6.9643	390	0.9185	0.2287	0.9185	0.9584
No log	7.0	392	0.9041	0.2217	0.9041	0.9509
No log	7.0357	394	0.7784	0.2607	0.7784	0.8823
No log	7.0714	396	0.6593	0.2821	0.6593	0.8120
No log	7.1071	398	0.6487	0.2821	0.6487	0.8054
No log	7.1429	400	0.6956	0.3143	0.6956	0.8341
No log	7.1786	402	0.8074	0.2607	0.8074	0.8986
No log	7.2143	404	0.9190	0.1858	0.9190	0.9586
No log	7.25	406	1.0104	0.1008	1.0104	1.0052
No log	7.2857	408	1.0196	0.0958	1.0196	1.0097
No log	7.3214	410	0.8990	0.1464	0.8990	0.9481
No log	7.3571	412	0.7515	0.2744	0.7515	0.8669
No log	7.3929	414	0.6847	0.2323	0.6847	0.8274
No log	7.4286	416	0.6727	0.3439	0.6727	0.8202
No log	7.4643	418	0.6856	0.2323	0.6856	0.8280
No log	7.5	420	0.7906	0.3180	0.7906	0.8892
No log	7.5357	422	0.9613	0.1799	0.9613	0.9805
No log	7.5714	424	1.1339	0.0857	1.1339	1.0648
No log	7.6071	426	1.1680	-0.0169	1.1680	1.0807
No log	7.6429	428	1.1020	0.0491	1.1020	1.0498
No log	7.6786	430	0.9756	0.1464	0.9756	0.9877
No log	7.7143	432	0.8209	0.2153	0.8209	0.9060
No log	7.75	434	0.7135	0.2000	0.7135	0.8447
No log	7.7857	436	0.6804	0.3118	0.6804	0.8248
No log	7.8214	438	0.6743	0.3089	0.6743	0.8212
No log	7.8571	440	0.6922	0.2421	0.6922	0.8320
No log	7.8929	442	0.7396	0.2079	0.7396	0.8600
No log	7.9286	444	0.8115	0.2153	0.8115	0.9008
No log	7.9643	446	0.8288	0.2150	0.8288	0.9104
No log	8.0	448	0.8182	0.2153	0.8182	0.9045
No log	8.0357	450	0.8441	0.2150	0.8441	0.9187
No log	8.0714	452	0.8268	0.2153	0.8268	0.9093
No log	8.1071	454	0.8057	0.2153	0.8057	0.8976
No log	8.1429	456	0.7919	0.2464	0.7919	0.8899
No log	8.1786	458	0.8041	0.2464	0.8041	0.8967
No log	8.2143	460	0.8071	0.2464	0.8071	0.8984
No log	8.25	462	0.8013	0.2464	0.8013	0.8951
No log	8.2857	464	0.8096	0.2464	0.8096	0.8998
No log	8.3214	466	0.8463	0.3180	0.8463	0.9199
No log	8.3571	468	0.8590	0.3180	0.8590	0.9268
No log	8.3929	470	0.8714	0.2146	0.8714	0.9335
No log	8.4286	472	0.8671	0.2523	0.8671	0.9312
No log	8.4643	474	0.8746	0.2523	0.8746	0.9352
No log	8.5	476	0.8790	0.2523	0.8790	0.9375
No log	8.5357	478	0.8833	0.2523	0.8833	0.9398
No log	8.5714	480	0.8561	0.2523	0.8561	0.9253
No log	8.6071	482	0.8192	0.2464	0.8192	0.9051
No log	8.6429	484	0.8134	0.2464	0.8134	0.9019
No log	8.6786	486	0.7909	0.2464	0.7909	0.8893
No log	8.7143	488	0.7731	0.2079	0.7731	0.8793
No log	8.75	490	0.7608	0.2079	0.7608	0.8723
No log	8.7857	492	0.7581	0.2079	0.7581	0.8707
No log	8.8214	494	0.7671	0.2079	0.7671	0.8759
No log	8.8571	496	0.7813	0.1765	0.7813	0.8839
No log	8.8929	498	0.7794	0.1765	0.7794	0.8829
0.4281	8.9286	500	0.8024	0.1765	0.8024	0.8958
0.4281	8.9643	502	0.8188	0.2523	0.8188	0.9049
0.4281	9.0	504	0.8118	0.2153	0.8118	0.9010
0.4281	9.0357	506	0.7929	0.1765	0.7929	0.8904
0.4281	9.0714	508	0.7924	0.1765	0.7924	0.8902
0.4281	9.1071	510	0.8059	0.2523	0.8059	0.8977
0.4281	9.1429	512	0.8111	0.2523	0.8111	0.9006
0.4281	9.1786	514	0.8143	0.2523	0.8143	0.9024
0.4281	9.2143	516	0.8186	0.2523	0.8186	0.9048
0.4281	9.25	518	0.8198	0.2523	0.8198	0.9054
0.4281	9.2857	520	0.8123	0.2523	0.8123	0.9013
0.4281	9.3214	522	0.7942	0.1675	0.7942	0.8912
0.4281	9.3571	524	0.7684	0.1675	0.7684	0.8766
0.4281	9.3929	526	0.7542	0.1675	0.7542	0.8684
0.4281	9.4286	528	0.7562	0.1675	0.7562	0.8696
0.4281	9.4643	530	0.7654	0.1675	0.7654	0.8749
0.4281	9.5	532	0.7792	0.1675	0.7792	0.8827
0.4281	9.5357	534	0.7991	0.2464	0.7991	0.8939
0.4281	9.5714	536	0.8070	0.1765	0.8070	0.8983
0.4281	9.6071	538	0.8179	0.2523	0.8179	0.9044
0.4281	9.6429	540	0.8220	0.2523	0.8220	0.9066
0.4281	9.6786	542	0.8187	0.2523	0.8187	0.9048
0.4281	9.7143	544	0.8069	0.1765	0.8069	0.8983
0.4281	9.75	546	0.7973	0.2464	0.7973	0.8929
0.4281	9.7857	548	0.7906	0.2079	0.7906	0.8892
0.4281	9.8214	550	0.7835	0.1675	0.7835	0.8852
0.4281	9.8571	552	0.7779	0.1675	0.7779	0.8820
0.4281	9.8929	554	0.7712	0.1675	0.7712	0.8782
0.4281	9.9286	556	0.7666	0.1675	0.7666	0.8755
0.4281	9.9643	558	0.7643	0.1675	0.7643	0.8743
0.4281	10.0	560	0.7632	0.1675	0.7632	0.8736

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024