ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k12_task1_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k12_task1_organization

ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k12_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

41% of all-time downloads

All-time downloads

Public

Parameters

135M

1.1 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: dfa63950

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k12_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.6536
Qwk: 0.6989
Mse: 0.6536
Rmse: 0.8085

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0357	2	5.4132	-0.0125	5.4132	2.3266
No log	0.0714	4	3.3880	0.0424	3.3880	1.8407
No log	0.1071	6	2.4152	-0.0755	2.4152	1.5541
No log	0.1429	8	2.3292	-0.1033	2.3292	1.5262
No log	0.1786	10	1.4643	0.0879	1.4643	1.2101
No log	0.2143	12	1.2319	0.1629	1.2319	1.1099
No log	0.25	14	1.3863	0.0734	1.3863	1.1774
No log	0.2857	16	1.7077	-0.0820	1.7077	1.3068
No log	0.3214	18	1.8660	-0.0334	1.8660	1.3660
No log	0.3571	20	1.7020	-0.0754	1.7020	1.3046
No log	0.3929	22	1.5210	-0.0596	1.5210	1.2333
No log	0.4286	24	1.3263	0.1876	1.3263	1.1517
No log	0.4643	26	1.2385	0.1318	1.2385	1.1129
No log	0.5	28	1.2646	0.1819	1.2646	1.1246
No log	0.5357	30	1.2799	0.1828	1.2799	1.1313
No log	0.5714	32	1.3080	0.1994	1.3080	1.1437
No log	0.6071	34	1.5706	0.0555	1.5706	1.2532
No log	0.6429	36	1.8961	0.0789	1.8961	1.3770
No log	0.6786	38	2.0706	0.1064	2.0706	1.4389
No log	0.7143	40	2.1077	0.1114	2.1077	1.4518
No log	0.75	42	1.8250	0.0944	1.8250	1.3509
No log	0.7857	44	1.5046	0.0678	1.5046	1.2266
No log	0.8214	46	1.5455	0.0410	1.5455	1.2432
No log	0.8571	48	1.7644	0.0719	1.7644	1.3283
No log	0.8929	50	1.8309	0.0719	1.8309	1.3531
No log	0.9286	52	1.6539	0.0773	1.6539	1.2861
No log	0.9643	54	1.2517	0.2527	1.2517	1.1188
No log	1.0	56	1.1374	0.2109	1.1374	1.0665
No log	1.0357	58	1.1993	0.1973	1.1993	1.0951
No log	1.0714	60	1.1625	0.2812	1.1625	1.0782
No log	1.1071	62	1.2444	0.2051	1.2444	1.1155
No log	1.1429	64	1.4392	0.0800	1.4392	1.1997
No log	1.1786	66	1.5253	0.0240	1.5253	1.2350
No log	1.2143	68	1.5269	0.0240	1.5269	1.2357
No log	1.25	70	1.4089	0.0916	1.4089	1.1870
No log	1.2857	72	1.2837	0.1259	1.2837	1.1330
No log	1.3214	74	1.1589	0.2807	1.1589	1.0765
No log	1.3571	76	1.1292	0.3015	1.1292	1.0626
No log	1.3929	78	1.1060	0.3219	1.1060	1.0517
No log	1.4286	80	1.0880	0.3127	1.0880	1.0431
No log	1.4643	82	1.1081	0.3322	1.1081	1.0527
No log	1.5	84	1.2148	0.2433	1.2148	1.1022
No log	1.5357	86	1.2539	0.2630	1.2539	1.1198
No log	1.5714	88	1.1387	0.2946	1.1387	1.0671
No log	1.6071	90	0.9907	0.3419	0.9907	0.9954
No log	1.6429	92	1.0211	0.3272	1.0211	1.0105
No log	1.6786	94	1.0049	0.3419	1.0049	1.0024
No log	1.7143	96	0.9496	0.3491	0.9496	0.9745
No log	1.75	98	0.9364	0.3810	0.9364	0.9677
No log	1.7857	100	0.9146	0.3849	0.9146	0.9564
No log	1.8214	102	0.8933	0.3870	0.8933	0.9452
No log	1.8571	104	0.8433	0.4738	0.8433	0.9183
No log	1.8929	106	0.8645	0.5466	0.8645	0.9298
No log	1.9286	108	0.9108	0.5886	0.9108	0.9543
No log	1.9643	110	0.9789	0.5674	0.9789	0.9894
No log	2.0	112	0.8224	0.5825	0.8224	0.9069
No log	2.0357	114	0.7760	0.6209	0.7760	0.8809
No log	2.0714	116	0.8182	0.5924	0.8182	0.9045
No log	2.1071	118	0.8465	0.6428	0.8465	0.9201
No log	2.1429	120	0.6979	0.6823	0.6979	0.8354
No log	2.1786	122	0.7528	0.6830	0.7528	0.8677
No log	2.2143	124	0.7481	0.6837	0.7481	0.8649
No log	2.25	126	0.7755	0.6744	0.7755	0.8806
No log	2.2857	128	0.8733	0.6151	0.8733	0.9345
No log	2.3214	130	0.7933	0.6666	0.7933	0.8907
No log	2.3571	132	0.6996	0.6609	0.6996	0.8364
No log	2.3929	134	0.7036	0.6352	0.7036	0.8388
No log	2.4286	136	0.8077	0.5843	0.8077	0.8987
No log	2.4643	138	0.8481	0.5861	0.8481	0.9209
No log	2.5	140	0.7608	0.5833	0.7608	0.8722
No log	2.5357	142	0.8181	0.5107	0.8181	0.9045
No log	2.5714	144	0.7984	0.5297	0.7984	0.8935
No log	2.6071	146	0.7382	0.6168	0.7382	0.8592
No log	2.6429	148	0.7640	0.5900	0.7640	0.8741
No log	2.6786	150	0.6888	0.6129	0.6888	0.8299
No log	2.7143	152	0.7219	0.6248	0.7219	0.8496
No log	2.75	154	0.7254	0.5996	0.7254	0.8517
No log	2.7857	156	0.6838	0.6588	0.6838	0.8269
No log	2.8214	158	0.6745	0.6382	0.6745	0.8213
No log	2.8571	160	0.7464	0.6460	0.7464	0.8639
No log	2.8929	162	0.7228	0.6509	0.7228	0.8502
No log	2.9286	164	0.7048	0.6692	0.7048	0.8395
No log	2.9643	166	0.6457	0.7047	0.6457	0.8036
No log	3.0	168	0.6462	0.7070	0.6462	0.8039
No log	3.0357	170	0.6361	0.6950	0.6361	0.7975
No log	3.0714	172	0.6476	0.7084	0.6476	0.8047
No log	3.1071	174	0.7504	0.6689	0.7504	0.8663
No log	3.1429	176	0.7657	0.6546	0.7657	0.8751
No log	3.1786	178	0.6884	0.6871	0.6884	0.8297
No log	3.2143	180	0.6497	0.7156	0.6497	0.8061
No log	3.25	182	0.6543	0.7102	0.6543	0.8089
No log	3.2857	184	0.7080	0.6653	0.7080	0.8414
No log	3.3214	186	0.7322	0.6121	0.7322	0.8557
No log	3.3571	188	0.6916	0.6671	0.6916	0.8316
No log	3.3929	190	0.6408	0.7077	0.6408	0.8005
No log	3.4286	192	0.6388	0.7200	0.6388	0.7993
No log	3.4643	194	0.6552	0.7033	0.6552	0.8095
No log	3.5	196	0.6364	0.7359	0.6364	0.7978
No log	3.5357	198	0.7032	0.7042	0.7032	0.8386
No log	3.5714	200	0.7383	0.6405	0.7383	0.8593
No log	3.6071	202	0.6639	0.7248	0.6639	0.8148
No log	3.6429	204	0.6301	0.6946	0.6301	0.7938
No log	3.6786	206	0.6369	0.7076	0.6369	0.7981
No log	3.7143	208	0.7148	0.6618	0.7148	0.8455
No log	3.75	210	0.7103	0.6620	0.7103	0.8428
No log	3.7857	212	0.7060	0.6738	0.7060	0.8402
No log	3.8214	214	0.6687	0.6875	0.6687	0.8177
No log	3.8571	216	0.6581	0.6956	0.6581	0.8112
No log	3.8929	218	0.7133	0.6379	0.7133	0.8446
No log	3.9286	220	0.6865	0.7010	0.6865	0.8286
No log	3.9643	222	0.6894	0.6821	0.6894	0.8303
No log	4.0	224	0.6510	0.7218	0.6510	0.8068
No log	4.0357	226	0.6305	0.7161	0.6305	0.7940
No log	4.0714	228	0.6695	0.6983	0.6695	0.8182
No log	4.1071	230	0.7463	0.6304	0.7463	0.8639
No log	4.1429	232	0.6573	0.6876	0.6573	0.8107
No log	4.1786	234	0.5882	0.6936	0.5882	0.7669
No log	4.2143	236	0.6261	0.6953	0.6261	0.7913
No log	4.25	238	0.6211	0.7022	0.6211	0.7881
No log	4.2857	240	0.6000	0.7123	0.6000	0.7746
No log	4.3214	242	0.6977	0.7014	0.6977	0.8353
No log	4.3571	244	0.7166	0.6877	0.7166	0.8465
No log	4.3929	246	0.6481	0.6911	0.6481	0.8050
No log	4.4286	248	0.6793	0.6923	0.6793	0.8242
No log	4.4643	250	0.8178	0.5597	0.8178	0.9043
No log	4.5	252	0.8440	0.5576	0.8440	0.9187
No log	4.5357	254	0.7502	0.6260	0.7502	0.8661
No log	4.5714	256	0.6731	0.6699	0.6731	0.8204
No log	4.6071	258	0.6613	0.6823	0.6613	0.8132
No log	4.6429	260	0.6640	0.6872	0.6640	0.8149
No log	4.6786	262	0.6606	0.6934	0.6606	0.8128
No log	4.7143	264	0.6842	0.6526	0.6842	0.8271
No log	4.75	266	0.6879	0.6547	0.6879	0.8294
No log	4.7857	268	0.6535	0.7188	0.6535	0.8084
No log	4.8214	270	0.6486	0.7026	0.6486	0.8054
No log	4.8571	272	0.6602	0.7172	0.6602	0.8125
No log	4.8929	274	0.6577	0.6985	0.6577	0.8110
No log	4.9286	276	0.6607	0.6950	0.6607	0.8128
No log	4.9643	278	0.6847	0.6708	0.6847	0.8275
No log	5.0	280	0.6940	0.6463	0.6940	0.8331
No log	5.0357	282	0.6650	0.6732	0.6650	0.8155
No log	5.0714	284	0.7020	0.6259	0.7020	0.8378
No log	5.1071	286	0.7401	0.5778	0.7401	0.8603
No log	5.1429	288	0.6995	0.6347	0.6995	0.8364
No log	5.1786	290	0.6665	0.6246	0.6665	0.8164
No log	5.2143	292	0.7390	0.5948	0.7390	0.8596
No log	5.25	294	0.8055	0.6074	0.8055	0.8975
No log	5.2857	296	0.7474	0.6102	0.7474	0.8645
No log	5.3214	298	0.6816	0.6450	0.6816	0.8256
No log	5.3571	300	0.7283	0.6042	0.7283	0.8534
No log	5.3929	302	0.8117	0.5611	0.8117	0.9010
No log	5.4286	304	0.8114	0.5611	0.8114	0.9008
No log	5.4643	306	0.7312	0.5994	0.7312	0.8551
No log	5.5	308	0.6988	0.6236	0.6988	0.8360
No log	5.5357	310	0.6939	0.6331	0.6939	0.8330
No log	5.5714	312	0.6968	0.6499	0.6968	0.8347
No log	5.6071	314	0.6881	0.6688	0.6881	0.8295
No log	5.6429	316	0.7025	0.6631	0.7025	0.8382
No log	5.6786	318	0.6923	0.6796	0.6923	0.8321
No log	5.7143	320	0.6855	0.6926	0.6855	0.8280
No log	5.75	322	0.7157	0.6532	0.7157	0.8460
No log	5.7857	324	0.7326	0.6470	0.7326	0.8559
No log	5.8214	326	0.7108	0.6553	0.7108	0.8431
No log	5.8571	328	0.6686	0.7081	0.6686	0.8177
No log	5.8929	330	0.6610	0.7495	0.6610	0.8130
No log	5.9286	332	0.6636	0.7351	0.6636	0.8146
No log	5.9643	334	0.6576	0.7288	0.6576	0.8109
No log	6.0	336	0.7083	0.6737	0.7083	0.8416
No log	6.0357	338	0.7569	0.6495	0.7569	0.8700
No log	6.0714	340	0.7333	0.6258	0.7333	0.8563
No log	6.1071	342	0.6719	0.6864	0.6719	0.8197
No log	6.1429	344	0.6428	0.7120	0.6428	0.8017
No log	6.1786	346	0.6404	0.6958	0.6404	0.8003
No log	6.2143	348	0.6296	0.7165	0.6296	0.7935
No log	6.25	350	0.6226	0.7300	0.6226	0.7890
No log	6.2857	352	0.6212	0.7623	0.6212	0.7882
No log	6.3214	354	0.6272	0.7632	0.6272	0.7920
No log	6.3571	356	0.6364	0.7632	0.6364	0.7978
No log	6.3929	358	0.6445	0.7588	0.6445	0.8028
No log	6.4286	360	0.6478	0.7588	0.6478	0.8049
No log	6.4643	362	0.6521	0.7534	0.6521	0.8075
No log	6.5	364	0.6609	0.7648	0.6609	0.8129
No log	6.5357	366	0.6566	0.7492	0.6566	0.8103
No log	6.5714	368	0.6547	0.7447	0.6547	0.8091
No log	6.6071	370	0.6535	0.7378	0.6535	0.8084
No log	6.6429	372	0.6551	0.7321	0.6551	0.8094
No log	6.6786	374	0.6545	0.7215	0.6545	0.8090
No log	6.7143	376	0.6404	0.7212	0.6404	0.8002
No log	6.75	378	0.6264	0.7154	0.6264	0.7914
No log	6.7857	380	0.6248	0.7391	0.6248	0.7904
No log	6.8214	382	0.6174	0.7312	0.6174	0.7857
No log	6.8571	384	0.6083	0.7498	0.6083	0.7799
No log	6.8929	386	0.5981	0.7481	0.5981	0.7733
No log	6.9286	388	0.6012	0.7500	0.6012	0.7754
No log	6.9643	390	0.6279	0.7061	0.6279	0.7924
No log	7.0	392	0.6377	0.7120	0.6377	0.7986
No log	7.0357	394	0.6204	0.7213	0.6204	0.7877
No log	7.0714	396	0.6026	0.7482	0.6026	0.7763
No log	7.1071	398	0.5920	0.7643	0.5920	0.7694
No log	7.1429	400	0.6126	0.75	0.6126	0.7827
No log	7.1786	402	0.6261	0.75	0.6261	0.7913
No log	7.2143	404	0.6158	0.7654	0.6158	0.7847
No log	7.25	406	0.6157	0.7497	0.6157	0.7847
No log	7.2857	408	0.6457	0.7148	0.6457	0.8036
No log	7.3214	410	0.6760	0.6998	0.6760	0.8222
No log	7.3571	412	0.7252	0.6711	0.7252	0.8516
No log	7.3929	414	0.7265	0.6711	0.7265	0.8523
No log	7.4286	416	0.7057	0.6924	0.7057	0.8401
No log	7.4643	418	0.6716	0.6912	0.6716	0.8195
No log	7.5	420	0.6507	0.7233	0.6507	0.8067
No log	7.5357	422	0.6406	0.7447	0.6406	0.8004
No log	7.5714	424	0.6387	0.7497	0.6387	0.7992
No log	7.6071	426	0.6410	0.7447	0.6410	0.8007
No log	7.6429	428	0.6491	0.7233	0.6491	0.8057
No log	7.6786	430	0.6522	0.7189	0.6522	0.8076
No log	7.7143	432	0.6496	0.7189	0.6496	0.8060
No log	7.75	434	0.6390	0.7315	0.6390	0.7994
No log	7.7857	436	0.6322	0.7485	0.6322	0.7951
No log	7.8214	438	0.6288	0.7410	0.6288	0.7930
No log	7.8571	440	0.6273	0.7410	0.6273	0.7920
No log	7.8929	442	0.6309	0.7315	0.6309	0.7943
No log	7.9286	444	0.6360	0.7203	0.6360	0.7975
No log	7.9643	446	0.6325	0.7224	0.6325	0.7953
No log	8.0	448	0.6262	0.7404	0.6262	0.7913
No log	8.0357	450	0.6253	0.7404	0.6253	0.7908
No log	8.0714	452	0.6261	0.7246	0.6261	0.7912
No log	8.1071	454	0.6277	0.7201	0.6277	0.7923
No log	8.1429	456	0.6268	0.7275	0.6268	0.7917
No log	8.1786	458	0.6326	0.7216	0.6326	0.7954
No log	8.2143	460	0.6357	0.7240	0.6357	0.7973
No log	8.25	462	0.6317	0.7372	0.6317	0.7948
No log	8.2857	464	0.6325	0.7316	0.6325	0.7953
No log	8.3214	466	0.6387	0.7227	0.6387	0.7992
No log	8.3571	468	0.6382	0.7329	0.6382	0.7988
No log	8.3929	470	0.6338	0.7271	0.6338	0.7961
No log	8.4286	472	0.6341	0.7372	0.6341	0.7963
No log	8.4643	474	0.6481	0.7148	0.6481	0.8050
No log	8.5	476	0.6724	0.6924	0.6724	0.8200
No log	8.5357	478	0.6994	0.6571	0.6994	0.8363
No log	8.5714	480	0.7263	0.6484	0.7263	0.8522
No log	8.6071	482	0.7267	0.6484	0.7267	0.8525
No log	8.6429	484	0.7080	0.6537	0.7080	0.8414
No log	8.6786	486	0.6842	0.6692	0.6842	0.8271
No log	8.7143	488	0.6605	0.7015	0.6605	0.8127
No log	8.75	490	0.6465	0.7247	0.6465	0.8041
No log	8.7857	492	0.6405	0.7292	0.6405	0.8003
No log	8.8214	494	0.6354	0.7426	0.6354	0.7971
No log	8.8571	496	0.6336	0.7404	0.6336	0.7960
No log	8.8929	498	0.6359	0.7247	0.6359	0.7974
0.509	8.9286	500	0.6436	0.7218	0.6436	0.8023
0.509	8.9643	502	0.6567	0.7029	0.6567	0.8104
0.509	9.0	504	0.6692	0.6737	0.6692	0.8180
0.509	9.0357	506	0.6781	0.6562	0.6781	0.8235
0.509	9.0714	508	0.6846	0.6600	0.6846	0.8274
0.509	9.1071	510	0.6798	0.6608	0.6798	0.8245
0.509	9.1429	512	0.6755	0.6608	0.6755	0.8219
0.509	9.1786	514	0.6672	0.6727	0.6672	0.8168
0.509	9.2143	516	0.6593	0.7015	0.6593	0.8120
0.509	9.25	518	0.6500	0.7106	0.6500	0.8062
0.509	9.2857	520	0.6402	0.7247	0.6402	0.8001
0.509	9.3214	522	0.6345	0.7247	0.6345	0.7966
0.509	9.3571	524	0.6307	0.7337	0.6307	0.7942
0.509	9.3929	526	0.6294	0.7337	0.6294	0.7934
0.509	9.4286	528	0.6314	0.7247	0.6314	0.7946
0.509	9.4643	530	0.6343	0.7247	0.6343	0.7964
0.509	9.5	532	0.6372	0.7247	0.6372	0.7982
0.509	9.5357	534	0.6408	0.7226	0.6408	0.8005
0.509	9.5714	536	0.6459	0.7092	0.6459	0.8037
0.509	9.6071	538	0.6501	0.6989	0.6501	0.8063
0.509	9.6429	540	0.6533	0.7002	0.6533	0.8082
0.509	9.6786	542	0.6542	0.7002	0.6542	0.8088
0.509	9.7143	544	0.6546	0.7002	0.6546	0.8091
0.509	9.75	546	0.6536	0.6989	0.6536	0.8085
0.509	9.7857	548	0.6521	0.6989	0.6521	0.8075
0.509	9.8214	550	0.6524	0.6989	0.6524	0.8077
0.509	9.8571	552	0.6526	0.6989	0.6526	0.8079
0.509	9.8929	554	0.6531	0.6989	0.6531	0.8081
0.509	9.9286	556	0.6532	0.6989	0.6532	0.8082
0.509	9.9643	558	0.6536	0.6989	0.6536	0.8084
0.509	10.0	560	0.6536	0.6989	0.6536	0.8085

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024