ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k14_task3_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k14_task3_organization

ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k14_task3_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

43% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: 0428fb5a

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k14_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.7642
Qwk: 0.1675
Mse: 0.7642
Rmse: 0.8742

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0357	2	3.5317	-0.0066	3.5317	1.8793
No log	0.0714	4	2.0296	-0.0390	2.0296	1.4247
No log	0.1071	6	1.1918	0.0255	1.1918	1.0917
No log	0.1429	8	0.8041	0.0823	0.8041	0.8967
No log	0.1786	10	0.7694	0.0647	0.7694	0.8771
No log	0.2143	12	0.7437	-0.1200	0.7437	0.8624
No log	0.25	14	0.8116	-0.0945	0.8116	0.9009
No log	0.2857	16	0.8989	0.0569	0.8989	0.9481
No log	0.3214	18	0.9873	0.0078	0.9873	0.9936
No log	0.3571	20	0.8649	-0.0333	0.8649	0.9300
No log	0.3929	22	0.6660	0.0638	0.6660	0.8161
No log	0.4286	24	0.6432	0.1407	0.6432	0.8020
No log	0.4643	26	0.6302	0.1206	0.6302	0.7939
No log	0.5	28	0.6194	0.1667	0.6194	0.7870
No log	0.5357	30	0.6390	0.0	0.6390	0.7994
No log	0.5714	32	0.6491	0.0303	0.6491	0.8057
No log	0.6071	34	0.7073	0.1020	0.7073	0.8410
No log	0.6429	36	0.7368	0.0692	0.7368	0.8584
No log	0.6786	38	0.6913	0.0692	0.6913	0.8315
No log	0.7143	40	0.6175	0.0303	0.6175	0.7858
No log	0.75	42	0.5912	0.0388	0.5912	0.7689
No log	0.7857	44	0.5769	0.1111	0.5769	0.7595
No log	0.8214	46	0.5790	0.0569	0.5790	0.7609
No log	0.8571	48	0.7112	0.0	0.7112	0.8433
No log	0.8929	50	0.6434	0.0	0.6434	0.8021
No log	0.9286	52	0.6023	0.1111	0.6023	0.7761
No log	0.9643	54	0.6402	0.1373	0.6402	0.8001
No log	1.0	56	0.6284	0.1667	0.6284	0.7927
No log	1.0357	58	0.6263	0.0725	0.6263	0.7914
No log	1.0714	60	0.6346	0.0	0.6346	0.7966
No log	1.1071	62	0.6146	0.1008	0.6146	0.7840
No log	1.1429	64	0.7008	0.1398	0.7008	0.8371
No log	1.1786	66	0.7232	0.2258	0.7232	0.8504
No log	1.2143	68	0.6249	0.1233	0.6249	0.7905
No log	1.25	70	0.8514	0.1053	0.8514	0.9227
No log	1.2857	72	0.8594	0.0476	0.8594	0.9271
No log	1.3214	74	0.6549	0.0588	0.6549	0.8092
No log	1.3571	76	0.5816	0.1795	0.5816	0.7626
No log	1.3929	78	0.6067	0.2189	0.6067	0.7789
No log	1.4286	80	0.6521	0.1698	0.6521	0.8075
No log	1.4643	82	0.7460	0.1351	0.7460	0.8637
No log	1.5	84	0.7538	0.1111	0.7538	0.8682
No log	1.5357	86	0.7029	0.0210	0.7029	0.8384
No log	1.5714	88	0.7371	0.1020	0.7371	0.8585
No log	1.6071	90	0.7596	0.1617	0.7596	0.8715
No log	1.6429	92	0.8298	0.1832	0.8298	0.9109
No log	1.6786	94	0.8780	0.2239	0.8780	0.9370
No log	1.7143	96	0.8740	0.0435	0.8740	0.9349
No log	1.75	98	0.8604	0.0270	0.8604	0.9276
No log	1.7857	100	0.8876	0.0103	0.8876	0.9421
No log	1.8214	102	0.9592	-0.0467	0.9592	0.9794
No log	1.8571	104	0.9780	-0.0046	0.9780	0.9889
No log	1.8929	106	0.9509	-0.0046	0.9509	0.9751
No log	1.9286	108	0.8338	0.0707	0.8338	0.9131
No log	1.9643	110	0.8523	-0.0653	0.8523	0.9232
No log	2.0	112	0.8532	0.0654	0.8532	0.9237
No log	2.0357	114	0.8319	0.1373	0.8319	0.9121
No log	2.0714	116	0.8281	0.1373	0.8281	0.9100
No log	2.1071	118	0.7257	0.1083	0.7257	0.8519
No log	2.1429	120	0.7106	0.0617	0.7106	0.8430
No log	2.1786	122	0.8195	0.1133	0.8195	0.9053
No log	2.2143	124	0.8465	0.0400	0.8465	0.9201
No log	2.25	126	0.8359	0.0	0.8359	0.9143
No log	2.2857	128	0.8002	0.0196	0.8002	0.8945
No log	2.3214	130	0.9636	0.0130	0.9636	0.9816
No log	2.3571	132	1.1346	0.0621	1.1346	1.0652
No log	2.3929	134	1.0605	0.125	1.0605	1.0298
No log	2.4286	136	0.7965	0.1489	0.7965	0.8925
No log	2.4643	138	0.7956	0.1600	0.7956	0.8920
No log	2.5	140	0.7704	0.1414	0.7704	0.8777
No log	2.5357	142	1.1105	0.1111	1.1105	1.0538
No log	2.5714	144	1.2037	0.0915	1.2037	1.0971
No log	2.6071	146	0.9554	0.1020	0.9554	0.9775
No log	2.6429	148	0.6989	0.1746	0.6989	0.8360
No log	2.6786	150	0.6785	0.1828	0.6785	0.8237
No log	2.7143	152	0.8350	0.2381	0.8350	0.9138
No log	2.75	154	1.0421	0.0745	1.0421	1.0208
No log	2.7857	156	0.9801	0.1644	0.9801	0.9900
No log	2.8214	158	0.7295	0.1086	0.7295	0.8541
No log	2.8571	160	0.6701	0.2251	0.6701	0.8186
No log	2.8929	162	0.7700	0.1256	0.7700	0.8775
No log	2.9286	164	0.6437	0.2195	0.6437	0.8023
No log	2.9643	166	0.6539	0.1138	0.6539	0.8087
No log	3.0	168	0.7004	0.1264	0.7004	0.8369
No log	3.0357	170	0.6896	0.0769	0.6896	0.8304
No log	3.0714	172	0.7124	0.0391	0.7124	0.8441
No log	3.1071	174	0.7086	0.0870	0.7086	0.8418
No log	3.1429	176	0.8652	0.2000	0.8652	0.9302
No log	3.1786	178	0.8838	0.1256	0.8838	0.9401
No log	3.2143	180	0.7721	0.1919	0.7721	0.8787
No log	3.25	182	0.6041	0.0920	0.6041	0.7772
No log	3.2857	184	0.6086	0.2663	0.6086	0.7801
No log	3.3214	186	0.5941	0.1373	0.5941	0.7708
No log	3.3571	188	0.7333	0.1515	0.7333	0.8563
No log	3.3929	190	0.9187	0.2000	0.9187	0.9585
No log	3.4286	192	0.8816	0.2000	0.8816	0.9390
No log	3.4643	194	0.7154	0.1233	0.7154	0.8458
No log	3.5	196	0.6117	0.1392	0.6117	0.7821
No log	3.5357	198	0.6921	0.0983	0.6921	0.8319
No log	3.5714	200	0.6377	0.1500	0.6377	0.7986
No log	3.6071	202	0.7102	0.2179	0.7102	0.8427
No log	3.6429	204	0.8331	0.1456	0.8331	0.9127
No log	3.6786	206	0.9457	0.1000	0.9457	0.9725
No log	3.7143	208	0.9230	0.1864	0.9230	0.9607
No log	3.75	210	0.7510	0.0457	0.7510	0.8666
No log	3.7857	212	0.6920	0.1828	0.6920	0.8319
No log	3.8214	214	0.7084	0.1158	0.7084	0.8417
No log	3.8571	216	0.8279	0.1402	0.8279	0.9099
No log	3.8929	218	0.9175	0.1852	0.9175	0.9579
No log	3.9286	220	0.9370	0.1781	0.9370	0.9680
No log	3.9643	222	0.8277	0.1179	0.8277	0.9098
No log	4.0	224	0.8280	0.1111	0.8280	0.9099
No log	4.0357	226	0.9321	0.1538	0.9321	0.9654
No log	4.0714	228	1.2876	0.0173	1.2876	1.1347
No log	4.1071	230	1.5728	-0.0265	1.5728	1.2541
No log	4.1429	232	1.5115	0.0596	1.5115	1.2294
No log	4.1786	234	1.1627	0.0909	1.1627	1.0783
No log	4.2143	236	0.8845	0.1245	0.8845	0.9405
No log	4.25	238	0.8500	0.0769	0.8500	0.9220
No log	4.2857	240	0.8175	0.2000	0.8175	0.9042
No log	4.3214	242	0.9185	0.1429	0.9185	0.9584
No log	4.3571	244	1.0546	0.1562	1.0546	1.0269
No log	4.3929	246	0.9857	0.1545	0.9857	0.9928
No log	4.4286	248	0.7380	0.1658	0.7380	0.8590
No log	4.4643	250	0.6922	0.1186	0.6922	0.8320
No log	4.5	252	0.7177	0.1461	0.7177	0.8472
No log	4.5357	254	0.6621	0.1243	0.6621	0.8137
No log	4.5714	256	0.7318	0.1739	0.7318	0.8554
No log	4.6071	258	0.8374	0.1848	0.8374	0.9151
No log	4.6429	260	0.8633	0.1855	0.8633	0.9292
No log	4.6786	262	0.7614	0.1340	0.7614	0.8726
No log	4.7143	264	0.7019	0.1323	0.7019	0.8378
No log	4.75	266	0.7163	0.1323	0.7163	0.8463
No log	4.7857	268	0.8340	0.2442	0.8340	0.9132
No log	4.8214	270	1.0338	0.1545	1.0338	1.0168
No log	4.8571	272	1.0476	0.1554	1.0476	1.0235
No log	4.8929	274	0.8464	0.2143	0.8464	0.9200
No log	4.9286	276	0.6655	0.2340	0.6655	0.8158
No log	4.9643	278	0.6371	0.2410	0.6371	0.7982
No log	5.0	280	0.6313	0.25	0.6313	0.7946
No log	5.0357	282	0.7192	0.2161	0.7192	0.8481
No log	5.0714	284	0.8654	0.1848	0.8654	0.9303
No log	5.1071	286	0.8845	0.1852	0.8845	0.9405
No log	5.1429	288	0.7388	0.1841	0.7388	0.8595
No log	5.1786	290	0.6107	0.3161	0.6107	0.7814
No log	5.2143	292	0.6117	0.3161	0.6117	0.7821
No log	5.25	294	0.7182	0.2161	0.7182	0.8475
No log	5.2857	296	0.7988	0.2153	0.7988	0.8938
No log	5.3214	298	0.8270	0.2153	0.8270	0.9094
No log	5.3571	300	0.8208	0.2153	0.8208	0.9060
No log	5.3929	302	0.8248	0.2153	0.8248	0.9082
No log	5.4286	304	0.7772	0.2079	0.7772	0.8816
No log	5.4643	306	0.7437	0.2079	0.7437	0.8624
No log	5.5	308	0.7603	0.2464	0.7603	0.8720
No log	5.5357	310	0.8132	0.2442	0.8132	0.9018
No log	5.5714	312	0.9151	0.2389	0.9151	0.9566
No log	5.6071	314	0.9603	0.1803	0.9603	0.9799
No log	5.6429	316	1.0215	0.0977	1.0215	1.0107
No log	5.6786	318	1.0019	0.1496	1.0019	1.0009
No log	5.7143	320	0.9794	0.1475	0.9794	0.9896
No log	5.75	322	0.8951	0.2140	0.8951	0.9461
No log	5.7857	324	0.8881	0.2140	0.8880	0.9424
No log	5.8214	326	0.9675	0.1475	0.9675	0.9836
No log	5.8571	328	1.0339	0.1235	1.0339	1.0168
No log	5.8929	330	1.0588	0.1264	1.0588	1.0290
No log	5.9286	332	1.0370	0.1148	1.0370	1.0183
No log	5.9643	334	0.9392	0.1475	0.9392	0.9691
No log	6.0	336	0.8691	0.2146	0.8691	0.9323
No log	6.0357	338	0.8178	0.2075	0.8178	0.9043
No log	6.0714	340	0.7389	0.1600	0.7389	0.8596
No log	6.1071	342	0.7489	0.1220	0.7489	0.8654
No log	6.1429	344	0.8680	0.2070	0.8680	0.9317
No log	6.1786	346	1.0947	0.1880	1.0947	1.0463
No log	6.2143	348	1.1643	0.1615	1.1643	1.0790
No log	6.25	350	1.0434	0.1880	1.0434	1.0214
No log	6.2857	352	0.8568	0.2066	0.8568	0.9256
No log	6.3214	354	0.7426	0.2676	0.7426	0.8617
No log	6.3571	356	0.6884	0.2637	0.6884	0.8297
No log	6.3929	358	0.6888	0.3077	0.6888	0.8300
No log	6.4286	360	0.7223	0.3237	0.7223	0.8499
No log	6.4643	362	0.7216	0.2871	0.7216	0.8495
No log	6.5	364	0.7184	0.2871	0.7184	0.8476
No log	6.5357	366	0.6455	0.3035	0.6455	0.8034
No log	6.5714	368	0.6391	0.3508	0.6391	0.7995
No log	6.6071	370	0.6959	0.2487	0.6959	0.8342
No log	6.6429	372	0.8217	0.2217	0.8217	0.9065
No log	6.6786	374	0.8765	0.2217	0.8765	0.9362
No log	6.7143	376	0.7833	0.2233	0.7833	0.8851
No log	6.75	378	0.7360	0.2549	0.7360	0.8579
No log	6.7857	380	0.7067	0.2549	0.7067	0.8407
No log	6.8214	382	0.6734	0.2000	0.6734	0.8206
No log	6.8571	384	0.6981	0.3237	0.6981	0.8355
No log	6.8929	386	0.7557	0.2233	0.7557	0.8693
No log	6.9286	388	0.8749	0.2217	0.8749	0.9354
No log	6.9643	390	0.9186	0.2294	0.9186	0.9585
No log	7.0	392	0.9042	0.2217	0.9042	0.9509
No log	7.0357	394	0.7784	0.2607	0.7784	0.8823
No log	7.0714	396	0.6593	0.2821	0.6593	0.8119
No log	7.1071	398	0.6488	0.2821	0.6488	0.8055
No log	7.1429	400	0.6961	0.3143	0.6961	0.8343
No log	7.1786	402	0.8086	0.2607	0.8086	0.8992
No log	7.2143	404	0.9207	0.1858	0.9207	0.9595
No log	7.25	406	1.0116	0.1008	1.0116	1.0058
No log	7.2857	408	1.0197	0.0958	1.0197	1.0098
No log	7.3214	410	0.8985	0.1464	0.8985	0.9479
No log	7.3571	412	0.7508	0.2744	0.7508	0.8665
No log	7.3929	414	0.6842	0.2323	0.6842	0.8272
No log	7.4286	416	0.6723	0.3439	0.6723	0.8200
No log	7.4643	418	0.6853	0.2323	0.6853	0.8278
No log	7.5	420	0.7905	0.3180	0.7905	0.8891
No log	7.5357	422	0.9616	0.1799	0.9616	0.9806
No log	7.5714	424	1.1339	0.0857	1.1339	1.0649
No log	7.6071	426	1.1675	-0.0169	1.1675	1.0805
No log	7.6429	428	1.1014	0.0491	1.1014	1.0495
No log	7.6786	430	0.9751	0.1464	0.9751	0.9875
No log	7.7143	432	0.8206	0.2153	0.8206	0.9059
No log	7.75	434	0.7134	0.2000	0.7134	0.8446
No log	7.7857	436	0.6803	0.3118	0.6803	0.8248
No log	7.8214	438	0.6744	0.3089	0.6744	0.8212
No log	7.8571	440	0.6924	0.2421	0.6924	0.8321
No log	7.8929	442	0.7399	0.2079	0.7399	0.8601
No log	7.9286	444	0.8118	0.2153	0.8118	0.9010
No log	7.9643	446	0.8295	0.2150	0.8295	0.9107
No log	8.0	448	0.8192	0.2153	0.8192	0.9051
No log	8.0357	450	0.8450	0.2150	0.8450	0.9192
No log	8.0714	452	0.8273	0.2153	0.8273	0.9096
No log	8.1071	454	0.8058	0.2153	0.8058	0.8977
No log	8.1429	456	0.7916	0.2464	0.7916	0.8897
No log	8.1786	458	0.8037	0.2464	0.8037	0.8965
No log	8.2143	460	0.8068	0.2464	0.8068	0.8982
No log	8.25	462	0.8014	0.2464	0.8014	0.8952
No log	8.2857	464	0.8102	0.2464	0.8102	0.9001
No log	8.3214	466	0.8474	0.3180	0.8474	0.9205
No log	8.3571	468	0.8607	0.3180	0.8607	0.9277
No log	8.3929	470	0.8735	0.2146	0.8735	0.9346
No log	8.4286	472	0.8692	0.2523	0.8692	0.9323
No log	8.4643	474	0.8762	0.2523	0.8762	0.9360
No log	8.5	476	0.8801	0.2523	0.8801	0.9382
No log	8.5357	478	0.8842	0.2523	0.8842	0.9403
No log	8.5714	480	0.8571	0.2523	0.8571	0.9258
No log	8.6071	482	0.8202	0.2464	0.8202	0.9057
No log	8.6429	484	0.8148	0.2464	0.8148	0.9026
No log	8.6786	486	0.7926	0.2464	0.7926	0.8903
No log	8.7143	488	0.7751	0.2079	0.7751	0.8804
No log	8.75	490	0.7630	0.2079	0.7630	0.8735
No log	8.7857	492	0.7602	0.2079	0.7602	0.8719
No log	8.8214	494	0.7691	0.2079	0.7691	0.8770
No log	8.8571	496	0.7830	0.1765	0.7830	0.8848
No log	8.8929	498	0.7808	0.1765	0.7808	0.8837
0.4281	8.9286	500	0.8036	0.1765	0.8036	0.8965
0.4281	8.9643	502	0.8198	0.2523	0.8198	0.9054
0.4281	9.0	504	0.8126	0.2153	0.8126	0.9015
0.4281	9.0357	506	0.7936	0.1765	0.7936	0.8908
0.4281	9.0714	508	0.7931	0.1765	0.7931	0.8906
0.4281	9.1071	510	0.8066	0.2523	0.8066	0.8981
0.4281	9.1429	512	0.8119	0.2523	0.8119	0.9011
0.4281	9.1786	514	0.8152	0.2523	0.8152	0.9029
0.4281	9.2143	516	0.8196	0.2523	0.8196	0.9053
0.4281	9.25	518	0.8208	0.2523	0.8208	0.9060
0.4281	9.2857	520	0.8133	0.2523	0.8133	0.9018
0.4281	9.3214	522	0.7952	0.1675	0.7952	0.8917
0.4281	9.3571	524	0.7694	0.1675	0.7694	0.8772
0.4281	9.3929	526	0.7551	0.1675	0.7551	0.8690
0.4281	9.4286	528	0.7571	0.1675	0.7571	0.8701
0.4281	9.4643	530	0.7663	0.1675	0.7663	0.8754
0.4281	9.5	532	0.7801	0.1675	0.7801	0.8833
0.4281	9.5357	534	0.8002	0.2464	0.8002	0.8945
0.4281	9.5714	536	0.8080	0.1765	0.8080	0.8989
0.4281	9.6071	538	0.8189	0.2523	0.8189	0.9050
0.4281	9.6429	540	0.8231	0.2523	0.8231	0.9073
0.4281	9.6786	542	0.8199	0.2523	0.8199	0.9055
0.4281	9.7143	544	0.8081	0.1765	0.8081	0.8989
0.4281	9.75	546	0.7985	0.2464	0.7985	0.8936
0.4281	9.7857	548	0.7917	0.2079	0.7917	0.8898
0.4281	9.8214	550	0.7846	0.1675	0.7846	0.8858
0.4281	9.8571	552	0.7789	0.1675	0.7789	0.8826
0.4281	9.8929	554	0.7722	0.1675	0.7722	0.8787
0.4281	9.9286	556	0.7676	0.1675	0.7676	0.8761
0.4281	9.9643	558	0.7653	0.1675	0.7653	0.8748
0.4281	10.0	560	0.7642	0.1675	0.7642	0.8742

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024