ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k17_task1_organization

MayBashendy/ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k17_task1_organization

ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k17_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

57% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 23, 2024
Updated: Dec 23, 2024
SHA: 5afb829f

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k17_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.9751
Qwk: 0.5149
Mse: 0.9751
Rmse: 0.9875

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 16
eval_batch_size: 16
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0476	2	7.8901	-0.0486	7.8901	2.8089
No log	0.0952	4	5.5869	-0.0322	5.5869	2.3637
No log	0.1429	6	4.0134	0.0318	4.0134	2.0034
No log	0.1905	8	3.0236	0.0896	3.0236	1.7388
No log	0.2381	10	2.2875	0.1207	2.2875	1.5124
No log	0.2857	12	1.7732	0.1875	1.7732	1.3316
No log	0.3333	14	1.4097	0.2261	1.4097	1.1873
No log	0.3810	16	1.2004	0.3491	1.2004	1.0956
No log	0.4286	18	1.1400	0.4466	1.1400	1.0677
No log	0.4762	20	1.2071	0.3135	1.2071	1.0987
No log	0.5238	22	1.3200	0.3257	1.3200	1.1489
No log	0.5714	24	1.2556	0.3390	1.2556	1.1205
No log	0.6190	26	1.0633	0.4223	1.0633	1.0312
No log	0.6667	28	0.9520	0.4906	0.9520	0.9757
No log	0.7143	30	0.9030	0.4467	0.9030	0.9502
No log	0.7619	32	0.9306	0.4026	0.9306	0.9647
No log	0.8095	34	0.8843	0.4500	0.8843	0.9404
No log	0.8571	36	0.8684	0.5328	0.8684	0.9319
No log	0.9048	38	0.9109	0.4444	0.9109	0.9544
No log	0.9524	40	0.9773	0.4369	0.9773	0.9886
No log	1.0	42	1.0533	0.4159	1.0533	1.0263
No log	1.0476	44	1.0778	0.3936	1.0778	1.0382
No log	1.0952	46	1.0054	0.4618	1.0054	1.0027
No log	1.1429	48	0.9936	0.4709	0.9936	0.9968
No log	1.1905	50	0.8736	0.5337	0.8736	0.9347
No log	1.2381	52	0.8242	0.5753	0.8242	0.9079
No log	1.2857	54	0.7995	0.5951	0.7995	0.8941
No log	1.3333	56	0.8387	0.5522	0.8387	0.9158
No log	1.3810	58	0.9193	0.4968	0.9193	0.9588
No log	1.4286	60	1.1190	0.3950	1.1190	1.0578
No log	1.4762	62	1.2242	0.4294	1.2242	1.1064
No log	1.5238	64	1.1380	0.4211	1.1380	1.0668
No log	1.5714	66	0.9090	0.5166	0.9090	0.9534
No log	1.6190	68	0.7333	0.5822	0.7333	0.8563
No log	1.6667	70	0.7097	0.6302	0.7097	0.8424
No log	1.7143	72	0.7468	0.5819	0.7468	0.8641
No log	1.7619	74	0.8814	0.5673	0.8814	0.9388
No log	1.8095	76	1.0372	0.4610	1.0372	1.0185
No log	1.8571	78	1.0885	0.4673	1.0885	1.0433
No log	1.9048	80	1.0223	0.4815	1.0223	1.0111
No log	1.9524	82	0.9639	0.5449	0.9639	0.9818
No log	2.0	84	0.8572	0.6201	0.8572	0.9259
No log	2.0476	86	0.9354	0.5789	0.9354	0.9671
No log	2.0952	88	1.0952	0.4648	1.0952	1.0465
No log	2.1429	90	1.0489	0.4841	1.0489	1.0242
No log	2.1905	92	0.9251	0.6164	0.9251	0.9618
No log	2.2381	94	0.7505	0.6684	0.7505	0.8663
No log	2.2857	96	0.6938	0.6587	0.6938	0.8329
No log	2.3333	98	0.7142	0.6838	0.7142	0.8451
No log	2.3810	100	0.8593	0.6368	0.8593	0.9270
No log	2.4286	102	1.0356	0.5107	1.0356	1.0176
No log	2.4762	104	1.0067	0.5413	1.0067	1.0033
No log	2.5238	106	0.8276	0.6563	0.8276	0.9097
No log	2.5714	108	0.7512	0.6782	0.7512	0.8667
No log	2.6190	110	0.6829	0.6914	0.6829	0.8264
No log	2.6667	112	0.6453	0.6948	0.6453	0.8033
No log	2.7143	114	0.6605	0.6801	0.6605	0.8127
No log	2.7619	116	0.7215	0.6979	0.7215	0.8494
No log	2.8095	118	0.7421	0.6932	0.7421	0.8615
No log	2.8571	120	0.7606	0.6878	0.7606	0.8721
No log	2.9048	122	0.8175	0.6377	0.8175	0.9042
No log	2.9524	124	0.7644	0.6762	0.7644	0.8743
No log	3.0	126	0.6981	0.7013	0.6981	0.8355
No log	3.0476	128	0.6963	0.7028	0.6963	0.8344
No log	3.0952	130	0.7246	0.7026	0.7246	0.8512
No log	3.1429	132	0.6926	0.6963	0.6926	0.8323
No log	3.1905	134	0.6647	0.7183	0.6647	0.8153
No log	3.2381	136	0.6758	0.7183	0.6758	0.8221
No log	3.2857	138	0.7171	0.6915	0.7171	0.8468
No log	3.3333	140	0.7648	0.7037	0.7648	0.8745
No log	3.3810	142	0.8034	0.6875	0.8034	0.8963
No log	3.4286	144	0.7557	0.6858	0.7557	0.8693
No log	3.4762	146	0.6836	0.7286	0.6836	0.8268
No log	3.5238	148	0.6983	0.6958	0.6983	0.8357
No log	3.5714	150	0.7830	0.6754	0.7830	0.8849
No log	3.6190	152	0.7158	0.6926	0.7158	0.8460
No log	3.6667	154	0.6175	0.7165	0.6175	0.7858
No log	3.7143	156	0.6060	0.6874	0.6060	0.7785
No log	3.7619	158	0.6087	0.6708	0.6087	0.7802
No log	3.8095	160	0.6223	0.6755	0.6223	0.7889
No log	3.8571	162	0.6260	0.6696	0.6260	0.7912
No log	3.9048	164	0.6310	0.6677	0.6310	0.7944
No log	3.9524	166	0.6376	0.7007	0.6376	0.7985
No log	4.0	168	0.6388	0.6539	0.6388	0.7992
No log	4.0476	170	0.6594	0.6830	0.6594	0.8120
No log	4.0952	172	0.6727	0.6789	0.6727	0.8202
No log	4.1429	174	0.7051	0.6724	0.7051	0.8397
No log	4.1905	176	0.7362	0.6788	0.7362	0.8580
No log	4.2381	178	0.7195	0.6724	0.7195	0.8483
No log	4.2857	180	0.6975	0.6884	0.6975	0.8352
No log	4.3333	182	0.7092	0.6774	0.7092	0.8421
No log	4.3810	184	0.7069	0.6889	0.7069	0.8407
No log	4.4286	186	0.6926	0.6639	0.6926	0.8322
No log	4.4762	188	0.7243	0.6992	0.7243	0.8511
No log	4.5238	190	0.7044	0.6812	0.7044	0.8393
No log	4.5714	192	0.6674	0.6807	0.6674	0.8170
No log	4.6190	194	0.6688	0.6834	0.6688	0.8178
No log	4.6667	196	0.6590	0.6655	0.6590	0.8118
No log	4.7143	198	0.6622	0.6745	0.6622	0.8138
No log	4.7619	200	0.6766	0.7067	0.6766	0.8226
No log	4.8095	202	0.6572	0.6815	0.6572	0.8107
No log	4.8571	204	0.6577	0.6815	0.6577	0.8110
No log	4.9048	206	0.6561	0.7150	0.6561	0.8100
No log	4.9524	208	0.6956	0.6815	0.6956	0.8340
No log	5.0	210	0.7130	0.6697	0.7130	0.8444
No log	5.0476	212	0.6710	0.7344	0.6710	0.8192
No log	5.0952	214	0.6640	0.6868	0.6640	0.8149
No log	5.1429	216	0.6841	0.6882	0.6841	0.8271
No log	5.1905	218	0.6798	0.7099	0.6798	0.8245
No log	5.2381	220	0.7336	0.6743	0.7336	0.8565
No log	5.2857	222	0.7336	0.6797	0.7336	0.8565
No log	5.3333	224	0.7058	0.7015	0.7058	0.8401
No log	5.3810	226	0.7477	0.6685	0.7477	0.8647
No log	5.4286	228	0.8241	0.6567	0.8241	0.9078
No log	5.4762	230	0.8189	0.6576	0.8189	0.9050
No log	5.5238	232	0.7237	0.6856	0.7237	0.8507
No log	5.5714	234	0.7332	0.6625	0.7332	0.8563
No log	5.6190	236	0.7931	0.6371	0.7931	0.8906
No log	5.6667	238	0.7662	0.6373	0.7662	0.8753
No log	5.7143	240	0.7267	0.6588	0.7267	0.8524
No log	5.7619	242	0.7170	0.6588	0.7170	0.8467
No log	5.8095	244	0.7243	0.6590	0.7243	0.8511
No log	5.8571	246	0.7061	0.6544	0.7061	0.8403
No log	5.9048	248	0.6940	0.6747	0.6940	0.8331
No log	5.9524	250	0.7166	0.6655	0.7166	0.8465
No log	6.0	252	0.7179	0.6640	0.7179	0.8473
No log	6.0476	254	0.6853	0.6698	0.6853	0.8278
No log	6.0952	256	0.6874	0.6932	0.6874	0.8291
No log	6.1429	258	0.6859	0.6663	0.6859	0.8282
No log	6.1905	260	0.6892	0.6544	0.6892	0.8302
No log	6.2381	262	0.7009	0.6535	0.7009	0.8372
No log	6.2857	264	0.7183	0.6767	0.7183	0.8475
No log	6.3333	266	0.7693	0.6518	0.7693	0.8771
No log	6.3810	268	0.8278	0.6163	0.8278	0.9098
No log	6.4286	270	0.8301	0.5978	0.8301	0.9111
No log	6.4762	272	0.7702	0.6306	0.7702	0.8776
No log	6.5238	274	0.7540	0.6730	0.7540	0.8683
No log	6.5714	276	0.7556	0.6605	0.7556	0.8693
No log	6.6190	278	0.8372	0.5765	0.8372	0.9150
No log	6.6667	280	0.9243	0.5565	0.9243	0.9614
No log	6.7143	282	0.8237	0.5907	0.8237	0.9076
No log	6.7619	284	0.7508	0.6696	0.7508	0.8665
No log	6.8095	286	0.7545	0.6423	0.7545	0.8686
No log	6.8571	288	0.7631	0.6361	0.7631	0.8736
No log	6.9048	290	0.7589	0.6156	0.7589	0.8712
No log	6.9524	292	0.7650	0.6413	0.7650	0.8747
No log	7.0	294	0.7609	0.6369	0.7609	0.8723
No log	7.0476	296	0.7514	0.6458	0.7514	0.8668
No log	7.0952	298	0.8653	0.6251	0.8653	0.9302
No log	7.1429	300	0.9816	0.5908	0.9816	0.9908
No log	7.1905	302	0.9479	0.5896	0.9479	0.9736
No log	7.2381	304	0.7855	0.6688	0.7855	0.8863
No log	7.2857	306	0.7498	0.6482	0.7498	0.8659
No log	7.3333	308	0.7696	0.6501	0.7696	0.8773
No log	7.3810	310	0.7256	0.6895	0.7256	0.8518
No log	7.4286	312	0.7633	0.6580	0.7633	0.8737
No log	7.4762	314	0.7613	0.6533	0.7613	0.8725
No log	7.5238	316	0.7645	0.6469	0.7645	0.8743
No log	7.5714	318	0.7472	0.6491	0.7472	0.8644
No log	7.6190	320	0.7597	0.6397	0.7597	0.8716
No log	7.6667	322	0.8526	0.6313	0.8526	0.9234
No log	7.7143	324	0.8613	0.6284	0.8613	0.9281
No log	7.7619	326	0.8321	0.6365	0.8321	0.9122
No log	7.8095	328	0.8141	0.6418	0.8141	0.9022
No log	7.8571	330	0.8095	0.6524	0.8095	0.8997
No log	7.9048	332	0.8155	0.6453	0.8155	0.9031
No log	7.9524	334	0.7944	0.6489	0.7944	0.8913
No log	8.0	336	0.8222	0.6234	0.8222	0.9068
No log	8.0476	338	0.8293	0.6204	0.8293	0.9106
No log	8.0952	340	0.7817	0.6211	0.7817	0.8841
No log	8.1429	342	0.7699	0.6442	0.7699	0.8774
No log	8.1905	344	0.7786	0.6504	0.7786	0.8824
No log	8.2381	346	0.7766	0.6303	0.7766	0.8812
No log	8.2857	348	0.7809	0.6133	0.7809	0.8837
No log	8.3333	350	0.7774	0.6182	0.7774	0.8817
No log	8.3810	352	0.7988	0.6629	0.7988	0.8938
No log	8.4286	354	0.7933	0.6352	0.7933	0.8907
No log	8.4762	356	0.7911	0.6220	0.7911	0.8894
No log	8.5238	358	0.8288	0.6195	0.8288	0.9104
No log	8.5714	360	0.7989	0.6240	0.7989	0.8938
No log	8.6190	362	0.7930	0.6265	0.7930	0.8905
No log	8.6667	364	0.8440	0.6132	0.8440	0.9187
No log	8.7143	366	0.8024	0.6333	0.8024	0.8958
No log	8.7619	368	0.7765	0.6445	0.7765	0.8812
No log	8.8095	370	0.7676	0.6517	0.7676	0.8761
No log	8.8571	372	0.7697	0.6369	0.7697	0.8773
No log	8.9048	374	0.8389	0.6477	0.8389	0.9159
No log	8.9524	376	0.8449	0.6449	0.8449	0.9192
No log	9.0	378	0.7601	0.6448	0.7601	0.8719
No log	9.0476	380	0.7383	0.6790	0.7383	0.8592
No log	9.0952	382	0.7363	0.6673	0.7363	0.8581
No log	9.1429	384	0.7180	0.6387	0.7180	0.8474
No log	9.1905	386	0.7360	0.6538	0.7360	0.8579
No log	9.2381	388	0.7722	0.6598	0.7722	0.8787
No log	9.2857	390	0.7792	0.6609	0.7792	0.8827
No log	9.3333	392	0.7696	0.6456	0.7696	0.8773
No log	9.3810	394	0.8189	0.6467	0.8189	0.9049
No log	9.4286	396	0.8250	0.6256	0.8250	0.9083
No log	9.4762	398	0.8148	0.6293	0.8148	0.9027
No log	9.5238	400	0.7827	0.6303	0.7827	0.8847
No log	9.5714	402	0.7977	0.6263	0.7977	0.8931
No log	9.6190	404	0.8267	0.6289	0.8267	0.9093
No log	9.6667	406	0.8416	0.6217	0.8416	0.9174
No log	9.7143	408	0.8470	0.6359	0.8470	0.9203
No log	9.7619	410	0.8740	0.6064	0.8740	0.9349
No log	9.8095	412	0.8765	0.6006	0.8765	0.9362
No log	9.8571	414	0.8776	0.6345	0.8776	0.9368
No log	9.9048	416	0.8801	0.6198	0.8801	0.9381
No log	9.9524	418	0.8860	0.6064	0.8860	0.9413
No log	10.0	420	0.9882	0.6117	0.9882	0.9941
No log	10.0476	422	0.9933	0.6109	0.9933	0.9967
No log	10.0952	424	0.9022	0.6146	0.9022	0.9498
No log	10.1429	426	0.8583	0.6190	0.8583	0.9265
No log	10.1905	428	0.8655	0.6195	0.8655	0.9303
No log	10.2381	430	0.8963	0.6088	0.8963	0.9467
No log	10.2857	432	0.9230	0.6080	0.9230	0.9607
No log	10.3333	434	0.9182	0.6080	0.9182	0.9582
No log	10.3810	436	0.9120	0.6053	0.9120	0.9550
No log	10.4286	438	0.9147	0.6055	0.9147	0.9564
No log	10.4762	440	0.9442	0.6142	0.9442	0.9717
No log	10.5238	442	0.9349	0.5946	0.9349	0.9669
No log	10.5714	444	0.9454	0.6015	0.9454	0.9723
No log	10.6190	446	0.9355	0.5972	0.9355	0.9672
No log	10.6667	448	0.9089	0.6110	0.9089	0.9534
No log	10.7143	450	0.9126	0.6287	0.9126	0.9553
No log	10.7619	452	0.9172	0.5896	0.9172	0.9577
No log	10.8095	454	0.9277	0.5832	0.9277	0.9632
No log	10.8571	456	0.9082	0.5995	0.9082	0.9530
No log	10.9048	458	0.9080	0.5946	0.9080	0.9529
No log	10.9524	460	0.8944	0.6049	0.8944	0.9457
No log	11.0	462	0.8851	0.6085	0.8851	0.9408
No log	11.0476	464	0.8695	0.6125	0.8695	0.9325
No log	11.0952	466	0.9441	0.6117	0.9441	0.9716
No log	11.1429	468	0.9820	0.5878	0.9820	0.9910
No log	11.1905	470	0.8822	0.6287	0.8822	0.9393
No log	11.2381	472	0.7998	0.6206	0.7998	0.8943
No log	11.2857	474	0.8260	0.6347	0.8260	0.9089
No log	11.3333	476	0.8305	0.6248	0.8305	0.9113
No log	11.3810	478	0.8127	0.6381	0.8127	0.9015
No log	11.4286	480	0.8413	0.6053	0.8413	0.9172
No log	11.4762	482	0.8571	0.6344	0.8571	0.9258
No log	11.5238	484	0.8293	0.6255	0.8293	0.9106
No log	11.5714	486	0.8581	0.5795	0.8581	0.9264
No log	11.6190	488	0.8816	0.5663	0.8816	0.9389
No log	11.6667	490	0.8254	0.6448	0.8254	0.9085
No log	11.7143	492	0.8679	0.6273	0.8679	0.9316
No log	11.7619	494	0.9640	0.5944	0.9640	0.9818
No log	11.8095	496	0.9808	0.5763	0.9808	0.9903
No log	11.8571	498	0.8839	0.6115	0.8839	0.9402
0.5855	11.9048	500	0.8327	0.6174	0.8327	0.9125
0.5855	11.9524	502	0.8533	0.5772	0.8533	0.9237
0.5855	12.0	504	0.8281	0.6048	0.8281	0.9100
0.5855	12.0476	506	0.8260	0.6284	0.8260	0.9089
0.5855	12.0952	508	0.8330	0.6218	0.8330	0.9127
0.5855	12.1429	510	0.8454	0.6322	0.8454	0.9195
0.5855	12.1905	512	0.8733	0.6212	0.8733	0.9345
0.5855	12.2381	514	0.8348	0.6178	0.8348	0.9137
0.5855	12.2857	516	0.8539	0.6414	0.8539	0.9240
0.5855	12.3333	518	0.9126	0.6202	0.9126	0.9553
0.5855	12.3810	520	0.9035	0.6291	0.9035	0.9505
0.5855	12.4286	522	0.8455	0.6453	0.8455	0.9195
0.5855	12.4762	524	0.8933	0.6228	0.8933	0.9452
0.5855	12.5238	526	0.9286	0.6169	0.9286	0.9636
0.5855	12.5714	528	0.8856	0.6117	0.8856	0.9410
0.5855	12.6190	530	0.8509	0.6255	0.8509	0.9225
0.5855	12.6667	532	0.8319	0.6326	0.8319	0.9121
0.5855	12.7143	534	0.8360	0.6277	0.8360	0.9143
0.5855	12.7619	536	0.8619	0.6170	0.8619	0.9284
0.5855	12.8095	538	0.8609	0.6170	0.8609	0.9278
0.5855	12.8571	540	0.8062	0.6228	0.8062	0.8979
0.5855	12.9048	542	0.8006	0.6209	0.8006	0.8948
0.5855	12.9524	544	0.8133	0.6228	0.8133	0.9018
0.5855	13.0	546	0.8207	0.6380	0.8207	0.9059
0.5855	13.0476	548	0.8443	0.6274	0.8443	0.9188
0.5855	13.0952	550	0.8186	0.6381	0.8186	0.9048
0.5855	13.1429	552	0.7997	0.6106	0.7997	0.8942
0.5855	13.1905	554	0.8074	0.6124	0.8074	0.8985
0.5855	13.2381	556	0.8468	0.6321	0.8468	0.9202
0.5855	13.2857	558	0.9263	0.6086	0.9263	0.9624
0.5855	13.3333	560	0.9172	0.6276	0.9172	0.9577
0.5855	13.3810	562	0.8707	0.5996	0.8707	0.9331
0.5855	13.4286	564	0.8702	0.6220	0.8702	0.9328
0.5855	13.4762	566	0.8810	0.6147	0.8810	0.9386
0.5855	13.5238	568	0.9158	0.6248	0.9158	0.9570
0.5855	13.5714	570	0.9594	0.6120	0.9594	0.9795
0.5855	13.6190	572	0.9655	0.6142	0.9655	0.9826
0.5855	13.6667	574	0.9082	0.6176	0.9082	0.9530
0.5855	13.7143	576	0.8872	0.5943	0.8872	0.9419
0.5855	13.7619	578	0.8823	0.5943	0.8823	0.9393
0.5855	13.8095	580	0.8862	0.6246	0.8862	0.9414
0.5855	13.8571	582	0.9359	0.6097	0.9359	0.9674
0.5855	13.9048	584	0.9380	0.6097	0.9380	0.9685
0.5855	13.9524	586	0.8812	0.6116	0.8812	0.9387
0.5855	14.0	588	0.9165	0.5687	0.9165	0.9574
0.5855	14.0476	590	0.9751	0.5149	0.9751	0.9875

Framework versions

Transformers 4.44.2
Pytorch 2.4.1+cu121
Datasets 3.2.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 23, 2024
Updated: Dec 23, 2024