ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k14_task1_organization

MayBashendy/ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k14_task1_organization

ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k14_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

54% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 23, 2024
Updated: Dec 23, 2024
SHA: a8adaafc

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k14_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.9058
Qwk: 0.6081
Mse: 0.9058
Rmse: 0.9517

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 16
eval_batch_size: 16
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0556	2	7.8338	-0.0371	7.8338	2.7989
No log	0.1111	4	5.5578	-0.0349	5.5578	2.3575
No log	0.1667	6	3.9689	0.0200	3.9689	1.9922
No log	0.2222	8	2.9370	0.0790	2.9370	1.7138
No log	0.2778	10	2.2072	0.0643	2.2072	1.4857
No log	0.3333	12	1.8068	0.1742	1.8068	1.3442
No log	0.3889	14	1.5103	0.1839	1.5103	1.2289
No log	0.4444	16	1.3256	0.2054	1.3256	1.1513
No log	0.5	18	1.2344	0.1655	1.2344	1.1110
No log	0.5556	20	1.1251	0.3249	1.1251	1.0607
No log	0.6111	22	1.0623	0.4226	1.0623	1.0307
No log	0.6667	24	1.1112	0.4100	1.1112	1.0541
No log	0.7222	26	1.1657	0.3669	1.1657	1.0797
No log	0.7778	28	1.1672	0.3759	1.1672	1.0804
No log	0.8333	30	1.2008	0.3524	1.2008	1.0958
No log	0.8889	32	1.1020	0.3719	1.1020	1.0498
No log	0.9444	34	1.0057	0.4867	1.0057	1.0028
No log	1.0	36	0.9906	0.4977	0.9906	0.9953
No log	1.0556	38	1.0119	0.4784	1.0119	1.0059
No log	1.1111	40	1.1180	0.3266	1.1180	1.0574
No log	1.1667	42	1.1770	0.3450	1.1770	1.0849
No log	1.2222	44	1.3333	0.3631	1.3333	1.1547
No log	1.2778	46	1.3954	0.3830	1.3954	1.1813
No log	1.3333	48	1.4539	0.3639	1.4539	1.2058
No log	1.3889	50	1.3146	0.3833	1.3146	1.1465
No log	1.4444	52	1.1710	0.4275	1.1710	1.0821
No log	1.5	54	0.9494	0.4642	0.9494	0.9744
No log	1.5556	56	0.8403	0.5792	0.8403	0.9167
No log	1.6111	58	0.8103	0.5936	0.8103	0.9002
No log	1.6667	60	0.8175	0.5684	0.8175	0.9042
No log	1.7222	62	0.8603	0.5378	0.8603	0.9275
No log	1.7778	64	0.9217	0.5078	0.9217	0.9601
No log	1.8333	66	0.9222	0.4769	0.9222	0.9603
No log	1.8889	68	0.8805	0.5229	0.8805	0.9384
No log	1.9444	70	0.8751	0.5224	0.8751	0.9354
No log	2.0	72	0.8282	0.5345	0.8282	0.9101
No log	2.0556	74	0.7959	0.5451	0.7959	0.8921
No log	2.1111	76	0.7914	0.5011	0.7914	0.8896
No log	2.1667	78	0.7815	0.4960	0.7815	0.8840
No log	2.2222	80	0.7952	0.5733	0.7952	0.8917
No log	2.2778	82	0.8805	0.5375	0.8805	0.9384
No log	2.3333	84	0.9010	0.5334	0.9010	0.9492
No log	2.3889	86	0.8380	0.5580	0.8380	0.9154
No log	2.4444	88	0.8318	0.5863	0.8318	0.9120
No log	2.5	90	0.8332	0.6069	0.8332	0.9128
No log	2.5556	92	0.8463	0.6003	0.8463	0.9200
No log	2.6111	94	0.8418	0.6096	0.8418	0.9175
No log	2.6667	96	0.8273	0.6186	0.8273	0.9095
No log	2.7222	98	0.8127	0.5440	0.8127	0.9015
No log	2.7778	100	0.8042	0.5767	0.8042	0.8968
No log	2.8333	102	0.8103	0.6037	0.8103	0.9002
No log	2.8889	104	0.8100	0.6302	0.8100	0.9000
No log	2.9444	106	0.7864	0.6027	0.7864	0.8868
No log	3.0	108	0.8235	0.6059	0.8235	0.9075
No log	3.0556	110	0.8079	0.6105	0.8079	0.8988
No log	3.1111	112	0.7633	0.5960	0.7633	0.8737
No log	3.1667	114	0.7895	0.6184	0.7895	0.8886
No log	3.2222	116	0.8126	0.5816	0.8126	0.9014
No log	3.2778	118	0.7695	0.6347	0.7695	0.8772
No log	3.3333	120	0.7520	0.6089	0.7520	0.8672
No log	3.3889	122	0.9010	0.5946	0.9010	0.9492
No log	3.4444	124	1.0092	0.5059	1.0092	1.0046
No log	3.5	126	0.9726	0.5166	0.9726	0.9862
No log	3.5556	128	0.8503	0.6146	0.8503	0.9221
No log	3.6111	130	0.7353	0.6155	0.7353	0.8575
No log	3.6667	132	0.7384	0.6150	0.7384	0.8593
No log	3.7222	134	0.7947	0.5817	0.7947	0.8915
No log	3.7778	136	0.7465	0.6090	0.7465	0.8640
No log	3.8333	138	0.6886	0.6460	0.6886	0.8298
No log	3.8889	140	0.6979	0.6348	0.6979	0.8354
No log	3.9444	142	0.6965	0.6426	0.6965	0.8346
No log	4.0	144	0.6919	0.6441	0.6919	0.8318
No log	4.0556	146	0.6919	0.6346	0.6919	0.8318
No log	4.1111	148	0.7005	0.6504	0.7005	0.8370
No log	4.1667	150	0.7060	0.6657	0.7060	0.8403
No log	4.2222	152	0.7205	0.6657	0.7205	0.8488
No log	4.2778	154	0.7026	0.6489	0.7026	0.8382
No log	4.3333	156	0.7012	0.6340	0.7012	0.8374
No log	4.3889	158	0.7150	0.6657	0.7150	0.8456
No log	4.4444	160	0.7217	0.6382	0.7217	0.8495
No log	4.5	162	0.7397	0.6307	0.7397	0.8600
No log	4.5556	164	0.7909	0.6647	0.7909	0.8893
No log	4.6111	166	0.8798	0.5781	0.8798	0.9380
No log	4.6667	168	0.9941	0.4853	0.9941	0.9971
No log	4.7222	170	0.9493	0.5136	0.9493	0.9743
No log	4.7778	172	0.8122	0.6542	0.8122	0.9012
No log	4.8333	174	0.7673	0.6479	0.7673	0.8760
No log	4.8889	176	0.7754	0.6519	0.7754	0.8806
No log	4.9444	178	0.7399	0.7017	0.7399	0.8602
No log	5.0	180	0.7279	0.6430	0.7279	0.8532
No log	5.0556	182	0.7317	0.6510	0.7317	0.8554
No log	5.1111	184	0.7438	0.7017	0.7438	0.8624
No log	5.1667	186	0.8335	0.6380	0.8335	0.9129
No log	5.2222	188	0.8224	0.6372	0.8224	0.9069
No log	5.2778	190	0.7662	0.6692	0.7662	0.8753
No log	5.3333	192	0.7493	0.6876	0.7493	0.8656
No log	5.3889	194	0.7716	0.6235	0.7716	0.8784
No log	5.4444	196	0.7636	0.6431	0.7636	0.8738
No log	5.5	198	0.7546	0.6849	0.7546	0.8687
No log	5.5556	200	0.8143	0.6219	0.8143	0.9024
No log	5.6111	202	0.8608	0.5686	0.8608	0.9278
No log	5.6667	204	0.8264	0.6015	0.8264	0.9090
No log	5.7222	206	0.7723	0.6633	0.7723	0.8788
No log	5.7778	208	0.7690	0.6231	0.7690	0.8769
No log	5.8333	210	0.7605	0.6349	0.7605	0.8721
No log	5.8889	212	0.7645	0.6744	0.7645	0.8743
No log	5.9444	214	0.8822	0.5034	0.8822	0.9392
No log	6.0	216	0.9493	0.4945	0.9493	0.9743
No log	6.0556	218	0.8801	0.5276	0.8801	0.9381
No log	6.1111	220	0.7603	0.6059	0.7603	0.8719
No log	6.1667	222	0.7245	0.6522	0.7245	0.8512
No log	6.2222	224	0.7269	0.6609	0.7269	0.8526
No log	6.2778	226	0.7320	0.6613	0.7320	0.8556
No log	6.3333	228	0.7837	0.6448	0.7837	0.8853
No log	6.3889	230	0.8407	0.6104	0.8407	0.9169
No log	6.4444	232	0.9001	0.5669	0.9001	0.9487
No log	6.5	234	0.9450	0.5637	0.9450	0.9721
No log	6.5556	236	0.9037	0.6164	0.9037	0.9506
No log	6.6111	238	0.8558	0.6091	0.8558	0.9251
No log	6.6667	240	0.8521	0.6048	0.8521	0.9231
No log	6.7222	242	0.8655	0.6039	0.8655	0.9303
No log	6.7778	244	0.9158	0.5919	0.9158	0.9570
No log	6.8333	246	0.8906	0.5929	0.8906	0.9437
No log	6.8889	248	0.8367	0.6413	0.8367	0.9147
No log	6.9444	250	0.8470	0.6232	0.8470	0.9203
No log	7.0	252	0.8981	0.6055	0.8981	0.9477
No log	7.0556	254	0.9682	0.5367	0.9682	0.9840
No log	7.1111	256	0.9647	0.5199	0.9647	0.9822
No log	7.1667	258	0.8822	0.5662	0.8822	0.9393
No log	7.2222	260	0.8453	0.6451	0.8453	0.9194
No log	7.2778	262	0.8513	0.6586	0.8513	0.9226
No log	7.3333	264	0.8854	0.6044	0.8854	0.9410
No log	7.3889	266	0.9207	0.5600	0.9207	0.9595
No log	7.4444	268	0.9119	0.5663	0.9119	0.9549
No log	7.5	270	0.8436	0.6417	0.8436	0.9185
No log	7.5556	272	0.7917	0.6478	0.7917	0.8898
No log	7.6111	274	0.8106	0.6462	0.8106	0.9003
No log	7.6667	276	0.8615	0.6059	0.8615	0.9282
No log	7.7222	278	0.9143	0.5767	0.9143	0.9562
No log	7.7778	280	0.9068	0.5798	0.9068	0.9523
No log	7.8333	282	0.8389	0.6299	0.8389	0.9159
No log	7.8889	284	0.8202	0.6472	0.8202	0.9056
No log	7.9444	286	0.8341	0.6240	0.8341	0.9133
No log	8.0	288	0.8329	0.6240	0.8329	0.9126
No log	8.0556	290	0.8402	0.6254	0.8402	0.9166
No log	8.1111	292	0.8590	0.6137	0.8590	0.9268
No log	8.1667	294	0.9024	0.6143	0.9024	0.9499
No log	8.2222	296	0.9969	0.5181	0.9969	0.9984
No log	8.2778	298	0.9590	0.5697	0.9590	0.9793
No log	8.3333	300	0.9180	0.5842	0.9180	0.9581
No log	8.3889	302	0.8483	0.6330	0.8483	0.9210
No log	8.4444	304	0.8555	0.6317	0.8555	0.9250
No log	8.5	306	0.9163	0.5916	0.9163	0.9572
No log	8.5556	308	1.0221	0.5214	1.0221	1.0110
No log	8.6111	310	1.0320	0.5049	1.0320	1.0159
No log	8.6667	312	0.9850	0.6014	0.9850	0.9925
No log	8.7222	314	0.9202	0.6030	0.9202	0.9593
No log	8.7778	316	0.9345	0.6053	0.9345	0.9667
No log	8.8333	318	1.0023	0.5902	1.0023	1.0011
No log	8.8889	320	1.0104	0.5769	1.0104	1.0052
No log	8.9444	322	0.9751	0.5926	0.9751	0.9875
No log	9.0	324	0.9414	0.6098	0.9414	0.9703
No log	9.0556	326	0.9010	0.6301	0.9010	0.9492
No log	9.1111	328	0.8772	0.6422	0.8772	0.9366
No log	9.1667	330	0.8791	0.6582	0.8791	0.9376
No log	9.2222	332	0.9306	0.6009	0.9306	0.9647
No log	9.2778	334	0.9411	0.5896	0.9411	0.9701
No log	9.3333	336	0.8898	0.5935	0.8898	0.9433
No log	9.3889	338	0.9081	0.5860	0.9081	0.9530
No log	9.4444	340	1.0072	0.5414	1.0072	1.0036
No log	9.5	342	1.0188	0.5273	1.0188	1.0093
No log	9.5556	344	0.9364	0.5648	0.9364	0.9677
No log	9.6111	346	0.8449	0.6413	0.8449	0.9192
No log	9.6667	348	0.8565	0.6200	0.8565	0.9255
No log	9.7222	350	0.8610	0.6410	0.8610	0.9279
No log	9.7778	352	0.8671	0.6406	0.8671	0.9312
No log	9.8333	354	0.8906	0.6308	0.8906	0.9437
No log	9.8889	356	0.9279	0.6251	0.9279	0.9633
No log	9.9444	358	0.9692	0.5999	0.9692	0.9845
No log	10.0	360	0.9529	0.5937	0.9529	0.9762
No log	10.0556	362	0.9143	0.6424	0.9143	0.9562
No log	10.1111	364	0.8670	0.6572	0.8670	0.9311
No log	10.1667	366	0.8643	0.6643	0.8643	0.9297
No log	10.2222	368	0.8947	0.6599	0.8947	0.9459
No log	10.2778	370	0.8867	0.6599	0.8867	0.9417
No log	10.3333	372	0.8595	0.6518	0.8595	0.9271
No log	10.3889	374	0.8527	0.6562	0.8527	0.9234
No log	10.4444	376	0.9005	0.6633	0.9005	0.9490
No log	10.5	378	0.9060	0.6398	0.9060	0.9518
No log	10.5556	380	0.8761	0.6527	0.8761	0.9360
No log	10.6111	382	0.8702	0.6396	0.8702	0.9329
No log	10.6667	384	0.8643	0.6445	0.8643	0.9297
No log	10.7222	386	0.8766	0.6398	0.8766	0.9363
No log	10.7778	388	0.9295	0.5991	0.9295	0.9641
No log	10.8333	390	0.9771	0.5706	0.9771	0.9885
No log	10.8889	392	1.0217	0.5496	1.0217	1.0108
No log	10.9444	394	0.9974	0.5672	0.9974	0.9987
No log	11.0	396	0.9362	0.5952	0.9362	0.9676
No log	11.0556	398	0.9329	0.6237	0.9329	0.9659
No log	11.1111	400	0.9336	0.6032	0.9336	0.9662
No log	11.1667	402	0.9600	0.6088	0.9600	0.9798
No log	11.2222	404	0.9802	0.5914	0.9802	0.9900
No log	11.2778	406	0.9712	0.5943	0.9712	0.9855
No log	11.3333	408	0.9346	0.5940	0.9346	0.9667
No log	11.3889	410	0.9356	0.5872	0.9356	0.9672
No log	11.4444	412	0.9297	0.6165	0.9297	0.9642
No log	11.5	414	0.9234	0.6138	0.9234	0.9609
No log	11.5556	416	0.9307	0.6105	0.9307	0.9647
No log	11.6111	418	0.9353	0.6198	0.9353	0.9671
No log	11.6667	420	0.9006	0.6095	0.9006	0.9490
No log	11.7222	422	0.8815	0.6316	0.8815	0.9389
No log	11.7778	424	0.8756	0.6430	0.8756	0.9357
No log	11.8333	426	0.8727	0.6404	0.8727	0.9342
No log	11.8889	428	0.8688	0.6209	0.8688	0.9321
No log	11.9444	430	0.8449	0.6486	0.8449	0.9192
No log	12.0	432	0.8657	0.6591	0.8657	0.9304
No log	12.0556	434	0.8944	0.6215	0.8944	0.9457
No log	12.1111	436	0.8711	0.6365	0.8711	0.9333
No log	12.1667	438	0.8616	0.6421	0.8616	0.9282
No log	12.2222	440	0.8612	0.6082	0.8612	0.9280
No log	12.2778	442	0.8656	0.6180	0.8656	0.9304
No log	12.3333	444	0.9101	0.6270	0.9101	0.9540
No log	12.3889	446	0.9604	0.6056	0.9604	0.9800
No log	12.4444	448	0.9360	0.6146	0.9360	0.9675
No log	12.5	450	0.9100	0.6150	0.9100	0.9539
No log	12.5556	452	0.9007	0.6269	0.9007	0.9491
No log	12.6111	454	0.9041	0.6226	0.9041	0.9508
No log	12.6667	456	0.8994	0.6375	0.8994	0.9484
No log	12.7222	458	0.9023	0.6307	0.9023	0.9499
No log	12.7778	460	0.8982	0.6307	0.8982	0.9477
No log	12.8333	462	0.8708	0.6368	0.8708	0.9332
No log	12.8889	464	0.8675	0.6367	0.8675	0.9314
No log	12.9444	466	0.8764	0.6415	0.8764	0.9362
No log	13.0	468	0.9358	0.6247	0.9358	0.9673
No log	13.0556	470	0.9561	0.5759	0.9561	0.9778
No log	13.1111	472	0.9310	0.6010	0.9310	0.9649
No log	13.1667	474	0.9238	0.6101	0.9238	0.9612
No log	13.2222	476	0.8788	0.6590	0.8788	0.9375
No log	13.2778	478	0.8698	0.6607	0.8698	0.9327
No log	13.3333	480	0.9189	0.6123	0.9189	0.9586
No log	13.3889	482	0.9574	0.5803	0.9574	0.9785
No log	13.4444	484	0.9170	0.6155	0.9170	0.9576
No log	13.5	486	0.8926	0.6342	0.8926	0.9448
No log	13.5556	488	0.8730	0.6322	0.8730	0.9344
No log	13.6111	490	0.9060	0.6232	0.9060	0.9518
No log	13.6667	492	0.9986	0.5857	0.9986	0.9993
No log	13.7222	494	1.0394	0.5685	1.0394	1.0195
No log	13.7778	496	0.9746	0.5926	0.9746	0.9872
No log	13.8333	498	0.8983	0.6206	0.8983	0.9478
0.605	13.8889	500	0.8756	0.6169	0.8756	0.9357
0.605	13.9444	502	0.8866	0.6039	0.8866	0.9416
0.605	14.0	504	0.8718	0.6223	0.8718	0.9337
0.605	14.0556	506	0.8936	0.6193	0.8936	0.9453
0.605	14.1111	508	0.9034	0.6007	0.9034	0.9505
0.605	14.1667	510	0.9045	0.6007	0.9045	0.9511
0.605	14.2222	512	0.8786	0.6184	0.8786	0.9373
0.605	14.2778	514	0.8615	0.6353	0.8615	0.9281
0.605	14.3333	516	0.8590	0.6249	0.8590	0.9268
0.605	14.3889	518	0.8515	0.6353	0.8515	0.9228
0.605	14.4444	520	0.8369	0.6218	0.8369	0.9148
0.605	14.5	522	0.8391	0.6457	0.8391	0.9160
0.605	14.5556	524	0.8916	0.6060	0.8916	0.9443
0.605	14.6111	526	0.8950	0.6060	0.8950	0.9460
0.605	14.6667	528	0.8924	0.6149	0.8924	0.9447
0.605	14.7222	530	0.8722	0.6325	0.8722	0.9339
0.605	14.7778	532	0.8324	0.6375	0.8324	0.9124
0.605	14.8333	534	0.8316	0.6467	0.8316	0.9119
0.605	14.8889	536	0.8499	0.6501	0.8499	0.9219
0.605	14.9444	538	0.8886	0.6349	0.8886	0.9427
0.605	15.0	540	0.9230	0.5958	0.9230	0.9607
0.605	15.0556	542	0.9329	0.6040	0.9329	0.9658
0.605	15.1111	544	0.9047	0.6464	0.9047	0.9511
0.605	15.1667	546	0.8891	0.6476	0.8891	0.9429
0.605	15.2222	548	0.9007	0.6451	0.9007	0.9491
0.605	15.2778	550	0.8906	0.6484	0.8906	0.9437
0.605	15.3333	552	0.8972	0.6421	0.8972	0.9472
0.605	15.3889	554	0.9014	0.6217	0.9014	0.9494
0.605	15.4444	556	0.8963	0.6321	0.8963	0.9468
0.605	15.5	558	0.8811	0.6401	0.8811	0.9387
0.605	15.5556	560	0.8789	0.6298	0.8789	0.9375
0.605	15.6111	562	0.8553	0.6388	0.8553	0.9248
0.605	15.6667	564	0.8286	0.6368	0.8286	0.9103
0.605	15.7222	566	0.8289	0.6337	0.8289	0.9105
0.605	15.7778	568	0.8592	0.6363	0.8592	0.9269
0.605	15.8333	570	0.9252	0.6007	0.9252	0.9619
0.605	15.8889	572	0.9297	0.5980	0.9297	0.9642
0.605	15.9444	574	0.9137	0.6094	0.9137	0.9559
0.605	16.0	576	0.8956	0.6105	0.8956	0.9463
0.605	16.0556	578	0.9058	0.6081	0.9058	0.9517

Framework versions

Transformers 4.44.2
Pytorch 2.4.1+cu121
Datasets 3.2.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 23, 2024
Updated: Dec 23, 2024