ArabicNewSplits6_FineTuningAraBERTFreeze_run3_AugV5_k11_task1_organization

MayBashendy/ArabicNewSplits6_FineTuningAraBERTFreeze_run3_AugV5_k11_task1_organization

ArabicNewSplits6_FineTuningAraBERTFreeze_run3_AugV5_k11_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

23% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 24, 2024
Updated: Dec 24, 2024
SHA: a48d1db5

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits6_FineTuningAraBERTFreeze_run3_AugV5_k11_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.7288
Qwk: 0.6475
Mse: 0.7288
Rmse: 0.8537

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 16
eval_batch_size: 16
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0714	2	6.3945	0.0579	6.3945	2.5287
No log	0.1429	4	5.3506	0.0725	5.3506	2.3131
No log	0.2143	6	4.6637	0.0135	4.6637	2.1596
No log	0.2857	8	4.0996	0.0082	4.0996	2.0247
No log	0.3571	10	3.5099	-0.0450	3.5099	1.8735
No log	0.4286	12	2.9158	-0.0914	2.9158	1.7076
No log	0.5	14	2.3270	0.0398	2.3270	1.5255
No log	0.5714	16	1.8569	0.1818	1.8569	1.3627
No log	0.6429	18	1.5442	0.2092	1.5442	1.2427
No log	0.7143	20	1.3675	0.3201	1.3675	1.1694
No log	0.7857	22	1.2113	0.4041	1.2113	1.1006
No log	0.8571	24	1.0592	0.4459	1.0592	1.0292
No log	0.9286	26	1.0018	0.4955	1.0018	1.0009
No log	1.0	28	1.0272	0.5231	1.0272	1.0135
No log	1.0714	30	1.1914	0.5004	1.1914	1.0915
No log	1.1429	32	1.3147	0.4705	1.3147	1.1466
No log	1.2143	34	1.2367	0.4782	1.2367	1.1121
No log	1.2857	36	1.0628	0.5201	1.0628	1.0309
No log	1.3571	38	1.0127	0.5331	1.0127	1.0063
No log	1.4286	40	1.0475	0.5118	1.0475	1.0235
No log	1.5	42	1.1102	0.4928	1.1102	1.0537
No log	1.5714	44	1.1002	0.5070	1.1002	1.0489
No log	1.6429	46	0.9268	0.5896	0.9268	0.9627
No log	1.7143	48	0.7742	0.6174	0.7742	0.8799
No log	1.7857	50	0.7759	0.6513	0.7759	0.8809
No log	1.8571	52	0.8567	0.6239	0.8567	0.9256
No log	1.9286	54	1.1391	0.5176	1.1391	1.0673
No log	2.0	56	1.2528	0.5164	1.2528	1.1193
No log	2.0714	58	1.0913	0.5367	1.0913	1.0446
No log	2.1429	60	0.8079	0.6279	0.8079	0.8989
No log	2.2143	62	0.6569	0.6497	0.6569	0.8105
No log	2.2857	64	0.6442	0.6632	0.6442	0.8026
No log	2.3571	66	0.6571	0.6541	0.6571	0.8106
No log	2.4286	68	0.6973	0.6740	0.6973	0.8351
No log	2.5	70	0.7474	0.6446	0.7474	0.8645
No log	2.5714	72	0.8346	0.5862	0.8346	0.9136
No log	2.6429	74	0.8192	0.6107	0.8192	0.9051
No log	2.7143	76	0.7522	0.6480	0.7522	0.8673
No log	2.7857	78	0.7311	0.6757	0.7311	0.8550
No log	2.8571	80	0.7688	0.6735	0.7688	0.8768
No log	2.9286	82	0.8615	0.5976	0.8615	0.9282
No log	3.0	84	0.8986	0.5932	0.8986	0.9480
No log	3.0714	86	0.8393	0.6193	0.8393	0.9161
No log	3.1429	88	0.7563	0.6894	0.7563	0.8697
No log	3.2143	90	0.7028	0.6871	0.7028	0.8383
No log	3.2857	92	0.7335	0.7051	0.7335	0.8564
No log	3.3571	94	0.8244	0.6646	0.8244	0.9080
No log	3.4286	96	0.8799	0.6343	0.8799	0.9380
No log	3.5	98	0.7875	0.6878	0.7875	0.8874
No log	3.5714	100	0.6710	0.7243	0.6710	0.8192
No log	3.6429	102	0.6259	0.7489	0.6259	0.7911
No log	3.7143	104	0.6077	0.7396	0.6077	0.7795
No log	3.7857	106	0.6853	0.7106	0.6853	0.8278
No log	3.8571	108	0.8299	0.6213	0.8299	0.9110
No log	3.9286	110	0.8413	0.6244	0.8413	0.9172
No log	4.0	112	0.7981	0.6556	0.7981	0.8934
No log	4.0714	114	0.7221	0.6752	0.7221	0.8497
No log	4.1429	116	0.6393	0.7194	0.6393	0.7995
No log	4.2143	118	0.6168	0.7118	0.6168	0.7853
No log	4.2857	120	0.6770	0.7195	0.6770	0.8228
No log	4.3571	122	0.8401	0.6371	0.8401	0.9165
No log	4.4286	124	1.0599	0.5936	1.0599	1.0295
No log	4.5	126	1.0310	0.6040	1.0310	1.0154
No log	4.5714	128	0.8568	0.6581	0.8568	0.9256
No log	4.6429	130	0.6440	0.7278	0.6440	0.8025
No log	4.7143	132	0.5798	0.7200	0.5798	0.7615
No log	4.7857	134	0.5754	0.7113	0.5754	0.7586
No log	4.8571	136	0.5675	0.7397	0.5675	0.7533
No log	4.9286	138	0.5817	0.7112	0.5817	0.7627
No log	5.0	140	0.6440	0.7299	0.6440	0.8025
No log	5.0714	142	0.7763	0.6647	0.7763	0.8811
No log	5.1429	144	0.7493	0.6729	0.7493	0.8656
No log	5.2143	146	0.6782	0.7063	0.6782	0.8235
No log	5.2857	148	0.6360	0.7229	0.6360	0.7975
No log	5.3571	150	0.6207	0.6962	0.6207	0.7879
No log	5.4286	152	0.6823	0.7063	0.6823	0.8260
No log	5.5	154	0.7928	0.7030	0.7928	0.8904
No log	5.5714	156	0.8564	0.6545	0.8564	0.9254
No log	5.6429	158	0.7448	0.6958	0.7448	0.8630
No log	5.7143	160	0.6050	0.6998	0.6050	0.7778
No log	5.7857	162	0.6130	0.6939	0.6130	0.7830
No log	5.8571	164	0.6169	0.7009	0.6169	0.7855
No log	5.9286	166	0.6224	0.7063	0.6224	0.7889
No log	6.0	168	0.7283	0.6931	0.7283	0.8534
No log	6.0714	170	0.7789	0.7021	0.7789	0.8826
No log	6.1429	172	0.7136	0.6980	0.7136	0.8448
No log	6.2143	174	0.6225	0.7095	0.6225	0.7890
No log	6.2857	176	0.6250	0.7203	0.6250	0.7906
No log	6.3571	178	0.6209	0.7144	0.6209	0.7880
No log	6.4286	180	0.6139	0.7126	0.6139	0.7835
No log	6.5	182	0.7773	0.7060	0.7773	0.8817
No log	6.5714	184	0.9176	0.6658	0.9176	0.9579
No log	6.6429	186	0.8602	0.6833	0.8602	0.9274
No log	6.7143	188	0.7305	0.7126	0.7305	0.8547
No log	6.7857	190	0.6352	0.7176	0.6352	0.7970
No log	6.8571	192	0.6202	0.7241	0.6202	0.7875
No log	6.9286	194	0.5992	0.7272	0.5992	0.7741
No log	7.0	196	0.6246	0.7330	0.6246	0.7903
No log	7.0714	198	0.6297	0.7351	0.6297	0.7935
No log	7.1429	200	0.6211	0.7284	0.6211	0.7881
No log	7.2143	202	0.6382	0.7	0.6382	0.7989
No log	7.2857	204	0.7054	0.6987	0.7054	0.8399
No log	7.3571	206	0.7697	0.6984	0.7697	0.8773
No log	7.4286	208	0.6903	0.7211	0.6903	0.8308
No log	7.5	210	0.6227	0.6982	0.6227	0.7891
No log	7.5714	212	0.6286	0.6926	0.6286	0.7929
No log	7.6429	214	0.6055	0.7008	0.6055	0.7781
No log	7.7143	216	0.6086	0.7244	0.6086	0.7802
No log	7.7857	218	0.6243	0.7217	0.6243	0.7901
No log	7.8571	220	0.6061	0.7038	0.6061	0.7785
No log	7.9286	222	0.6152	0.6932	0.6152	0.7843
No log	8.0	224	0.7232	0.6803	0.7232	0.8504
No log	8.0714	226	0.8156	0.6908	0.8156	0.9031
No log	8.1429	228	0.7415	0.6847	0.7415	0.8611
No log	8.2143	230	0.6951	0.6599	0.6951	0.8337
No log	8.2857	232	0.6617	0.6931	0.6617	0.8135
No log	8.3571	234	0.6536	0.7242	0.6536	0.8085
No log	8.4286	236	0.6675	0.7232	0.6675	0.8170
No log	8.5	238	0.6813	0.7299	0.6813	0.8254
No log	8.5714	240	0.7229	0.6954	0.7229	0.8502
No log	8.6429	242	0.7115	0.7076	0.7115	0.8435
No log	8.7143	244	0.6740	0.7352	0.6740	0.8210
No log	8.7857	246	0.6654	0.7316	0.6654	0.8157
No log	8.8571	248	0.6787	0.7378	0.6787	0.8239
No log	8.9286	250	0.6883	0.7367	0.6883	0.8296
No log	9.0	252	0.6956	0.7362	0.6956	0.8340
No log	9.0714	254	0.6599	0.7332	0.6599	0.8123
No log	9.1429	256	0.6553	0.7332	0.6553	0.8095
No log	9.2143	258	0.6763	0.7228	0.6763	0.8224
No log	9.2857	260	0.7119	0.7089	0.7119	0.8437
No log	9.3571	262	0.7901	0.6745	0.7901	0.8889
No log	9.4286	264	0.7323	0.7042	0.7323	0.8557
No log	9.5	266	0.6588	0.7029	0.6588	0.8117
No log	9.5714	268	0.6641	0.6773	0.6641	0.8149
No log	9.6429	270	0.7178	0.6481	0.7178	0.8472
No log	9.7143	272	0.6858	0.6889	0.6858	0.8282
No log	9.7857	274	0.6565	0.7105	0.6565	0.8102
No log	9.8571	276	0.6547	0.7096	0.6547	0.8091
No log	9.9286	278	0.6441	0.7072	0.6441	0.8026
No log	10.0	280	0.6449	0.7229	0.6449	0.8030
No log	10.0714	282	0.6628	0.7152	0.6628	0.8141
No log	10.1429	284	0.6631	0.7202	0.6631	0.8143
No log	10.2143	286	0.6644	0.7142	0.6644	0.8151
No log	10.2857	288	0.6791	0.6954	0.6791	0.8240
No log	10.3571	290	0.6834	0.7343	0.6834	0.8267
No log	10.4286	292	0.6997	0.7197	0.6997	0.8365
No log	10.5	294	0.7157	0.7221	0.7157	0.8460
No log	10.5714	296	0.6912	0.7318	0.6912	0.8314
No log	10.6429	298	0.6903	0.6995	0.6903	0.8308
No log	10.7143	300	0.6979	0.6712	0.6979	0.8354
No log	10.7857	302	0.6860	0.6758	0.6860	0.8283
No log	10.8571	304	0.6671	0.7163	0.6671	0.8168
No log	10.9286	306	0.6668	0.7070	0.6668	0.8166
No log	11.0	308	0.6733	0.7059	0.6733	0.8206
No log	11.0714	310	0.6663	0.7059	0.6663	0.8163
No log	11.1429	312	0.6657	0.7185	0.6657	0.8159
No log	11.2143	314	0.7205	0.6874	0.7205	0.8488
No log	11.2857	316	0.7350	0.6737	0.7350	0.8573
No log	11.3571	318	0.6856	0.7064	0.6856	0.8280
No log	11.4286	320	0.6943	0.7012	0.6943	0.8332
No log	11.5	322	0.6981	0.6969	0.6981	0.8355
No log	11.5714	324	0.6846	0.6897	0.6846	0.8274
No log	11.6429	326	0.6970	0.6978	0.6970	0.8348
No log	11.7143	328	0.7278	0.6783	0.7278	0.8531
No log	11.7857	330	0.7889	0.6795	0.7889	0.8882
No log	11.8571	332	0.7700	0.6659	0.7700	0.8775
No log	11.9286	334	0.7448	0.7075	0.7448	0.8630
No log	12.0	336	0.7531	0.7109	0.7531	0.8678
No log	12.0714	338	0.7549	0.6917	0.7549	0.8689
No log	12.1429	340	0.7600	0.7080	0.7600	0.8718
No log	12.2143	342	0.7482	0.6915	0.7482	0.8650
No log	12.2857	344	0.7405	0.6852	0.7405	0.8605
No log	12.3571	346	0.7438	0.6797	0.7438	0.8625
No log	12.4286	348	0.7841	0.6584	0.7841	0.8855
No log	12.5	350	0.7832	0.6601	0.7832	0.8850
No log	12.5714	352	0.7249	0.6912	0.7249	0.8514
No log	12.6429	354	0.7951	0.6763	0.7951	0.8917
No log	12.7143	356	0.9158	0.6285	0.9158	0.9569
No log	12.7857	358	0.8918	0.6374	0.8918	0.9444
No log	12.8571	360	0.7862	0.6861	0.7862	0.8867
No log	12.9286	362	0.7284	0.6523	0.7284	0.8534
No log	13.0	364	0.8196	0.6937	0.8196	0.9053
No log	13.0714	366	0.8331	0.6690	0.8331	0.9128
No log	13.1429	368	0.7452	0.6346	0.7452	0.8632
No log	13.2143	370	0.7432	0.6604	0.7432	0.8621
No log	13.2857	372	0.8949	0.6351	0.8949	0.9460
No log	13.3571	374	0.9375	0.6263	0.9375	0.9682
No log	13.4286	376	0.8456	0.6420	0.8456	0.9196
No log	13.5	378	0.7332	0.6789	0.7332	0.8563
No log	13.5714	380	0.7414	0.6580	0.7414	0.8611
No log	13.6429	382	0.7738	0.6734	0.7738	0.8797
No log	13.7143	384	0.7475	0.6754	0.7475	0.8646
No log	13.7857	386	0.7431	0.6800	0.7431	0.8620
No log	13.8571	388	0.7693	0.6756	0.7693	0.8771
No log	13.9286	390	0.7724	0.6712	0.7724	0.8789
No log	14.0	392	0.7617	0.6790	0.7617	0.8728
No log	14.0714	394	0.7471	0.6933	0.7471	0.8644
No log	14.1429	396	0.7505	0.6702	0.7505	0.8663
No log	14.2143	398	0.7622	0.6786	0.7622	0.8730
No log	14.2857	400	0.7217	0.6754	0.7217	0.8496
No log	14.3571	402	0.7315	0.6999	0.7315	0.8553
No log	14.4286	404	0.7871	0.6775	0.7871	0.8872
No log	14.5	406	0.8397	0.6454	0.8397	0.9163
No log	14.5714	408	0.7845	0.6910	0.7845	0.8857
No log	14.6429	410	0.7307	0.7066	0.7307	0.8548
No log	14.7143	412	0.6950	0.6940	0.6950	0.8337
No log	14.7857	414	0.6994	0.6732	0.6994	0.8363
No log	14.8571	416	0.6956	0.6698	0.6956	0.8340
No log	14.9286	418	0.6957	0.6828	0.6957	0.8341
No log	15.0	420	0.7152	0.6528	0.7152	0.8457
No log	15.0714	422	0.7603	0.7004	0.7603	0.8720
No log	15.1429	424	0.7364	0.6732	0.7364	0.8581
No log	15.2143	426	0.6839	0.6695	0.6839	0.8270
No log	15.2857	428	0.6883	0.6648	0.6883	0.8296
No log	15.3571	430	0.6818	0.6724	0.6818	0.8257
No log	15.4286	432	0.6837	0.6849	0.6837	0.8269
No log	15.5	434	0.6812	0.6747	0.6812	0.8253
No log	15.5714	436	0.6831	0.6703	0.6831	0.8265
No log	15.6429	438	0.6906	0.6811	0.6906	0.8310
No log	15.7143	440	0.6851	0.6902	0.6851	0.8277
No log	15.7857	442	0.6859	0.6802	0.6859	0.8282
No log	15.8571	444	0.6966	0.6737	0.6966	0.8346
No log	15.9286	446	0.7264	0.6908	0.7264	0.8523
No log	16.0	448	0.7442	0.7066	0.7442	0.8626
No log	16.0714	450	0.7432	0.7027	0.7432	0.8621
No log	16.1429	452	0.7487	0.7123	0.7487	0.8653
No log	16.2143	454	0.7269	0.6890	0.7269	0.8526
No log	16.2857	456	0.7029	0.6881	0.7029	0.8384
No log	16.3571	458	0.7050	0.6908	0.7050	0.8396
No log	16.4286	460	0.6885	0.6786	0.6885	0.8298
No log	16.5	462	0.6929	0.6889	0.6929	0.8324
No log	16.5714	464	0.7145	0.6736	0.7145	0.8453
No log	16.6429	466	0.6943	0.6705	0.6943	0.8332
No log	16.7143	468	0.6725	0.6782	0.6725	0.8201
No log	16.7857	470	0.7058	0.6726	0.7058	0.8401
No log	16.8571	472	0.7237	0.6908	0.7237	0.8507
No log	16.9286	474	0.6992	0.6854	0.6992	0.8362
No log	17.0	476	0.7069	0.6599	0.7069	0.8408
No log	17.0714	478	0.7398	0.6625	0.7398	0.8601
No log	17.1429	480	0.7483	0.6625	0.7483	0.8650
No log	17.2143	482	0.7081	0.6804	0.7081	0.8415
No log	17.2857	484	0.7103	0.6693	0.7103	0.8428
No log	17.3571	486	0.7337	0.6872	0.7337	0.8566
No log	17.4286	488	0.7109	0.6820	0.7109	0.8431
No log	17.5	490	0.7177	0.7054	0.7177	0.8472
No log	17.5714	492	0.7394	0.7059	0.7394	0.8599
No log	17.6429	494	0.7103	0.6981	0.7103	0.8428
No log	17.7143	496	0.7006	0.6770	0.7006	0.8370
No log	17.7857	498	0.7022	0.6766	0.7022	0.8380
0.5868	17.8571	500	0.6957	0.6770	0.6957	0.8341
0.5868	17.9286	502	0.7018	0.6983	0.7018	0.8378
0.5868	18.0	504	0.7011	0.6933	0.7011	0.8373
0.5868	18.0714	506	0.6970	0.6939	0.6970	0.8349
0.5868	18.1429	508	0.6851	0.6632	0.6851	0.8277
0.5868	18.2143	510	0.6830	0.6614	0.6830	0.8264
0.5868	18.2857	512	0.6864	0.6516	0.6864	0.8285
0.5868	18.3571	514	0.6920	0.6508	0.6920	0.8319
0.5868	18.4286	516	0.7139	0.6868	0.7139	0.8449
0.5868	18.5	518	0.7303	0.7013	0.7303	0.8546
0.5868	18.5714	520	0.7222	0.6597	0.7222	0.8498
0.5868	18.6429	522	0.7155	0.6437	0.7155	0.8459
0.5868	18.7143	524	0.7284	0.6424	0.7284	0.8535
0.5868	18.7857	526	0.7259	0.6408	0.7259	0.8520
0.5868	18.8571	528	0.7288	0.6475	0.7288	0.8537

Framework versions

Transformers 4.44.2
Pytorch 2.4.1+cu121
Datasets 3.2.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 24, 2024
Updated: Dec 24, 2024