ArabicNewSplits6_FineTuningAraBERTFreeze_run3_AugV5_k2_task1_organization

MayBashendy/ArabicNewSplits6_FineTuningAraBERTFreeze_run3_AugV5_k2_task1_organization

ArabicNewSplits6_FineTuningAraBERTFreeze_run3_AugV5_k2_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

42% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 23, 2024
Updated: Dec 23, 2024
SHA: 59a08b33

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits6_FineTuningAraBERTFreeze_run3_AugV5_k2_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.8562
Qwk: 0.6133
Mse: 0.8562
Rmse: 0.9253

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 16
eval_batch_size: 16
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2857	2	7.9230	-0.0516	7.9230	2.8148
No log	0.5714	4	5.6989	-0.0383	5.6989	2.3872
No log	0.8571	6	3.9845	0.0230	3.9845	1.9961
No log	1.1429	8	2.9735	0.0996	2.9735	1.7244
No log	1.4286	10	2.3212	0.1775	2.3212	1.5235
No log	1.7143	12	1.7468	0.1452	1.7468	1.3217
No log	2.0	14	1.3470	0.2968	1.3470	1.1606
No log	2.2857	16	1.1559	0.4496	1.1559	1.0751
No log	2.5714	18	1.0418	0.4447	1.0418	1.0207
No log	2.8571	20	0.9900	0.4195	0.9900	0.9950
No log	3.1429	22	0.9516	0.4176	0.9516	0.9755
No log	3.4286	24	0.9305	0.4543	0.9305	0.9646
No log	3.7143	26	0.9566	0.4636	0.9566	0.9780
No log	4.0	28	0.9307	0.5019	0.9307	0.9647
No log	4.2857	30	0.8596	0.5110	0.8596	0.9271
No log	4.5714	32	0.8371	0.5417	0.8371	0.9149
No log	4.8571	34	0.8418	0.5834	0.8418	0.9175
No log	5.1429	36	0.8522	0.5810	0.8522	0.9232
No log	5.4286	38	0.8326	0.6051	0.8326	0.9125
No log	5.7143	40	0.8331	0.5948	0.8331	0.9127
No log	6.0	42	0.8663	0.6102	0.8663	0.9307
No log	6.2857	44	0.9908	0.5821	0.9908	0.9954
No log	6.5714	46	1.0594	0.5444	1.0594	1.0293
No log	6.8571	48	0.9426	0.5945	0.9426	0.9709
No log	7.1429	50	0.8648	0.6251	0.8648	0.9299
No log	7.4286	52	0.8724	0.6267	0.8724	0.9340
No log	7.7143	54	0.8156	0.6445	0.8156	0.9031
No log	8.0	56	0.7829	0.6720	0.7829	0.8848
No log	8.2857	58	0.7544	0.6908	0.7544	0.8686
No log	8.5714	60	0.7504	0.6952	0.7504	0.8663
No log	8.8571	62	0.7270	0.6946	0.7270	0.8526
No log	9.1429	64	0.6976	0.7035	0.6976	0.8353
No log	9.4286	66	0.7008	0.7021	0.7008	0.8372
No log	9.7143	68	0.7009	0.7021	0.7009	0.8372
No log	10.0	70	0.7048	0.6983	0.7048	0.8395
No log	10.2857	72	0.7497	0.6842	0.7497	0.8659
No log	10.5714	74	0.8146	0.6634	0.8146	0.9025
No log	10.8571	76	0.7883	0.6795	0.7883	0.8879
No log	11.1429	78	0.7424	0.7249	0.7424	0.8616
No log	11.4286	80	0.7416	0.7150	0.7416	0.8612
No log	11.7143	82	0.7684	0.6929	0.7684	0.8766
No log	12.0	84	0.7670	0.7020	0.7670	0.8758
No log	12.2857	86	0.7853	0.6852	0.7853	0.8862
No log	12.5714	88	0.8390	0.6572	0.8390	0.9160
No log	12.8571	90	0.8309	0.6675	0.8309	0.9115
No log	13.1429	92	0.7627	0.6852	0.7627	0.8733
No log	13.4286	94	0.7525	0.6793	0.7525	0.8675
No log	13.7143	96	0.7608	0.6750	0.7608	0.8722
No log	14.0	98	0.7489	0.7007	0.7489	0.8654
No log	14.2857	100	0.7547	0.7079	0.7547	0.8687
No log	14.5714	102	0.7964	0.6937	0.7964	0.8924
No log	14.8571	104	0.8834	0.6533	0.8834	0.9399
No log	15.1429	106	0.8632	0.6630	0.8632	0.9291
No log	15.4286	108	0.7806	0.6771	0.7806	0.8835
No log	15.7143	110	0.7533	0.7134	0.7533	0.8679
No log	16.0	112	0.7455	0.6977	0.7455	0.8634
No log	16.2857	114	0.7411	0.7118	0.7411	0.8609
No log	16.5714	116	0.7710	0.6741	0.7710	0.8781
No log	16.8571	118	0.8753	0.6229	0.8753	0.9356
No log	17.1429	120	0.8933	0.6237	0.8933	0.9451
No log	17.4286	122	0.8011	0.6518	0.8011	0.8950
No log	17.7143	124	0.7202	0.7028	0.7202	0.8486
No log	18.0	126	0.7194	0.7285	0.7194	0.8482
No log	18.2857	128	0.7211	0.7227	0.7211	0.8492
No log	18.5714	130	0.7517	0.6894	0.7517	0.8670
No log	18.8571	132	0.8439	0.6573	0.8439	0.9187
No log	19.1429	134	0.8726	0.6465	0.8726	0.9341
No log	19.4286	136	0.8044	0.6665	0.8044	0.8969
No log	19.7143	138	0.7252	0.6948	0.7252	0.8516
No log	20.0	140	0.7282	0.7091	0.7282	0.8533
No log	20.2857	142	0.7370	0.7128	0.7370	0.8585
No log	20.5714	144	0.7236	0.7262	0.7236	0.8506
No log	20.8571	146	0.7340	0.6815	0.7340	0.8567
No log	21.1429	148	0.7467	0.6753	0.7467	0.8641
No log	21.4286	150	0.7425	0.6743	0.7425	0.8617
No log	21.7143	152	0.7183	0.7092	0.7183	0.8475
No log	22.0	154	0.7356	0.7070	0.7356	0.8577
No log	22.2857	156	0.7463	0.6987	0.7463	0.8639
No log	22.5714	158	0.7496	0.6632	0.7496	0.8658
No log	22.8571	160	0.7741	0.6907	0.7741	0.8799
No log	23.1429	162	0.8304	0.6584	0.8304	0.9113
No log	23.4286	164	0.8354	0.6610	0.8354	0.9140
No log	23.7143	166	0.8029	0.6719	0.8029	0.8961
No log	24.0	168	0.7959	0.6629	0.7959	0.8921
No log	24.2857	170	0.7994	0.6569	0.7994	0.8941
No log	24.5714	172	0.8050	0.6786	0.8050	0.8972
No log	24.8571	174	0.8135	0.6786	0.8135	0.9020
No log	25.1429	176	0.8208	0.6586	0.8208	0.9060
No log	25.4286	178	0.8181	0.6657	0.8181	0.9045
No log	25.7143	180	0.8355	0.6634	0.8355	0.9140
No log	26.0	182	0.8332	0.6634	0.8332	0.9128
No log	26.2857	184	0.8089	0.6841	0.8089	0.8994
No log	26.5714	186	0.7969	0.6841	0.7969	0.8927
No log	26.8571	188	0.7818	0.6685	0.7818	0.8842
No log	27.1429	190	0.7885	0.6706	0.7885	0.8879
No log	27.4286	192	0.8003	0.6405	0.8003	0.8946
No log	27.7143	194	0.8131	0.6399	0.8131	0.9017
No log	28.0	196	0.8129	0.6399	0.8129	0.9016
No log	28.2857	198	0.8123	0.6419	0.8123	0.9013
No log	28.5714	200	0.8136	0.6503	0.8136	0.9020
No log	28.8571	202	0.8370	0.6505	0.8370	0.9149
No log	29.1429	204	0.8462	0.6566	0.8462	0.9199
No log	29.4286	206	0.8344	0.6295	0.8344	0.9135
No log	29.7143	208	0.8400	0.6377	0.8400	0.9165
No log	30.0	210	0.8579	0.6336	0.8579	0.9263
No log	30.2857	212	0.8637	0.6247	0.8637	0.9294
No log	30.5714	214	0.8691	0.6274	0.8691	0.9322
No log	30.8571	216	0.8721	0.6329	0.8721	0.9339
No log	31.1429	218	0.8698	0.6230	0.8698	0.9326
No log	31.4286	220	0.8722	0.6222	0.8722	0.9339
No log	31.7143	222	0.8663	0.6265	0.8663	0.9307
No log	32.0	224	0.8567	0.6390	0.8567	0.9256
No log	32.2857	226	0.8476	0.6507	0.8476	0.9207
No log	32.5714	228	0.8411	0.6306	0.8411	0.9171
No log	32.8571	230	0.8434	0.6436	0.8434	0.9184
No log	33.1429	232	0.8424	0.6298	0.8424	0.9178
No log	33.4286	234	0.8371	0.6426	0.8371	0.9149
No log	33.7143	236	0.8382	0.6503	0.8382	0.9155
No log	34.0	238	0.8384	0.6446	0.8384	0.9156
No log	34.2857	240	0.8494	0.6441	0.8494	0.9216
No log	34.5714	242	0.8854	0.6378	0.8854	0.9409
No log	34.8571	244	0.9002	0.6212	0.9002	0.9488
No log	35.1429	246	0.8766	0.6342	0.8766	0.9363
No log	35.4286	248	0.8419	0.6495	0.8419	0.9176
No log	35.7143	250	0.8312	0.6579	0.8312	0.9117
No log	36.0	252	0.8306	0.6876	0.8306	0.9114
No log	36.2857	254	0.8335	0.6782	0.8335	0.9130
No log	36.5714	256	0.8387	0.6707	0.8387	0.9158
No log	36.8571	258	0.8601	0.6620	0.8601	0.9274
No log	37.1429	260	0.9044	0.6567	0.9044	0.9510
No log	37.4286	262	0.9043	0.6609	0.9043	0.9510
No log	37.7143	264	0.8735	0.6423	0.8735	0.9346
No log	38.0	266	0.8303	0.6487	0.8303	0.9112
No log	38.2857	268	0.8158	0.7045	0.8158	0.9032
No log	38.5714	270	0.8080	0.6652	0.8080	0.8989
No log	38.8571	272	0.8009	0.6531	0.8009	0.8949
No log	39.1429	274	0.8024	0.6463	0.8024	0.8958
No log	39.4286	276	0.8020	0.6233	0.8020	0.8955
No log	39.7143	278	0.8125	0.6451	0.8125	0.9014
No log	40.0	280	0.8257	0.6451	0.8257	0.9087
No log	40.2857	282	0.8272	0.6429	0.8272	0.9095
No log	40.5714	284	0.8323	0.6319	0.8323	0.9123
No log	40.8571	286	0.8505	0.6587	0.8505	0.9222
No log	41.1429	288	0.8604	0.6629	0.8604	0.9276
No log	41.4286	290	0.8543	0.6500	0.8543	0.9243
No log	41.7143	292	0.8801	0.6165	0.8801	0.9382
No log	42.0	294	0.9152	0.6193	0.9152	0.9567
No log	42.2857	296	0.9427	0.6190	0.9427	0.9709
No log	42.5714	298	0.9278	0.6204	0.9278	0.9632
No log	42.8571	300	0.8708	0.6321	0.8708	0.9332
No log	43.1429	302	0.8083	0.6410	0.8083	0.8990
No log	43.4286	304	0.7912	0.6854	0.7912	0.8895
No log	43.7143	306	0.7919	0.6681	0.7919	0.8899
No log	44.0	308	0.7908	0.6681	0.7908	0.8893
No log	44.2857	310	0.7884	0.6497	0.7884	0.8879
No log	44.5714	312	0.8132	0.6220	0.8132	0.9018
No log	44.8571	314	0.8507	0.6321	0.8507	0.9223
No log	45.1429	316	0.8818	0.6456	0.8818	0.9390
No log	45.4286	318	0.8677	0.6321	0.8677	0.9315
No log	45.7143	320	0.8406	0.6449	0.8406	0.9168
No log	46.0	322	0.8315	0.6175	0.8315	0.9119
No log	46.2857	324	0.8297	0.6534	0.8297	0.9109
No log	46.5714	326	0.8447	0.6150	0.8447	0.9191
No log	46.8571	328	0.8737	0.6157	0.8737	0.9347
No log	47.1429	330	0.9223	0.6417	0.9223	0.9603
No log	47.4286	332	0.9403	0.6347	0.9403	0.9697
No log	47.7143	334	0.9160	0.6355	0.9160	0.9571
No log	48.0	336	0.8926	0.6284	0.8926	0.9448
No log	48.2857	338	0.8710	0.6142	0.8710	0.9332
No log	48.5714	340	0.8521	0.6232	0.8521	0.9231
No log	48.8571	342	0.8475	0.6246	0.8475	0.9206
No log	49.1429	344	0.8599	0.6246	0.8599	0.9273
No log	49.4286	346	0.8574	0.6246	0.8574	0.9259
No log	49.7143	348	0.8652	0.6218	0.8652	0.9302
No log	50.0	350	0.8927	0.6160	0.8927	0.9448
No log	50.2857	352	0.9029	0.6263	0.9029	0.9502
No log	50.5714	354	0.8890	0.6141	0.8890	0.9429
No log	50.8571	356	0.8798	0.6084	0.8798	0.9380
No log	51.1429	358	0.8911	0.6138	0.8911	0.9440
No log	51.4286	360	0.9183	0.6222	0.9183	0.9583
No log	51.7143	362	0.9185	0.6317	0.9185	0.9584
No log	52.0	364	0.9231	0.6116	0.9231	0.9608
No log	52.2857	366	0.9209	0.6116	0.9209	0.9596
No log	52.5714	368	0.8974	0.6217	0.8974	0.9473
No log	52.8571	370	0.8679	0.6169	0.8679	0.9316
No log	53.1429	372	0.8561	0.6241	0.8561	0.9252
No log	53.4286	374	0.8609	0.6365	0.8609	0.9279
No log	53.7143	376	0.8713	0.6084	0.8713	0.9335
No log	54.0	378	0.8930	0.6334	0.8930	0.9450
No log	54.2857	380	0.8925	0.6228	0.8925	0.9447
No log	54.5714	382	0.8810	0.6050	0.8810	0.9386
No log	54.8571	384	0.8758	0.6063	0.8758	0.9358
No log	55.1429	386	0.8683	0.6354	0.8683	0.9318
No log	55.4286	388	0.8712	0.6340	0.8712	0.9334
No log	55.7143	390	0.8774	0.6276	0.8774	0.9367
No log	56.0	392	0.8835	0.6139	0.8835	0.9400
No log	56.2857	394	0.8741	0.6122	0.8741	0.9350
No log	56.5714	396	0.8618	0.6249	0.8618	0.9284
No log	56.8571	398	0.8593	0.6249	0.8593	0.9270
No log	57.1429	400	0.8595	0.6212	0.8595	0.9271
No log	57.4286	402	0.8730	0.5965	0.8730	0.9343
No log	57.7143	404	0.9014	0.6190	0.9014	0.9494
No log	58.0	406	0.9217	0.6310	0.9217	0.9600
No log	58.2857	408	0.9109	0.6310	0.9109	0.9544
No log	58.5714	410	0.8794	0.6150	0.8794	0.9378
No log	58.8571	412	0.8466	0.6258	0.8466	0.9201
No log	59.1429	414	0.8386	0.6243	0.8386	0.9157
No log	59.4286	416	0.8435	0.6243	0.8435	0.9184
No log	59.7143	418	0.8569	0.6033	0.8569	0.9257
No log	60.0	420	0.8813	0.6119	0.8813	0.9388
No log	60.2857	422	0.8997	0.6193	0.8997	0.9486
No log	60.5714	424	0.8997	0.6158	0.8997	0.9485
No log	60.8571	426	0.8960	0.6158	0.8960	0.9466
No log	61.1429	428	0.8694	0.5977	0.8694	0.9324
No log	61.4286	430	0.8514	0.6105	0.8514	0.9227
No log	61.7143	432	0.8412	0.6246	0.8412	0.9172
No log	62.0	434	0.8331	0.6458	0.8331	0.9128
No log	62.2857	436	0.8413	0.6246	0.8413	0.9172
No log	62.5714	438	0.8582	0.6231	0.8582	0.9264
No log	62.8571	440	0.8854	0.6132	0.8854	0.9409
No log	63.1429	442	0.9138	0.6190	0.9138	0.9559
No log	63.4286	444	0.9213	0.6190	0.9213	0.9598
No log	63.7143	446	0.9139	0.6012	0.9139	0.9560
No log	64.0	448	0.9201	0.6000	0.9201	0.9592
No log	64.2857	450	0.9168	0.6000	0.9168	0.9575
No log	64.5714	452	0.9216	0.6050	0.9216	0.9600
No log	64.8571	454	0.9061	0.6124	0.9061	0.9519
No log	65.1429	456	0.8776	0.6048	0.8776	0.9368
No log	65.4286	458	0.8680	0.6158	0.8680	0.9317
No log	65.7143	460	0.8597	0.6215	0.8597	0.9272
No log	66.0	462	0.8591	0.6127	0.8591	0.9269
No log	66.2857	464	0.8623	0.6114	0.8623	0.9286
No log	66.5714	466	0.8661	0.6114	0.8661	0.9306
No log	66.8571	468	0.8784	0.6185	0.8784	0.9372
No log	67.1429	470	0.8908	0.6158	0.8908	0.9438
No log	67.4286	472	0.9072	0.6158	0.9072	0.9525
No log	67.7143	474	0.9004	0.6064	0.9004	0.9489
No log	68.0	476	0.8786	0.6050	0.8786	0.9373
No log	68.2857	478	0.8625	0.6067	0.8625	0.9287
No log	68.5714	480	0.8661	0.6025	0.8661	0.9306
No log	68.8571	482	0.8850	0.6230	0.8850	0.9407
No log	69.1429	484	0.9167	0.6128	0.9167	0.9575
No log	69.4286	486	0.9446	0.6090	0.9446	0.9719
No log	69.7143	488	0.9429	0.6090	0.9429	0.9710
No log	70.0	490	0.9215	0.6146	0.9215	0.9599
No log	70.2857	492	0.8909	0.6191	0.8909	0.9439
No log	70.5714	494	0.8771	0.6275	0.8771	0.9365
No log	70.8571	496	0.8814	0.6310	0.8814	0.9388
No log	71.1429	498	0.8853	0.6181	0.8853	0.9409
0.4502	71.4286	500	0.8951	0.6230	0.8951	0.9461
0.4502	71.7143	502	0.8901	0.6230	0.8901	0.9434
0.4502	72.0	504	0.8770	0.6132	0.8770	0.9365
0.4502	72.2857	506	0.8711	0.6003	0.8711	0.9333
0.4502	72.5714	508	0.8643	0.6120	0.8643	0.9297
0.4502	72.8571	510	0.8562	0.6133	0.8562	0.9253

Framework versions

Transformers 4.44.2
Pytorch 2.4.1+cu121
Datasets 3.2.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 23, 2024
Updated: Dec 23, 2024