ArabicNewSplits3_FineTuningAraBERT_run2_AugV5_k10_task1_organization

MayBashendy/ArabicNewSplits3_FineTuningAraBERT_run2_AugV5_k10_task1_organization

ArabicNewSplits3_FineTuningAraBERT_run2_AugV5_k10_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

16% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 4, 2024
Updated: Dec 4, 2024
SHA: 0ef62744

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits3_FineTuningAraBERT_run2_AugV5_k10_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.7271
Qwk: 0.6431
Mse: 0.7271
Rmse: 0.8527

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.04	2	4.7660	-0.0151	4.7660	2.1831
No log	0.08	4	2.7800	0.0315	2.7800	1.6673
No log	0.12	6	1.9801	-0.0354	1.9801	1.4072
No log	0.16	8	2.4587	-0.1636	2.4587	1.5680
No log	0.2	10	1.9055	-0.0680	1.9055	1.3804
No log	0.24	12	1.4720	0.1236	1.4720	1.2133
No log	0.28	14	1.3428	0.0493	1.3428	1.1588
No log	0.32	16	1.5088	0.0502	1.5088	1.2283
No log	0.36	18	1.5366	0.0502	1.5366	1.2396
No log	0.4	20	1.3687	0.0502	1.3687	1.1699
No log	0.44	22	1.2149	0.1164	1.2149	1.1022
No log	0.48	24	1.0969	0.3793	1.0969	1.0473
No log	0.52	26	1.0160	0.3696	1.0160	1.0080
No log	0.56	28	1.0119	0.2980	1.0119	1.0059
No log	0.6	30	0.9662	0.3276	0.9662	0.9830
No log	0.64	32	0.8600	0.4438	0.8600	0.9274
No log	0.68	34	0.8412	0.5	0.8412	0.9172
No log	0.72	36	0.9916	0.4527	0.9916	0.9958
No log	0.76	38	1.1141	0.4137	1.1141	1.0555
No log	0.8	40	0.9422	0.4493	0.9422	0.9707
No log	0.84	42	0.7827	0.4852	0.7827	0.8847
No log	0.88	44	0.7817	0.5629	0.7817	0.8841
No log	0.92	46	0.7947	0.5037	0.7947	0.8914
No log	0.96	48	0.8103	0.5037	0.8103	0.9002
No log	1.0	50	0.7784	0.5484	0.7784	0.8823
No log	1.04	52	0.7824	0.5272	0.7824	0.8846
No log	1.08	54	0.7833	0.5629	0.7833	0.8850
No log	1.12	56	0.7761	0.5758	0.7761	0.8810
No log	1.16	58	0.7943	0.5758	0.7943	0.8912
No log	1.2	60	0.7965	0.4897	0.7965	0.8925
No log	1.24	62	0.7978	0.4897	0.7978	0.8932
No log	1.28	64	0.7500	0.5345	0.7500	0.8660
No log	1.32	66	0.7429	0.4875	0.7429	0.8619
No log	1.3600	68	0.7668	0.4897	0.7668	0.8756
No log	1.4	70	0.7577	0.5034	0.7577	0.8705
No log	1.44	72	0.8103	0.5083	0.8103	0.9002
No log	1.48	74	0.8455	0.4873	0.8455	0.9195
No log	1.52	76	0.7940	0.5286	0.7940	0.8910
No log	1.56	78	0.7399	0.6283	0.7399	0.8602
No log	1.6	80	0.7827	0.6419	0.7827	0.8847
No log	1.6400	82	0.7471	0.6322	0.7471	0.8644
No log	1.6800	84	0.7640	0.6801	0.7640	0.8741
No log	1.72	86	0.7978	0.6741	0.7978	0.8932
No log	1.76	88	0.7038	0.6959	0.7038	0.8389
No log	1.8	90	0.6945	0.6743	0.6945	0.8334
No log	1.8400	92	0.6982	0.6927	0.6982	0.8356
No log	1.88	94	0.6950	0.6835	0.6950	0.8336
No log	1.92	96	0.7052	0.7034	0.7052	0.8398
No log	1.96	98	0.6851	0.7130	0.6851	0.8277
No log	2.0	100	0.6280	0.6905	0.6280	0.7925
No log	2.04	102	0.6430	0.6918	0.6430	0.8019
No log	2.08	104	0.6034	0.7133	0.6034	0.7768
No log	2.12	106	0.6815	0.6937	0.6815	0.8255
No log	2.16	108	0.7411	0.5909	0.7411	0.8608
No log	2.2	110	0.6543	0.7132	0.6543	0.8089
No log	2.24	112	0.6510	0.6855	0.6510	0.8069
No log	2.2800	114	0.6789	0.7340	0.6789	0.8240
No log	2.32	116	0.7071	0.6671	0.7071	0.8409
No log	2.36	118	0.6994	0.6712	0.6994	0.8363
No log	2.4	120	0.6608	0.6671	0.6608	0.8129
No log	2.44	122	0.7031	0.6683	0.7031	0.8385
No log	2.48	124	0.5697	0.7165	0.5697	0.7548
No log	2.52	126	0.5652	0.7164	0.5652	0.7518
No log	2.56	128	0.6030	0.6375	0.6030	0.7765
No log	2.6	130	0.5643	0.7317	0.5643	0.7512
No log	2.64	132	0.6556	0.6548	0.6556	0.8097
No log	2.68	134	0.6535	0.6548	0.6535	0.8084
No log	2.7200	136	0.5613	0.7564	0.5613	0.7492
No log	2.76	138	0.5474	0.7515	0.5474	0.7399
No log	2.8	140	0.6650	0.6548	0.6650	0.8155
No log	2.84	142	0.7601	0.6271	0.7601	0.8718
No log	2.88	144	0.7677	0.6480	0.7677	0.8762
No log	2.92	146	0.6482	0.7164	0.6482	0.8051
No log	2.96	148	0.6089	0.7227	0.6089	0.7803
No log	3.0	150	0.7262	0.6548	0.7262	0.8522
No log	3.04	152	0.8609	0.5645	0.8609	0.9278
No log	3.08	154	0.7347	0.6686	0.7347	0.8571
No log	3.12	156	0.6637	0.6814	0.6637	0.8147
No log	3.16	158	0.6927	0.6758	0.6927	0.8323
No log	3.2	160	0.7841	0.5475	0.7841	0.8855
No log	3.24	162	0.7069	0.6686	0.7069	0.8408
No log	3.2800	164	0.7264	0.6548	0.7264	0.8523
No log	3.32	166	0.9499	0.5536	0.9499	0.9746
No log	3.36	168	1.0768	0.5276	1.0768	1.0377
No log	3.4	170	0.9388	0.5536	0.9388	0.9689
No log	3.44	172	0.8987	0.6055	0.8987	0.9480
No log	3.48	174	0.7807	0.7089	0.7807	0.8836
No log	3.52	176	0.6556	0.6228	0.6556	0.8097
No log	3.56	178	0.6231	0.6150	0.6231	0.7894
No log	3.6	180	0.6018	0.7036	0.6018	0.7758
No log	3.64	182	0.6547	0.6587	0.6547	0.8091
No log	3.68	184	0.7934	0.6271	0.7934	0.8907
No log	3.7200	186	0.7408	0.6195	0.7408	0.8607
No log	3.76	188	0.7020	0.6116	0.7020	0.8378
No log	3.8	190	0.6662	0.6653	0.6662	0.8162
No log	3.84	192	0.6191	0.7164	0.6191	0.7868
No log	3.88	194	0.6713	0.7089	0.6713	0.8193
No log	3.92	196	0.8613	0.5276	0.8613	0.9280
No log	3.96	198	1.0149	0.5382	1.0149	1.0074
No log	4.0	200	0.9588	0.5276	0.9588	0.9792
No log	4.04	202	0.8195	0.6410	0.8195	0.9052
No log	4.08	204	0.8184	0.628	0.8184	0.9047
No log	4.12	206	0.8315	0.628	0.8315	0.9119
No log	4.16	208	0.7777	0.6538	0.7777	0.8819
No log	4.2	210	0.7584	0.6829	0.7584	0.8709
No log	4.24	212	0.6918	0.7295	0.6918	0.8317
No log	4.28	214	0.6310	0.7008	0.6310	0.7944
No log	4.32	216	0.6109	0.6710	0.6109	0.7816
No log	4.36	218	0.6074	0.7123	0.6074	0.7793
No log	4.4	220	0.5952	0.7474	0.5952	0.7715
No log	4.44	222	0.5859	0.7474	0.5859	0.7654
No log	4.48	224	0.5857	0.7324	0.5857	0.7653
No log	4.52	226	0.5748	0.7210	0.5748	0.7582
No log	4.5600	228	0.5791	0.7210	0.5791	0.7610
No log	4.6	230	0.5892	0.7051	0.5892	0.7676
No log	4.64	232	0.6281	0.6840	0.6281	0.7925
No log	4.68	234	0.6038	0.6851	0.6038	0.7771
No log	4.72	236	0.5973	0.6851	0.5973	0.7728
No log	4.76	238	0.5714	0.6929	0.5714	0.7559
No log	4.8	240	0.5629	0.6579	0.5629	0.7503
No log	4.84	242	0.5739	0.6433	0.5739	0.7575
No log	4.88	244	0.5526	0.6480	0.5526	0.7434
No log	4.92	246	0.5793	0.6992	0.5793	0.7611
No log	4.96	248	0.6924	0.6431	0.6924	0.8321
No log	5.0	250	0.7459	0.65	0.7459	0.8637
No log	5.04	252	0.6889	0.6478	0.6889	0.8300
No log	5.08	254	0.6208	0.5982	0.6208	0.7879
No log	5.12	256	0.6214	0.5982	0.6214	0.7883
No log	5.16	258	0.6173	0.6468	0.6173	0.7857
No log	5.2	260	0.6087	0.6870	0.6087	0.7802
No log	5.24	262	0.6183	0.6875	0.6183	0.7863
No log	5.28	264	0.6171	0.6875	0.6171	0.7855
No log	5.32	266	0.6106	0.7258	0.6106	0.7814
No log	5.36	268	0.5840	0.6732	0.5840	0.7642
No log	5.4	270	0.5861	0.6616	0.5861	0.7656
No log	5.44	272	0.5901	0.6767	0.5901	0.7682
No log	5.48	274	0.6431	0.6261	0.6431	0.8019
No log	5.52	276	0.7174	0.6154	0.7174	0.8470
No log	5.5600	278	0.6993	0.6176	0.6993	0.8362
No log	5.6	280	0.6613	0.6471	0.6613	0.8132
No log	5.64	282	0.6589	0.6471	0.6589	0.8117
No log	5.68	284	0.6520	0.6471	0.6520	0.8074
No log	5.72	286	0.6918	0.6405	0.6918	0.8318
No log	5.76	288	0.7975	0.6229	0.7975	0.8931
No log	5.8	290	0.8900	0.5808	0.8900	0.9434
No log	5.84	292	0.8896	0.5808	0.8896	0.9432
No log	5.88	294	0.8564	0.5943	0.8564	0.9254
No log	5.92	296	0.7588	0.6473	0.7588	0.8711
No log	5.96	298	0.7119	0.6604	0.7119	0.8437
No log	6.0	300	0.6765	0.6821	0.6765	0.8225
No log	6.04	302	0.6989	0.6689	0.6989	0.8360
No log	6.08	304	0.7631	0.5986	0.7631	0.8736
No log	6.12	306	0.8721	0.5808	0.8721	0.9339
No log	6.16	308	0.8805	0.5808	0.8805	0.9383
No log	6.2	310	0.8079	0.6322	0.8079	0.8988
No log	6.24	312	0.6933	0.6751	0.6933	0.8326
No log	6.28	314	0.6189	0.6813	0.6189	0.7867
No log	6.32	316	0.6058	0.7117	0.6058	0.7784
No log	6.36	318	0.5975	0.6926	0.5975	0.7730
No log	6.4	320	0.6067	0.7195	0.6067	0.7789
No log	6.44	322	0.6631	0.7063	0.6631	0.8143
No log	6.48	324	0.7572	0.6634	0.7572	0.8702
No log	6.52	326	0.7540	0.65	0.7540	0.8683
No log	6.5600	328	0.7109	0.6768	0.7109	0.8432
No log	6.6	330	0.6768	0.6358	0.6768	0.8227
No log	6.64	332	0.6627	0.6358	0.6627	0.8140
No log	6.68	334	0.6980	0.6217	0.6980	0.8355
No log	6.72	336	0.7165	0.6217	0.7165	0.8465
No log	6.76	338	0.6956	0.6261	0.6956	0.8340
No log	6.8	340	0.6817	0.6405	0.6817	0.8257
No log	6.84	342	0.6586	0.6405	0.6586	0.8116
No log	6.88	344	0.6607	0.6405	0.6607	0.8129
No log	6.92	346	0.6953	0.6261	0.6953	0.8338
No log	6.96	348	0.7468	0.6053	0.7468	0.8642
No log	7.0	350	0.7466	0.5933	0.7466	0.8640
No log	7.04	352	0.7060	0.6261	0.7060	0.8402
No log	7.08	354	0.7137	0.5970	0.7137	0.8448
No log	7.12	356	0.7528	0.5970	0.7528	0.8676
No log	7.16	358	0.7569	0.5823	0.7569	0.8700
No log	7.2	360	0.7464	0.5823	0.7464	0.8640
No log	7.24	362	0.6951	0.6261	0.6951	0.8337
No log	7.28	364	0.6800	0.6261	0.6800	0.8246
No log	7.32	366	0.7002	0.6261	0.7002	0.8368
No log	7.36	368	0.7431	0.6014	0.7431	0.8621
No log	7.4	370	0.7746	0.6014	0.7746	0.8801
No log	7.44	372	0.7792	0.6014	0.7792	0.8827
No log	7.48	374	0.8323	0.6055	0.8323	0.9123
No log	7.52	376	0.8832	0.6055	0.8832	0.9398
No log	7.5600	378	0.8824	0.6055	0.8824	0.9393
No log	7.6	380	0.8168	0.5943	0.8168	0.9038
No log	7.64	382	0.7401	0.6293	0.7401	0.8603
No log	7.68	384	0.7070	0.6431	0.7070	0.8408
No log	7.72	386	0.7156	0.6431	0.7156	0.8459
No log	7.76	388	0.7229	0.6431	0.7229	0.8503
No log	7.8	390	0.7340	0.6431	0.7340	0.8567
No log	7.84	392	0.7241	0.6431	0.7241	0.8509
No log	7.88	394	0.7348	0.6293	0.7348	0.8572
No log	7.92	396	0.7462	0.6293	0.7462	0.8638
No log	7.96	398	0.7479	0.6293	0.7479	0.8648
No log	8.0	400	0.7289	0.6478	0.7289	0.8538
No log	8.04	402	0.6981	0.6478	0.6981	0.8355
No log	8.08	404	0.6922	0.6478	0.6922	0.8320
No log	8.12	406	0.6999	0.6478	0.6999	0.8366
No log	8.16	408	0.6788	0.6499	0.6788	0.8239
No log	8.2	410	0.6675	0.6379	0.6675	0.8170
No log	8.24	412	0.6455	0.6519	0.6455	0.8034
No log	8.28	414	0.6462	0.6519	0.6462	0.8039
No log	8.32	416	0.6442	0.6519	0.6442	0.8026
No log	8.36	418	0.6486	0.6519	0.6486	0.8053
No log	8.4	420	0.6557	0.6283	0.6557	0.8097
No log	8.44	422	0.6845	0.6261	0.6845	0.8273
No log	8.48	424	0.7054	0.6478	0.7054	0.8399
No log	8.52	426	0.7069	0.6478	0.7069	0.8408
No log	8.56	428	0.6967	0.6478	0.6967	0.8347
No log	8.6	430	0.6669	0.6283	0.6669	0.8166
No log	8.64	432	0.6431	0.6519	0.6431	0.8019
No log	8.68	434	0.6453	0.6519	0.6453	0.8033
No log	8.72	436	0.6649	0.6283	0.6649	0.8154
No log	8.76	438	0.6867	0.6261	0.6867	0.8287
No log	8.8	440	0.6993	0.6478	0.6993	0.8363
No log	8.84	442	0.6997	0.6261	0.6997	0.8365
No log	8.88	444	0.7095	0.6261	0.7095	0.8423
No log	8.92	446	0.7261	0.6431	0.7261	0.8521
No log	8.96	448	0.7244	0.6478	0.7244	0.8511
No log	9.0	450	0.7312	0.6431	0.7312	0.8551
No log	9.04	452	0.7266	0.6261	0.7266	0.8524
No log	9.08	454	0.7242	0.6261	0.7242	0.8510
No log	9.12	456	0.7133	0.6261	0.7133	0.8446
No log	9.16	458	0.7086	0.6261	0.7086	0.8418
No log	9.2	460	0.7174	0.6261	0.7174	0.8470
No log	9.24	462	0.7235	0.6217	0.7235	0.8506
No log	9.28	464	0.7306	0.6431	0.7306	0.8547
No log	9.32	466	0.7365	0.6293	0.7365	0.8582
No log	9.36	468	0.7494	0.6293	0.7494	0.8657
No log	9.4	470	0.7580	0.6154	0.7580	0.8706
No log	9.44	472	0.7709	0.6154	0.7709	0.8780
No log	9.48	474	0.7726	0.6154	0.7726	0.8789
No log	9.52	476	0.7695	0.6154	0.7695	0.8772
No log	9.56	478	0.7636	0.6154	0.7636	0.8738
No log	9.6	480	0.7511	0.6431	0.7511	0.8667
No log	9.64	482	0.7412	0.6431	0.7412	0.8609
No log	9.68	484	0.7307	0.6431	0.7307	0.8548
No log	9.72	486	0.7233	0.6431	0.7233	0.8505
No log	9.76	488	0.7167	0.6431	0.7167	0.8466
No log	9.8	490	0.7169	0.6431	0.7169	0.8467
No log	9.84	492	0.7205	0.6431	0.7205	0.8488
No log	9.88	494	0.7219	0.6431	0.7219	0.8496
No log	9.92	496	0.7240	0.6431	0.7240	0.8509
No log	9.96	498	0.7261	0.6431	0.7261	0.8521
0.353	10.0	500	0.7271	0.6431	0.7271	0.8527

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 4, 2024
Updated: Dec 4, 2024