ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k9_task1_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k9_task1_organization

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k9_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

14% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: 78ceb227

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k9_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.6405
Qwk: 0.7269
Mse: 0.6405
Rmse: 0.8003

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0465	2	5.1494	-0.0293	5.1494	2.2692
No log	0.0930	4	3.0765	0.0224	3.0765	1.7540
No log	0.1395	6	2.5776	-0.1172	2.5776	1.6055
No log	0.1860	8	1.5443	0.0816	1.5443	1.2427
No log	0.2326	10	1.2770	0.2302	1.2770	1.1300
No log	0.2791	12	1.2577	0.2081	1.2577	1.1215
No log	0.3256	14	1.2235	0.2392	1.2235	1.1061
No log	0.3721	16	1.1345	0.3109	1.1345	1.0651
No log	0.4186	18	1.0615	0.3028	1.0615	1.0303
No log	0.4651	20	1.0354	0.3445	1.0354	1.0175
No log	0.5116	22	1.0973	0.3174	1.0973	1.0475
No log	0.5581	24	1.1246	0.3690	1.1246	1.0605
No log	0.6047	26	1.0528	0.4216	1.0528	1.0261
No log	0.6512	28	1.2072	0.4045	1.2072	1.0987
No log	0.6977	30	1.5130	0.3286	1.5130	1.2300
No log	0.7442	32	1.2757	0.3671	1.2757	1.1295
No log	0.7907	34	0.9464	0.4502	0.9464	0.9728
No log	0.8372	36	0.9076	0.3755	0.9076	0.9527
No log	0.8837	38	0.9115	0.3564	0.9115	0.9547
No log	0.9302	40	0.8823	0.3845	0.8823	0.9393
No log	0.9767	42	0.7717	0.5149	0.7717	0.8785
No log	1.0233	44	0.7263	0.5912	0.7263	0.8522
No log	1.0698	46	0.7050	0.6400	0.7050	0.8396
No log	1.1163	48	0.6992	0.6541	0.6992	0.8362
No log	1.1628	50	0.6615	0.6387	0.6615	0.8133
No log	1.2093	52	0.7231	0.6954	0.7231	0.8503
No log	1.2558	54	0.7496	0.7071	0.7496	0.8658
No log	1.3023	56	0.6438	0.6813	0.6438	0.8024
No log	1.3488	58	0.6163	0.6761	0.6163	0.7851
No log	1.3953	60	0.6341	0.6883	0.6341	0.7963
No log	1.4419	62	0.8197	0.6589	0.8197	0.9054
No log	1.4884	64	0.8124	0.6706	0.8124	0.9014
No log	1.5349	66	0.5751	0.7097	0.5751	0.7584
No log	1.5814	68	0.7148	0.6827	0.7148	0.8455
No log	1.6279	70	0.8530	0.6236	0.8530	0.9236
No log	1.6744	72	0.7075	0.6692	0.7075	0.8411
No log	1.7209	74	0.5580	0.7328	0.5580	0.7470
No log	1.7674	76	0.6843	0.6869	0.6843	0.8272
No log	1.8140	78	0.7279	0.6889	0.7279	0.8532
No log	1.8605	80	0.6306	0.7268	0.6306	0.7941
No log	1.9070	82	0.6520	0.7193	0.6520	0.8075
No log	1.9535	84	0.6664	0.7252	0.6664	0.8164
No log	2.0	86	0.6895	0.7115	0.6895	0.8303
No log	2.0465	88	0.6176	0.7374	0.6176	0.7859
No log	2.0930	90	0.6525	0.6715	0.6525	0.8078
No log	2.1395	92	0.7228	0.6249	0.7228	0.8502
No log	2.1860	94	0.6296	0.7036	0.6296	0.7935
No log	2.2326	96	0.6425	0.7140	0.6425	0.8016
No log	2.2791	98	0.8374	0.6073	0.8374	0.9151
No log	2.3256	100	0.7745	0.6431	0.7745	0.8800
No log	2.3721	102	0.6432	0.7181	0.6432	0.8020
No log	2.4186	104	0.6400	0.7160	0.6400	0.8000
No log	2.4651	106	0.6131	0.7143	0.6131	0.7830
No log	2.5116	108	0.6163	0.7252	0.6163	0.7851
No log	2.5581	110	0.6913	0.6960	0.6913	0.8315
No log	2.6047	112	0.8691	0.6290	0.8691	0.9322
No log	2.6512	114	0.8097	0.6227	0.8097	0.8998
No log	2.6977	116	0.6143	0.7034	0.6143	0.7838
No log	2.7442	118	0.7025	0.6358	0.7025	0.8382
No log	2.7907	120	0.7584	0.6394	0.7584	0.8709
No log	2.8372	122	0.6496	0.6746	0.6496	0.8060
No log	2.8837	124	0.6166	0.7123	0.6166	0.7853
No log	2.9302	126	0.6929	0.6482	0.6929	0.8324
No log	2.9767	128	0.6937	0.6645	0.6937	0.8329
No log	3.0233	130	0.6640	0.7120	0.6640	0.8149
No log	3.0698	132	0.6860	0.7149	0.6860	0.8282
No log	3.1163	134	0.6542	0.7227	0.6542	0.8088
No log	3.1628	136	0.6303	0.6940	0.6303	0.7939
No log	3.2093	138	0.6327	0.7007	0.6327	0.7954
No log	3.2558	140	0.6474	0.6920	0.6474	0.8046
No log	3.3023	142	0.7655	0.6690	0.7655	0.8749
No log	3.3488	144	0.7852	0.6720	0.7852	0.8861
No log	3.3953	146	0.6828	0.7243	0.6828	0.8263
No log	3.4419	148	0.6141	0.6932	0.6141	0.7837
No log	3.4884	150	0.6311	0.6915	0.6311	0.7944
No log	3.5349	152	0.5976	0.6914	0.5976	0.7730
No log	3.5814	154	0.6022	0.7174	0.6022	0.7760
No log	3.6279	156	0.7228	0.6959	0.7228	0.8502
No log	3.6744	158	0.7547	0.6805	0.7547	0.8687
No log	3.7209	160	0.7312	0.6895	0.7312	0.8551
No log	3.7674	162	0.6273	0.7420	0.6273	0.7920
No log	3.8140	164	0.5764	0.7290	0.5764	0.7592
No log	3.8605	166	0.6860	0.6957	0.6860	0.8283
No log	3.9070	168	0.7654	0.6499	0.7654	0.8749
No log	3.9535	170	0.6737	0.6950	0.6737	0.8208
No log	4.0	172	0.6185	0.6976	0.6185	0.7864
No log	4.0465	174	0.6704	0.7381	0.6704	0.8188
No log	4.0930	176	0.6632	0.7262	0.6632	0.8144
No log	4.1395	178	0.6499	0.6898	0.6499	0.8062
No log	4.1860	180	0.6602	0.6831	0.6602	0.8125
No log	4.2326	182	0.6706	0.6818	0.6706	0.8189
No log	4.2791	184	0.6560	0.6864	0.6560	0.8099
No log	4.3256	186	0.6546	0.7154	0.6546	0.8091
No log	4.3721	188	0.6489	0.7154	0.6489	0.8056
No log	4.4186	190	0.6354	0.7165	0.6354	0.7971
No log	4.4651	192	0.6446	0.6861	0.6446	0.8029
No log	4.5116	194	0.6271	0.7024	0.6271	0.7919
No log	4.5581	196	0.6513	0.7358	0.6513	0.8071
No log	4.6047	198	0.6746	0.7194	0.6746	0.8213
No log	4.6512	200	0.7038	0.6878	0.7038	0.8389
No log	4.6977	202	0.7082	0.7006	0.7082	0.8415
No log	4.7442	204	0.7102	0.6833	0.7102	0.8427
No log	4.7907	206	0.6706	0.7275	0.6706	0.8189
No log	4.8372	208	0.6612	0.7134	0.6612	0.8131
No log	4.8837	210	0.6380	0.7062	0.6380	0.7987
No log	4.9302	212	0.6305	0.7085	0.6305	0.7940
No log	4.9767	214	0.6266	0.7157	0.6266	0.7916
No log	5.0233	216	0.6160	0.7241	0.6160	0.7848
No log	5.0698	218	0.6044	0.7141	0.6044	0.7775
No log	5.1163	220	0.6021	0.7244	0.6021	0.7759
No log	5.1628	222	0.5958	0.7161	0.5958	0.7719
No log	5.2093	224	0.5996	0.7205	0.5996	0.7743
No log	5.2558	226	0.6063	0.7343	0.6063	0.7787
No log	5.3023	228	0.5963	0.7021	0.5963	0.7722
No log	5.3488	230	0.6153	0.7303	0.6153	0.7844
No log	5.3953	232	0.6148	0.7170	0.6148	0.7841
No log	5.4419	234	0.6064	0.7179	0.6064	0.7787
No log	5.4884	236	0.6156	0.7244	0.6156	0.7846
No log	5.5349	238	0.6124	0.7154	0.6124	0.7825
No log	5.5814	240	0.6017	0.7340	0.6017	0.7757
No log	5.6279	242	0.5997	0.7308	0.5997	0.7744
No log	5.6744	244	0.5899	0.7324	0.5899	0.7680
No log	5.7209	246	0.5797	0.7402	0.5797	0.7614
No log	5.7674	248	0.5744	0.7495	0.5744	0.7579
No log	5.8140	250	0.5760	0.7322	0.5760	0.7589
No log	5.8605	252	0.5912	0.7302	0.5912	0.7689
No log	5.9070	254	0.5973	0.7261	0.5973	0.7729
No log	5.9535	256	0.6002	0.7261	0.6002	0.7747
No log	6.0	258	0.6026	0.7098	0.6026	0.7763
No log	6.0465	260	0.6084	0.7064	0.6084	0.7800
No log	6.0930	262	0.6170	0.7120	0.6170	0.7855
No log	6.1395	264	0.6238	0.7072	0.6238	0.7898
No log	6.1860	266	0.6460	0.7111	0.6460	0.8037
No log	6.2326	268	0.6487	0.7183	0.6487	0.8054
No log	6.2791	270	0.6506	0.7159	0.6506	0.8066
No log	6.3256	272	0.6404	0.7126	0.6404	0.8003
No log	6.3721	274	0.6410	0.7136	0.6410	0.8006
No log	6.4186	276	0.6490	0.7114	0.6490	0.8056
No log	6.4651	278	0.6465	0.7121	0.6465	0.8040
No log	6.5116	280	0.6469	0.7090	0.6469	0.8043
No log	6.5581	282	0.6459	0.7090	0.6459	0.8037
No log	6.6047	284	0.6402	0.7026	0.6402	0.8001
No log	6.6512	286	0.6366	0.6896	0.6366	0.7979
No log	6.6977	288	0.6398	0.6854	0.6398	0.7999
No log	6.7442	290	0.6385	0.6854	0.6385	0.7990
No log	6.7907	292	0.6331	0.7022	0.6331	0.7957
No log	6.8372	294	0.6402	0.6940	0.6402	0.8001
No log	6.8837	296	0.6828	0.6988	0.6828	0.8263
No log	6.9302	298	0.7291	0.7005	0.7291	0.8539
No log	6.9767	300	0.7051	0.7152	0.7051	0.8397
No log	7.0233	302	0.6697	0.7150	0.6697	0.8184
No log	7.0698	304	0.6239	0.7243	0.6239	0.7899
No log	7.1163	306	0.6156	0.6988	0.6156	0.7846
No log	7.1628	308	0.6159	0.7035	0.6159	0.7848
No log	7.2093	310	0.6142	0.6971	0.6142	0.7837
No log	7.2558	312	0.6051	0.7111	0.6051	0.7779
No log	7.3023	314	0.6135	0.7174	0.6135	0.7833
No log	7.3488	316	0.6333	0.7055	0.6333	0.7958
No log	7.3953	318	0.6338	0.7007	0.6338	0.7961
No log	7.4419	320	0.6198	0.7014	0.6198	0.7873
No log	7.4884	322	0.6083	0.6995	0.6083	0.7800
No log	7.5349	324	0.6087	0.6995	0.6087	0.7802
No log	7.5814	326	0.6104	0.7183	0.6104	0.7813
No log	7.6279	328	0.6092	0.7325	0.6092	0.7805
No log	7.6744	330	0.6205	0.7426	0.6205	0.7877
No log	7.7209	332	0.6524	0.7411	0.6524	0.8077
No log	7.7674	334	0.6715	0.7177	0.6715	0.8194
No log	7.8140	336	0.6695	0.7403	0.6695	0.8182
No log	7.8605	338	0.6706	0.7338	0.6706	0.8189
No log	7.9070	340	0.6586	0.7366	0.6586	0.8116
No log	7.9535	342	0.6401	0.7386	0.6401	0.8001
No log	8.0	344	0.6222	0.7116	0.6222	0.7888
No log	8.0465	346	0.6145	0.7022	0.6145	0.7839
No log	8.0930	348	0.6153	0.7068	0.6153	0.7844
No log	8.1395	350	0.6234	0.7156	0.6234	0.7895
No log	8.1860	352	0.6493	0.7121	0.6493	0.8058
No log	8.2326	354	0.7050	0.6916	0.7050	0.8397
No log	8.2791	356	0.7459	0.6590	0.7459	0.8637
No log	8.3256	358	0.7680	0.6515	0.7680	0.8763
No log	8.3721	360	0.7465	0.6590	0.7465	0.8640
No log	8.4186	362	0.7294	0.6454	0.7294	0.8540
No log	8.4651	364	0.6900	0.6962	0.6900	0.8307
No log	8.5116	366	0.6679	0.7391	0.6679	0.8172
No log	8.5581	368	0.6554	0.7234	0.6554	0.8096
No log	8.6047	370	0.6473	0.7302	0.6473	0.8046
No log	8.6512	372	0.6470	0.7463	0.6470	0.8043
No log	8.6977	374	0.6510	0.7463	0.6510	0.8068
No log	8.7442	376	0.6557	0.7357	0.6557	0.8098
No log	8.7907	378	0.6604	0.7357	0.6604	0.8126
No log	8.8372	380	0.6766	0.7224	0.6766	0.8225
No log	8.8837	382	0.6914	0.7173	0.6914	0.8315
No log	8.9302	384	0.6907	0.7173	0.6907	0.8311
No log	8.9767	386	0.6789	0.7262	0.6789	0.8240
No log	9.0233	388	0.6646	0.7268	0.6646	0.8152
No log	9.0698	390	0.6520	0.7463	0.6520	0.8075
No log	9.1163	392	0.6490	0.7463	0.6490	0.8056
No log	9.1628	394	0.6528	0.7418	0.6528	0.8080
No log	9.2093	396	0.6633	0.7374	0.6633	0.8144
No log	9.2558	398	0.6671	0.7374	0.6671	0.8168
No log	9.3023	400	0.6752	0.7224	0.6752	0.8217
No log	9.3488	402	0.6789	0.7262	0.6789	0.8239
No log	9.3953	404	0.6735	0.7329	0.6735	0.8207
No log	9.4419	406	0.6652	0.7418	0.6652	0.8156
No log	9.4884	408	0.6571	0.7418	0.6571	0.8106
No log	9.5349	410	0.6512	0.7296	0.6512	0.8070
No log	9.5814	412	0.6436	0.7308	0.6436	0.8022
No log	9.6279	414	0.6405	0.7308	0.6405	0.8003
No log	9.6744	416	0.6386	0.7269	0.6386	0.7991
No log	9.7209	418	0.6395	0.7269	0.6395	0.7997
No log	9.7674	420	0.6402	0.7269	0.6402	0.8001
No log	9.8140	422	0.6398	0.7269	0.6398	0.7998
No log	9.8605	424	0.6399	0.7269	0.6399	0.7999
No log	9.9070	426	0.6400	0.7269	0.6400	0.8000
No log	9.9535	428	0.6404	0.7269	0.6404	0.8002
No log	10.0	430	0.6405	0.7269	0.6405	0.8003

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024