ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k9_task1_organization

MayBashendy/ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k9_task1_organization

ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k9_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

54% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 23, 2024
Updated: Dec 23, 2024
SHA: 6dda210d

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k9_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.8720
Qwk: 0.6385
Mse: 0.8720
Rmse: 0.9338

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 16
eval_batch_size: 16
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0870	2	7.9303	-0.0474	7.9303	2.8161
No log	0.1739	4	5.6391	-0.0411	5.6391	2.3747
No log	0.2609	6	3.9930	0.0148	3.9930	1.9982
No log	0.3478	8	2.9155	0.1017	2.9155	1.7075
No log	0.4348	10	2.1344	0.1807	2.1344	1.4610
No log	0.5217	12	1.5911	0.1818	1.5911	1.2614
No log	0.6087	14	1.3180	0.2711	1.3180	1.1480
No log	0.6957	16	1.1645	0.3369	1.1645	1.0791
No log	0.7826	18	1.0895	0.3526	1.0895	1.0438
No log	0.8696	20	1.0181	0.4117	1.0181	1.0090
No log	0.9565	22	0.9745	0.4313	0.9745	0.9871
No log	1.0435	24	1.0014	0.4961	1.0014	1.0007
No log	1.1304	26	1.0191	0.4779	1.0191	1.0095
No log	1.2174	28	1.0345	0.4743	1.0345	1.0171
No log	1.3043	30	1.0448	0.4433	1.0448	1.0221
No log	1.3913	32	0.9776	0.4937	0.9776	0.9887
No log	1.4783	34	0.9622	0.4892	0.9622	0.9809
No log	1.5652	36	0.9131	0.5146	0.9131	0.9556
No log	1.6522	38	0.8489	0.5191	0.8489	0.9213
No log	1.7391	40	0.8587	0.5209	0.8587	0.9267
No log	1.8261	42	0.8376	0.5255	0.8376	0.9152
No log	1.9130	44	0.7926	0.5442	0.7926	0.8903
No log	2.0	46	0.7825	0.5976	0.7825	0.8846
No log	2.0870	48	0.8604	0.5539	0.8604	0.9276
No log	2.1739	50	0.9468	0.5089	0.9468	0.9730
No log	2.2609	52	1.0062	0.4447	1.0062	1.0031
No log	2.3478	54	0.8958	0.5145	0.8958	0.9465
No log	2.4348	56	0.7973	0.5832	0.7973	0.8929
No log	2.5217	58	0.7082	0.6399	0.7082	0.8416
No log	2.6087	60	0.6607	0.6366	0.6607	0.8129
No log	2.6957	62	0.6581	0.6238	0.6581	0.8112
No log	2.7826	64	0.6464	0.6502	0.6464	0.8040
No log	2.8696	66	0.7143	0.6434	0.7143	0.8452
No log	2.9565	68	0.8682	0.5870	0.8682	0.9318
No log	3.0435	70	0.9599	0.5496	0.9599	0.9797
No log	3.1304	72	0.8801	0.6084	0.8801	0.9381
No log	3.2174	74	0.7088	0.6494	0.7088	0.8419
No log	3.3043	76	0.6542	0.7026	0.6542	0.8088
No log	3.3913	78	0.6656	0.6723	0.6656	0.8158
No log	3.4783	80	0.6981	0.6371	0.6981	0.8355
No log	3.5652	82	0.8767	0.5781	0.8767	0.9363
No log	3.6522	84	0.9626	0.5659	0.9626	0.9811
No log	3.7391	86	0.8369	0.5920	0.8369	0.9148
No log	3.8261	88	0.6422	0.6606	0.6422	0.8014
No log	3.9130	90	0.5936	0.6983	0.5936	0.7704
No log	4.0	92	0.5962	0.6983	0.5962	0.7721
No log	4.0870	94	0.6579	0.6668	0.6579	0.8111
No log	4.1739	96	0.6977	0.6478	0.6977	0.8353
No log	4.2609	98	0.7104	0.6511	0.7104	0.8429
No log	4.3478	100	0.7043	0.6379	0.7043	0.8392
No log	4.4348	102	0.7375	0.6584	0.7375	0.8588
No log	4.5217	104	0.7685	0.6584	0.7685	0.8766
No log	4.6087	106	0.7621	0.6679	0.7621	0.8730
No log	4.6957	108	0.9044	0.6226	0.9044	0.9510
No log	4.7826	110	0.9379	0.6132	0.9379	0.9684
No log	4.8696	112	0.9157	0.6198	0.9157	0.9569
No log	4.9565	114	0.8249	0.6447	0.8249	0.9082
No log	5.0435	116	0.6662	0.6879	0.6662	0.8162
No log	5.1304	118	0.6204	0.6951	0.6204	0.7877
No log	5.2174	120	0.6192	0.6972	0.6192	0.7869
No log	5.3043	122	0.6289	0.6785	0.6289	0.7930
No log	5.3913	124	0.7053	0.6803	0.7053	0.8398
No log	5.4783	126	0.7632	0.6654	0.7632	0.8736
No log	5.5652	128	0.6857	0.7021	0.6857	0.8281
No log	5.6522	130	0.6128	0.6869	0.6128	0.7828
No log	5.7391	132	0.6321	0.7140	0.6321	0.7950
No log	5.8261	134	0.6552	0.7118	0.6552	0.8094
No log	5.9130	136	0.6270	0.7094	0.6270	0.7918
No log	6.0	138	0.6369	0.6961	0.6369	0.7980
No log	6.0870	140	0.7776	0.6613	0.7776	0.8818
No log	6.1739	142	0.9628	0.5558	0.9628	0.9812
No log	6.2609	144	0.9535	0.5721	0.9535	0.9765
No log	6.3478	146	0.7484	0.6855	0.7484	0.8651
No log	6.4348	148	0.6257	0.6917	0.6257	0.7910
No log	6.5217	150	0.6342	0.6968	0.6342	0.7964
No log	6.6087	152	0.6255	0.6984	0.6255	0.7909
No log	6.6957	154	0.6795	0.7042	0.6795	0.8243
No log	6.7826	156	0.7865	0.6504	0.7865	0.8868
No log	6.8696	158	0.7660	0.6654	0.7660	0.8752
No log	6.9565	160	0.7571	0.6683	0.7571	0.8701
No log	7.0435	162	0.6860	0.6977	0.6860	0.8282
No log	7.1304	164	0.6531	0.6879	0.6531	0.8081
No log	7.2174	166	0.6339	0.6830	0.6339	0.7962
No log	7.3043	168	0.6201	0.6891	0.6201	0.7875
No log	7.3913	170	0.6159	0.7078	0.6159	0.7848
No log	7.4783	172	0.6204	0.7033	0.6204	0.7876
No log	7.5652	174	0.6266	0.7066	0.6266	0.7916
No log	7.6522	176	0.6694	0.6853	0.6694	0.8182
No log	7.7391	178	0.7645	0.6518	0.7645	0.8744
No log	7.8261	180	0.8966	0.6274	0.8966	0.9469
No log	7.9130	182	0.8431	0.6375	0.8431	0.9182
No log	8.0	184	0.7120	0.6781	0.7120	0.8438
No log	8.0870	186	0.7154	0.6706	0.7154	0.8458
No log	8.1739	188	0.7539	0.6778	0.7539	0.8683
No log	8.2609	190	0.7142	0.6706	0.7142	0.8451
No log	8.3478	192	0.6981	0.6819	0.6981	0.8355
No log	8.4348	194	0.7630	0.6675	0.7630	0.8735
No log	8.5217	196	0.7590	0.6675	0.7590	0.8712
No log	8.6087	198	0.7155	0.6832	0.7155	0.8459
No log	8.6957	200	0.7172	0.6736	0.7172	0.8469
No log	8.7826	202	0.7198	0.6670	0.7198	0.8484
No log	8.8696	204	0.7120	0.6766	0.7120	0.8438
No log	8.9565	206	0.7430	0.6872	0.7430	0.8620
No log	9.0435	208	0.8203	0.6442	0.8203	0.9057
No log	9.1304	210	0.7832	0.6495	0.7832	0.8850
No log	9.2174	212	0.7280	0.6851	0.7280	0.8532
No log	9.3043	214	0.6974	0.6756	0.6974	0.8351
No log	9.3913	216	0.7323	0.7060	0.7323	0.8557
No log	9.4783	218	0.8127	0.6487	0.8127	0.9015
No log	9.5652	220	0.8074	0.6397	0.8074	0.8986
No log	9.6522	222	0.7343	0.6627	0.7343	0.8569
No log	9.7391	224	0.7087	0.6653	0.7087	0.8418
No log	9.8261	226	0.7109	0.6830	0.7109	0.8431
No log	9.9130	228	0.7211	0.6421	0.7211	0.8492
No log	10.0	230	0.7142	0.6660	0.7142	0.8451
No log	10.0870	232	0.7115	0.6608	0.7115	0.8435
No log	10.1739	234	0.7048	0.6563	0.7048	0.8395
No log	10.2609	236	0.7202	0.6768	0.7202	0.8486
No log	10.3478	238	0.7632	0.6468	0.7632	0.8736
No log	10.4348	240	0.7458	0.6673	0.7458	0.8636
No log	10.5217	242	0.7146	0.6727	0.7146	0.8453
No log	10.6087	244	0.7422	0.6658	0.7422	0.8615
No log	10.6957	246	0.7479	0.6720	0.7479	0.8648
No log	10.7826	248	0.7646	0.6749	0.7646	0.8744
No log	10.8696	250	0.7626	0.6496	0.7626	0.8732
No log	10.9565	252	0.7687	0.6579	0.7687	0.8767
No log	11.0435	254	0.7660	0.6471	0.7660	0.8752
No log	11.1304	256	0.7598	0.6397	0.7598	0.8717
No log	11.2174	258	0.7530	0.6609	0.7530	0.8678
No log	11.3043	260	0.7581	0.6341	0.7581	0.8707
No log	11.3913	262	0.7518	0.6372	0.7518	0.8671
No log	11.4783	264	0.7565	0.6186	0.7565	0.8698
No log	11.5652	266	0.7776	0.6354	0.7776	0.8818
No log	11.6522	268	0.8163	0.6155	0.8163	0.9035
No log	11.7391	270	0.7867	0.6202	0.7867	0.8869
No log	11.8261	272	0.7448	0.6168	0.7448	0.8630
No log	11.9130	274	0.7459	0.6448	0.7459	0.8636
No log	12.0	276	0.7515	0.6185	0.7515	0.8669
No log	12.0870	278	0.7554	0.6146	0.7554	0.8691
No log	12.1739	280	0.7672	0.6616	0.7672	0.8759
No log	12.2609	282	0.7817	0.6421	0.7817	0.8841
No log	12.3478	284	0.8119	0.6779	0.8119	0.9010
No log	12.4348	286	0.7846	0.6729	0.7846	0.8858
No log	12.5217	288	0.7665	0.6303	0.7665	0.8755
No log	12.6087	290	0.8100	0.6003	0.8100	0.9000
No log	12.6957	292	0.8325	0.6071	0.8325	0.9124
No log	12.7826	294	0.7901	0.5992	0.7901	0.8889
No log	12.8696	296	0.8239	0.6779	0.8239	0.9077
No log	12.9565	298	0.9040	0.6239	0.9040	0.9508
No log	13.0435	300	0.8745	0.6836	0.8745	0.9352
No log	13.1304	302	0.8091	0.6729	0.8091	0.8995
No log	13.2174	304	0.7968	0.5909	0.7968	0.8926
No log	13.3043	306	0.8402	0.6154	0.8402	0.9166
No log	13.3913	308	0.8004	0.5965	0.8004	0.8947
No log	13.4783	310	0.7852	0.6475	0.7852	0.8861
No log	13.5652	312	0.8161	0.6843	0.8161	0.9034
No log	13.6522	314	0.8112	0.6835	0.8112	0.9007
No log	13.7391	316	0.7946	0.6793	0.7946	0.8914
No log	13.8261	318	0.7862	0.6558	0.7862	0.8867
No log	13.9130	320	0.7871	0.6241	0.7871	0.8872
No log	14.0	322	0.8089	0.6048	0.8089	0.8994
No log	14.0870	324	0.8056	0.6106	0.8056	0.8975
No log	14.1739	326	0.8278	0.6505	0.8278	0.9098
No log	14.2609	328	0.9235	0.6274	0.9235	0.9610
No log	14.3478	330	0.9073	0.6170	0.9073	0.9525
No log	14.4348	332	0.8210	0.6635	0.8210	0.9061
No log	14.5217	334	0.8103	0.5924	0.8103	0.9001
No log	14.6087	336	0.8446	0.5792	0.8446	0.9190
No log	14.6957	338	0.8328	0.5927	0.8328	0.9126
No log	14.7826	340	0.8549	0.5933	0.8549	0.9246
No log	14.8696	342	0.8178	0.6051	0.8178	0.9043
No log	14.9565	344	0.8402	0.6754	0.8402	0.9166
No log	15.0435	346	0.9588	0.6218	0.9588	0.9792
No log	15.1304	348	0.9823	0.6058	0.9823	0.9911
No log	15.2174	350	0.8825	0.6475	0.8825	0.9394
No log	15.3043	352	0.8077	0.6588	0.8077	0.8987
No log	15.3913	354	0.7958	0.6268	0.7958	0.8921
No log	15.4783	356	0.8065	0.6208	0.8065	0.8980
No log	15.5652	358	0.7903	0.6493	0.7903	0.8890
No log	15.6522	360	0.7874	0.6564	0.7874	0.8874
No log	15.7391	362	0.8089	0.6641	0.8089	0.8994
No log	15.8261	364	0.8011	0.6778	0.8011	0.8951
No log	15.9130	366	0.7755	0.6708	0.7755	0.8806
No log	16.0	368	0.7855	0.6252	0.7855	0.8863
No log	16.0870	370	0.7762	0.6382	0.7762	0.8810
No log	16.1739	372	0.7809	0.6582	0.7809	0.8837
No log	16.2609	374	0.8026	0.6887	0.8026	0.8959
No log	16.3478	376	0.8101	0.6906	0.8101	0.9000
No log	16.4348	378	0.7852	0.6499	0.7852	0.8861
No log	16.5217	380	0.7859	0.6235	0.7859	0.8865
No log	16.6087	382	0.7935	0.6555	0.7935	0.8908
No log	16.6957	384	0.8241	0.6937	0.8241	0.9078
No log	16.7826	386	0.8516	0.6734	0.8516	0.9228
No log	16.8696	388	0.8656	0.6621	0.8656	0.9304
No log	16.9565	390	0.8060	0.7038	0.8060	0.8978
No log	17.0435	392	0.7781	0.6972	0.7781	0.8821
No log	17.1304	394	0.7724	0.6884	0.7724	0.8788
No log	17.2174	396	0.8194	0.6905	0.8194	0.9052
No log	17.3043	398	0.8388	0.6800	0.8388	0.9158
No log	17.3913	400	0.8588	0.6457	0.8588	0.9267
No log	17.4783	402	0.8027	0.6843	0.8027	0.8959
No log	17.5652	404	0.7778	0.6335	0.7778	0.8819
No log	17.6522	406	0.7991	0.6079	0.7991	0.8939
No log	17.7391	408	0.7957	0.6594	0.7957	0.8920
No log	17.8261	410	0.8572	0.6875	0.8572	0.9259
No log	17.9130	412	1.0031	0.5881	1.0031	1.0015
No log	18.0	414	1.0360	0.5733	1.0360	1.0178
No log	18.0870	416	0.9460	0.6013	0.9460	0.9726
No log	18.1739	418	0.8535	0.6920	0.8535	0.9238
No log	18.2609	420	0.8223	0.6702	0.8223	0.9068
No log	18.3478	422	0.8294	0.6854	0.8294	0.9107
No log	18.4348	424	0.8685	0.6875	0.8685	0.9319
No log	18.5217	426	0.8839	0.6569	0.8839	0.9402
No log	18.6087	428	0.8529	0.6973	0.8529	0.9235
No log	18.6957	430	0.8303	0.6320	0.8303	0.9112
No log	18.7826	432	0.8354	0.6143	0.8354	0.9140
No log	18.8696	434	0.8381	0.6326	0.8381	0.9155
No log	18.9565	436	0.8872	0.6931	0.8872	0.9419
No log	19.0435	438	0.8799	0.6816	0.8799	0.9380
No log	19.1304	440	0.8396	0.6453	0.8396	0.9163
No log	19.2174	442	0.8493	0.6270	0.8493	0.9216
No log	19.3043	444	0.8583	0.6134	0.8583	0.9264
No log	19.3913	446	0.8410	0.6208	0.8410	0.9171
No log	19.4783	448	0.8295	0.6438	0.8295	0.9108
No log	19.5652	450	0.8346	0.6507	0.8346	0.9136
No log	19.6522	452	0.8383	0.6840	0.8383	0.9156
No log	19.7391	454	0.8382	0.6889	0.8382	0.9155
No log	19.8261	456	0.8263	0.6914	0.8263	0.9090
No log	19.9130	458	0.8520	0.6942	0.8520	0.9230
No log	20.0	460	0.8564	0.6942	0.8564	0.9254
No log	20.0870	462	0.8279	0.6864	0.8279	0.9099
No log	20.1739	464	0.8133	0.6728	0.8133	0.9018
No log	20.2609	466	0.8126	0.6728	0.8126	0.9014
No log	20.3478	468	0.8095	0.6158	0.8095	0.8997
No log	20.4348	470	0.8042	0.6335	0.8042	0.8968
No log	20.5217	472	0.8390	0.6936	0.8390	0.9160
No log	20.6087	474	0.8757	0.6630	0.8757	0.9358
No log	20.6957	476	0.8551	0.6760	0.8551	0.9247
No log	20.7826	478	0.8251	0.7048	0.8251	0.9083
No log	20.8696	480	0.8255	0.6870	0.8255	0.9086
No log	20.9565	482	0.8388	0.6826	0.8388	0.9158
No log	21.0435	484	0.9052	0.6489	0.9052	0.9514
No log	21.1304	486	1.0250	0.5624	1.0250	1.0124
No log	21.2174	488	1.0203	0.5624	1.0203	1.0101
No log	21.3043	490	0.9280	0.6058	0.9280	0.9633
No log	21.3913	492	0.8613	0.6618	0.8613	0.9280
No log	21.4783	494	0.8358	0.6894	0.8358	0.9142
No log	21.5652	496	0.8246	0.6857	0.8246	0.9081
No log	21.6522	498	0.8201	0.6729	0.8201	0.9056
0.5593	21.7391	500	0.8449	0.6688	0.8449	0.9192
0.5593	21.8261	502	0.9233	0.6151	0.9233	0.9609
0.5593	21.9130	504	0.9610	0.5912	0.9610	0.9803
0.5593	22.0	506	0.8990	0.6590	0.8990	0.9482
0.5593	22.0870	508	0.8315	0.6719	0.8315	0.9119
0.5593	22.1739	510	0.9357	0.6164	0.9357	0.9673
0.5593	22.2609	512	1.0951	0.5364	1.0951	1.0465
0.5593	22.3478	514	1.0627	0.5364	1.0627	1.0309
0.5593	22.4348	516	0.9000	0.6277	0.9000	0.9487
0.5593	22.5217	518	0.8220	0.6821	0.8220	0.9066
0.5593	22.6087	520	0.9593	0.5881	0.9593	0.9794
0.5593	22.6957	522	1.0182	0.5743	1.0182	1.0091
0.5593	22.7826	524	0.9588	0.5858	0.9588	0.9792
0.5593	22.8696	526	0.8530	0.6727	0.8530	0.9236
0.5593	22.9565	528	0.8138	0.6852	0.8138	0.9021
0.5593	23.0435	530	0.7970	0.6756	0.7970	0.8928
0.5593	23.1304	532	0.8049	0.6736	0.8049	0.8971
0.5593	23.2174	534	0.8267	0.6767	0.8267	0.9092
0.5593	23.3043	536	0.8326	0.6708	0.8326	0.9125
0.5593	23.3913	538	0.8130	0.6538	0.8130	0.9016
0.5593	23.4783	540	0.8147	0.6734	0.8147	0.9026
0.5593	23.5652	542	0.8459	0.6580	0.8459	0.9197
0.5593	23.6522	544	0.9017	0.6245	0.9017	0.9496
0.5593	23.7391	546	0.9250	0.6218	0.9250	0.9617
0.5593	23.8261	548	0.9225	0.6218	0.9225	0.9605
0.5593	23.9130	550	0.8720	0.6385	0.8720	0.9338

Framework versions

Transformers 4.44.2
Pytorch 2.4.1+cu121
Datasets 3.2.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 23, 2024
Updated: Dec 23, 2024